CONCEPTS OF

PATTERN RECOGNITION

National Remote Sensing Centre

Pattern recognition is a branch of

machine learning that focuses on the
recognition of patterns and regularities in a
given data.

Pattern recognition means finding

meaningful patterns in data, which can be
e tracted thro
extracted through
gh classification.
classification

National Remote Sensing Centre

1
 A pattern is a cluster of data points
i an n-dimensional
in di i l feature
f t space.

Classification is the procedure for

discriminating this cluster from the
other one in the feature space.

National Remote Sensing Centre

Pattern

B1: 43
B2: 23
B3: 21
B4: 70

Pattern

B1: 44
B2: 22
B3: 19
B4: 15

National Remote Sensing Centre

2
 National Remote Sensing Centre

Pattern recognition in remote sensing has been

based on the intuitive notion that pixels belonging
to the same class should have similar spectral
values in a given band.

Variation in a cluster will occur even if the pattern is

very well defined. This is because of Atmospheric
variability, illumination differences, sensor
parameters, etc.

National Remote Sensing Centre

3
 So, classification is a procedure to sort out
pixels and assigning them to respective
classes.

In general, two types of classification techniques

are available.

1. Supervised
2. Unsupervised
p

National Remote Sensing Centre

An Overview of Supervised Classification

National Remote Sensing Centre

4
 Supervised Classification

A classification procedure is said to be supervised if the user 
g
guides the algorithm for classification.
g

General Approach
1) Setup a classification scheme
2) Define the training data
3) Determine the  parameters required for classification
4) Select the features to be used in the classification
5) Perform the classification
6) Evaluate the classification

National Remote Sensing Centre

1) Setup a Classification Scheme

(Defining the required Land Use / Land Cover classes)

National Remote Sensing Centre

5
Classification scheme for National Level LULC mapping on annual basis
(1:250,000) using multi-temporal IRS P6 AWiFS datasets
S.No Land Use / Land Cover Class S.No Land Use / Land Cover Class
1 Built up land(Urban / Rural) 13 Wastelands : Salt Affected Land /
2 Kharif crop land Sandy Area / Mine dumps /
Industrial waste / Dumps / Barren
3 Rabi crop land rock / Stony waste / Sheet
4 Zaid crop land rock
5 Double crop land (Area sown 14 Gullied / Ravines
more than once) 15 Land with shrub / scrub
6 Current fallow land 16 Water bodies
7 Plantations / orchards Rivers / Streams/ Lakes / Ponds /
Reservoir / Tanks/ Ash pond /
8 Evergreen / Semi-Evergreen Cooling Pond / Wetland /
fforestt W t l
Waterlogged d areas
9 Deciduous forest 17 Shifting cultivation areas
10 Shrub / degraded / Scrub 18 Snow Covered / Glacial area
Forest
19 Rann
11 Littoral Swamp / Mangrove /
Fresh water Swamp 20 Cloud
12 Grassland & Grazing Land

Classification scheme for Wastelands Atlas of India 2010 (1:50,000)

National Remote Sensing Centre

6
2) Determine the  Parameters Required for Classification 
(Defining Training Data, Signature Generation, Purity & Separability)

Parametric & Non-parametric procedures

A parametric signature is based on statistical parameters of 
the training data.

A Non‐parametric signature is based on discrete objects in a

feature space. These feature space objects are used to
d fi the
define th boundaries
b d i for
f the
th classes.
l

National Remote Sensing Centre

Training Definition

FCC 432 (RGB)

National Remote Sensing Centre

7
 Non-parametric Training

Defining Training Sets Parallelepiped

National Remote Sensing Centre

Non-parametric Training

Feature Space

National Remote Sensing Centre

8
 Parametric Training

Defining Training Sets Ellipses

National Remote Sensing Centre

3) Perform the Classification

Evaluate the discriminant function and assign pixels to 
respective classes by applying the decision rule for each 
p
pixel.

Various methods are there to classify the given data using 
supervised techniques.

Parametric Non-parametric

 Minimum Distance  Parallelepiped

 Mahalanobis Distance  Feature Space
 Maximum Likelihood

National Remote Sensing Centre

9
 Parametric Image Classification

Minimum Distance Minimum Distance Classification

National Remote Sensing Centre

Parametric Image Classification

Maximum Likelihood

Agriculture

Sand

Forest Barren

Turbid Water
Deep Water

National Remote Sensing Centre

10
 Bayes' theorem
The Class‐conditional 
probability density function A priori probability

The probability that a pixel  The probability that class i
chosen randomly from a  will occur in the image
class i will have the 
measurement vector ‘x’
P ( x |  i ) P ( )
P ( i | x ) 
P( x)

The Posterior probability
The probability density function
The probability density function
The probability that a pixel 
belongs to class w given that is  The probability that a pixel 
has the characteristics ‘x’. selected at random from the 
image will have the measurement 
This is “Discriminant Function”. vector ‘x’

National Remote Sensing Centre

A Variety of Classification Techniques

 Fuzzy
F Classification
Cl ifi ti (Soft
(S ft classifier)
l ifi )
 Decision Tree Classification
 Artificial Neural Network Classification
 Texture Based Classification
 Object Based Classification
 Support Vector Machine Classification

National Remote Sensing Centre

11
 Multi-date AWiFS Data

Thresholding

Data Loss Usable Data

(Zero Fill / Cloudy)

High  in VIS & low VI Low VI &VI range Low  in NIR & very low VI

Sand Wastelands / Urban / Fallow Water

Vegetation

Low  in VIS & NIR High  in VIS & NIR

Forest / Plantation Crops Vegetables

Crop Calendar, Temporal NIR, R & VI Patterns

DECISION TREE 
Other Crops Wheat CLASSIFIER

National Remote Sensing Centre

Source: Procedure document of National Wheat Production Forecast

Classification using ANN

National Remote Sensing Centre

12
 Classification using SVM

Hyperplane

National Remote Sensing Centre

Un-supervised Classification Techniques

 K-means
K
 ISODATA

National Remote Sensing Centre

13
 User • Supervised
• Unsupervised (ISODATA, K-means)
Guidance

Data • Parametric (ML

(ML, Linear Discriminant,
Discriminant etc.)
etc )
• Non-parametric (ANN, SVM, DT, etc.)
Parameters
• Per Pixel Classifiers (ML, ANN, etc.)
• Sub-pixel Classifiers (Fuzzy, Spectral Mixture Analysis, etc.)
Pixel Info • Per Field Classifier (GIS based)
• Object based Classifier (eCognition)

Definitive • Hard
H d ClClassification
ifi i
• Soft Classification (Fuzzy)
Decision

National Remote Sensing Centre

4) Evaluation of Classification

National Remote Sensing Centre

14
National Remote Sensing Centre

Overall map accuracy

User’s Accuracy (Commission Error)
How accurate is the map?

Producer’s Accuracy  (Omission Error)
How accurately features on the
ground correctly shown on the
classified map

Kappa Coefficient of Agreement
Ability to compare two classifications

National Remote Sensing Centre

15
 Q?

National Remote Sensing Centre

Thank You!

National Remote Sensing Centre

16