Handwriting Analysis Using Image Processing and Pattern Recognition

Naveen Kumar B.M, 2nd Year M.Tech, P.E.S.C.E, Mandya

Abstract – Handwriting analysis is a modern form of psychology that identifies personality traits and human
character through handwriting. This paper demonstrates how we can use Image Processing and Pattern Recognition
techniques for Handwriting analysis. Even though analysis can be done manually, to get 100% accuracy and to save
time I thought of giving a techno-touch to this science. So I came out with this idea of using image processing
techniques for handwriting analysis.

1. Introduction Traditionally, these methods are grouped into

In image processing, after acquiring a digitized
image, the main tasks are: enhancement or
rectification; segmentation; measurement; and
data analysis. Image enhancement and image
rectification are often used to emphasize certain
features and to remove artifacts respectively.
Two types of measurements are made: feature
measurements are taken off individual objects
which have been defined by a segmentation
process, and field measurements are obtained
globally from complete images. Finally, these
feature and field measurements must be
analyzed.
two categories: structural methods and feature
space methods. Structural methods are useful in
situations where the different classes of entity
can be distinguished from each other by
structural information, e.g. in character
recognition different letters of the alphabet are
structurally different from each other. The
earlier-developed structural methods were the
syntactic methods, based on using formal
grammars to describe the structural are machine
vision methods such as those based on poling
distribution models, active contours,etc.

Pattern recognition by computer is, in 2. Image Processing and Pattern

general, a complex procedure requiring a variety Recognition
of techniques that successively transform the
iconic data to information directly usable for 2.1 Image Processing
recognition. Many methods of artificial pattern
Sight is a human being’s principle
recognition have been proposed, applicable in
sense. A visual image is rich in information
general not only to objects in a visual image but
from the outer world and receiving and
also to other types of real world entity.
analyzing such images is part of the routine
activity of human beings throughout their In image processing, after acquiring a
walking lives. At a more sophisticated level, digitized image, the main tasks are:
human beings may generate record or transmit enhancement or rectification; segmentation;
images. These activities together comprise measurement; and data analysis, as indicated in
image processing. Figure 2.1. Image enhancement and image
rectification are often used to emphasize certain
Theories and techniques of image
features and to remove artifacts respectively.
processing originated in the study of optics and
Two types of measurements are made: feature
optical instruments. However, the advent of measurements are taken off individual objects
digital computers opened vast new possibilities which have been defined by a segmentation
for artificial image processing. By the mid- process, and field measurements are obtained
1960’s, third-generation computers offered the globally from complete images. Finally, these
speed and storage necessary for practical feature and field measurements must be
implementation of image-processing algorithms; analyzed.
and in 1964 the capabilities of digital image
processing were spectacularly demonstrated
when pictures of the moon transmitted b the
Enhanceme segment Feature
Ranger 7 space probe were processed to correct nt or ation measureme
various types of image distortion inherent in the nt

on-board television camera.

Since that date, the field of image processing

Field
has experienced vigorous growth. Digital image measurem
ent
processing techniques are used today in a wide
range of applications that, although otherwise Digital Image
unrelated, share a common need for methods Data
analysis
capable of enhancing pictorial information for
human interpretation and analysis. These
applications include: remote sensing; security
monitoring; medical diagnosis; automatic
inspection; radar; sonar; detection of military Interpretati
targets; robotics; business communication; on
television enhancement;etc.
Fig 2.1 Diagram of Image processing for object
In civil engineering, it has been used for recognition
structural monitoring, hydrology, and soil
microstructure.
2.2 Pattern Recognition

In communication with the outer world, one of recognition have been proposed, applicable in
the most important goals for human beings is to general not only to objects in a visual image but
recognize objects. For example, from an image, also to other types of real world entity.
image set, or image sequence of objects, we
need to recognize which directions the objects
are oriented toward, where they are located, Traditionally, these methods are grouped into
how they are arranged, what size and shape they two categories: structural methods and feature
have, and what sorts of things they are. space methods. Structural methods are useful in
situations where the different classes of entity
During the past 30 years, pattern recognition
can be distinguished from each other by
has had a considerable growth. The need for
structural information, e.g. in character
theoretical methods and experimental software
recognition different letters of the alphabet are
and hardware is increasing. Applications of
structurally different from each other. The
pattern recognition now include: character
earlier-developed structural methods were the
recognition; target detection; medical diagnosis;
syntactic methods, based on using formal
biomedical signal and image analysis; remote
grammars to describe the structural are machine
sensing; identification of human faces and of
vision methods such as those based on point
fingerprints; reliability analyses;
distribution models, active contours,etc.
socioeconomics; archaeology; speech
recognition and understanding; machine part
recognition; automatic inspection; and many
others In feature-space methods, a set of
measurements (typically numerical) is made on
each real-world entity (or pattern), and from the
measurement set there is extracted a set of
Pattern recognition by computer is, in
features which together characterize the class of
general, a complex procedure requiring a variety
patterns to which the given pattern belongs. The
of techniques that successively transform the
features are regarded as the elements of a vector
iconic data to information directly usable for
drawn from the origin in a multi-dimensional
recognition. Many methods of artificial pattern
feature space. Ideally, the measurements and
features are so chosen that (a) the extremities of
the vectors representing patterns belonging to
the same class tend to cluster together in a
region of feature space, and (b) the extremities
of the vectors representing patterns belonging to
different classes tend to occur in distinct such
clusters in distinct regions of feature space. A
classifier can then assign an unseen real-world
pattern to a particular class according to the
region of feature space in which the vector
representing this pattern falls.
The traditional approach to feature-space
pattern recognition is the statistical approach,
where the boundaries between the regions
representing pattern classes in feature space are
found by statistical inference based on a design
set of sample patterns of known class
membership. An unseen pattern can then be
classified simply by determining the region of
feature space in which it lies. An alternative
approach is to use a mathematical or physical
model of the pattern generating mechanism to
predict the regions: this approach is useful in
situations where it is costly or impossible to
obtain sufficient numbers of design samples to
allow statistical conclusions to be drawn form
them with any degree of confidence. A third
possibility, which appears to be due to the
author, is to choose features sot hat the total
hyper volume of feature space within which
feature points can occur is know a priori. The
whole of feature space can then be partitioned
according to some suitable scheme for the
problem in hand. This approach might be useful
where there exists a continuum of pattern
classes, rather than a set of discrete classes.
Feature-space methods are useful in situations
where the distinctions between different pattern
classes are readily expressible in terms of
numerical measurements of this kind. Such a
situation often exists, for example, in the study
of soil microstructure, where, for example,
important distinctions between soil particles,
required by soil engineers, are based on such
considerations as roundness versus angularity.
These and other aspects both of the nature of a
soil particle and of soil structure lend
themselves to numerical measurement, and there
was an urgent need for numerically based
classification for immediate comparison with
numerical properties of the soil. The feature
space approach is the one that has therefore
been used in this research.
3. Design Issues in Pattern
Recognition System
Unclassified specimens are the specimens
which are to be classified. Pattern analysis is the
process of extracting the characteristics of the
specimens; these characteristics might be
measurements or structured observations.
Training is specimens whose class membership
is taken as known a priori; in almost all cases, it
is the set of characteristics obtained from these
specimens which is used.
A priori definitions are definitions of the
classes which have been set up in advance,
either on the basis of some theoretical analysis
or in an entirely arbitrary fashion depending on
the nature of the problem. The criteria are
definitions of the closeness with which an
unclassified specimen must match the definition
of a particular class in order to be placed in that
class; if no class is sufficiently closely matched,
the specimen ma be rejected i.e. not placed in
any class. These criteria may be set to broad or
narrow limits depending on the use to which the
results of the classification will be put.
Decision making is the process of
comparing the actual characteristics with those
on which the classification is to be based. In
some cases, it is appropriate to monitor the lack
of fit, i.e. the error, and to use this to modify the
set of characteristics which is actually being
used for classification.
Classifier (Analysis Phase)
Unclassified Pattern
Analysis
Specimens
Criteria
A pattern is the set of characteristics which is
inherent in a sample. These patterns may be
taken from real samples; BT some synthetic
patterns designed to test the system may be
included. Here, pattern analysis is the process of
extracting the actual set of characteristics to be
used in the classification.
The a priori definitions, training samples,
and criteria, are the current versions of these
parts of the system; but during the design
process, these may not yet have been finalized.
The results are then inspected to see whether
they are judged to be satisfactory. If not, the
error is fed back to modify the current versions
of the parts of the system. Figures 3.1(a) and
3.2(b) is a simplified and generalized view of
the process of designing a pattern recognition
system.
Error
Decision classes
making
A priori Training
definitio samples
 Figure 3.1(a) Operation of a pattern recognition system

A priori Error
definition
s

Pattern Training Decision

Patterns recognitio samples making classes
n

Criteria

Figure 3.1(b) Designing a pattern recognition system.

4. Example System: Handwriting Analysis personality is a subcategory of general psychology.

Handwriting analysis is a modern form of psychology
that identifies personality traits and human character
through handwriting. Personality is the term for
behavior and character. In the study of psychology,
Personality is a cluster of character traits and the
corresponding behaviors based on those character
traits. Handwriting analysis is the quickest way to
accurately discover someone’s true personality out of To get accuracy we will be comparing all the letters,
any formal psychological test on the market today. instead of stopping at one or two letters.

Handwriting analysis is categorized into to groups, If the letters are not segregated it is not possible to
those are apply this method.

1. Micro Analysis 2. Macro Analysis

We can reveal more than 100 personality traits using In this we need find the size of the writing as well as
this analysis. Even though not all the letters slant of the writing. This can be done by using
contributes to this analysis, we will need them at Emotional Gauge.
some point of time.
AB B CD
C
With the help of image processing and pattern
DE
recognition techniques we would be able to segregate
each letters from the handwriting samples.
E+

After that we would be comparing the captured

Large
image (i.e. letter) with the pre-defined set of images. Averag
e
If that particular criterion matches then we will say Small

that the man has that particular trait.

So, we need to maintain a database for storing the Fig 4.1 Emotional Gauge.

pre-defined images. Before we compare the captured

The first step is to decide which letters you are going
letter with the pre-defined image, we will place a
to use to measure slant. Some letters have three or
control point (collection of pixels) on the captured
more strokes to constitute the entire letter. Measuring
letter, to avoid the conflict between two over lapped
for slant is actually measuring one stroke; so many
letters
letters could have more than one measurable stroke,

Let us see with an example, consider the letter ‘t’ or none. The easiest letters to measure are the cursive

which is captured from the handwriting sample. t, b, l, m, n, r, s, d, h, and k.

5. Applications and Limitations of

Control
Handwriting Analysis
points

5.1 Applications of Handwriting Analysis

Here the control points are considered as edges for There are many uses of handwriting analysis. Below
that letter, we would be only concentrating only up to are a few of the most popular applications we use
those edges not beyond. today. You will find more.

• Dating and Socializing

 • Employee hiring and human resources • Handwriting samples must be scanned
or captured through digital cameras.
• Police profiling

• Self improvement and professional speaking

6. Conclusion
• Counselor, therapist, and coaching
applications. The work presented here is mainly aimed at
analyzing the people’s handwriting to know more
5.2 Limitations of Handwriting analysis
about them through the computer by making use of

Below are a few of the limitations of Handwriting the science called graphology.

analysis
I hope the tool which I am designing will reach out
the people for the best utilization. I am aiming at the
• Handwriting does not reveal the AGE of the
design of the tool which will be very much user
writer
friendly rather than a messy one.
• Handwriting does not reveal the Gender of
The proposed scheme assumes that the handwriting
the writer
samples provided for analysis are legible to read and
• Handwriting does not reveal if the writer has not a printed one as well.
written using left or the right hand or any
The future work encompasses finding out the hell
other part of the body.
traits and giving the remedy for it.

• Caste, religion, race, creed or religious

References
preferences cannot be found in the
handwriting [1] Daisheng Luo, Pattern Recognition and Image
Processing, Horwood Publishing 1998.
• The future cannot be predicted with the
handwriting. [2] Jorge Boliva, Nearest Neighbor in Pattern
Recognition, IEEE/ACM, Jan 1990.

[3] Laveen Kanal, On Patterns and Categories, 11th

Limitations when we do analysis using image
international conference on Pattern Recognition,
processing techniques are:
September 1992

• We cannot know the pressure of

[4] Bart A Baggett, Handwriting Analysis & Success
writing.
Secrets

• Dealing with illegible writing is

difficult.