FACE RECOGNITION USING NEURAL NETWORKS

CONTENTS
TOPIC
ABSTRACT
LIST OF FIGURES
CHAPTER-1: INTRODUCTION
1.1 Face Recognition Technology
1.2 Working of Face Recognition Technology
1.3 Introduction to Neural Networks
1.4 Use of Neural Networks

PAGE NO.

1-5
1
2
3
4

CHAPTER-2: HUMAN AND ARTIFICIAL NEURONS

2.1 How the Human Brain Learns
2.2 From Human Neurons to Artificial Neurons

6-7
6
7

CHAPTER-3: AN ENGINEERING APPROACH

3.1 A simple Neuron
3.2 Basic Structure of Artificial Neural Network
3.3 Pattern Recognition An Example

8-12
8
8
9

CHAPTER-4:ARCHITECTURE OF NEURAL NETWORK

4.1 Feed-Forward Networks
4.2 Feedback Networks
4.3 Network Layers
4.4 Advantages
4.5 Applications of Face Recognition

13-15
13
13
14
15
15

CHAPTER-5: CONCLUSION AND FUTURE SCOPE

16

REFERENCES

18

LIST OF FIGURES
Figure 1.1 : Points of Recognition
Figure 2.1 : Components of Neuron
Figure 2.2 : The Synapses
Figure 2.3 : The Neuron Model
Figure 3.1 : A simple Neuron
Figure 3.2 : Basic Structure of Artificial Neural Network
Figure 3.3 : Network for Pattern Recognition
DEPARTMENT OF ECE

PAGE NO.
2
6
7
7
8
9
10
Page 1

FACE RECOGNITION USING NEURAL NETWORKS

Figure 3.4 : Pattern 1 T and H

Figure 3.5 : Pattern 2
Figure 3.6 : Pattern 3
Figure 3.7 : Pattern 4
Figure 4.1 : Example of a simple feed forward network
Figure 4.2 : An example of a complicated network

10
11
12
12
13
14

CHAPTER-1
INTRODUCTION
1.1 Face Recognition Technology
Face recognition technology is the least intrusive and fastest biometric technology. It works
with the most obvious individual identifier the human face.
Instead of requiring people to place their hand on a reader(a process not acceptable in
some cultures as well as being a source of illness transfer) or precisely position their eye in
front of a scanner, face recognition systems unobtrusively take pictures of people's faces as
they enter a defined area. There is no intrusion or delay, and in most cases the subjects are
entirely unaware of the process. They do not feel "under surveillance" or that their privacy
has been invaded.
Facial recognition analyzes the characteristics of a person's face images input through
a digital video camera. It measures the overall facial structure, including distances between
eyes, nose, mouth, and jaw edges. These measurements are retained in a database and used as
DEPARTMENT OF ECE

Page 2

FACE RECOGNITION USING NEURAL NETWORKS

a comparison when a user stands before the camera. This biometric has been widely, and
perhaps wildly, touted as a fantastic system for recognizing potential threats (whether
terrorist, scam artist, or known criminal) but so far has not seen wide acceptance in high-level
usage. It is projected that biometric facial recognition technology will soon overtake
fingerprint biometrics as the most popular form of user authentication.
Every face has numerous, distinguishable landmarks, the different peaks and valleys that
make up facial features. Each human face has approximately 80 nodal points. Some of these
measured by the Facial Recognition Technology are:

Distance between the eyes

Width of the nose

Depth of the eye sockets

The shape of the cheekbones

The length of the jaw line

Figure 1.1: Points of recognition

These nodal points are measured creating a numerical code, called a face print, representing
the face in the database.

DEPARTMENT OF ECE

Page 3

FACE RECOGNITION USING NEURAL NETWORKS

1.2 Working of face recognition technology:

The following four-stage process illustrates the way biometric systems operate:
Capture - a physical or behavioural sample is captured by the system during
enrolment
Extraction - Unique data is extracted from the sample and a template is created
Comparison - The template is then compared with a new sample
Matching - The system then decides if the features extracted from the new sample are
matching or not when the user faces the camera, standing about two feet from it. The
system will locate the user's face and perform matches against the claimed identity or
the facial database. It is possible that the user may need to move and reattempt the
verification based on his facial position. The system usually comes to a decision in
less than 5 seconds.
Use - Currently gaining support as a potential tool for averting terrorist crimes, facial
recognition is already in use in many law enforcement areas. Software has also been
developed for computer networks and automated bank tellers that use facial
recognition for user verification purposes.
Evaluation - One of the strongest positive aspects of facial recognition is that it is
non-intrusive. Verification or identification can be accomplished from two feet away
or more, and without requiring the user to wait for long periods of time or do anything
more than look at the camera. Face recognition is also very difficult to fool. It works
by comparing facial landmarks - specific proportions and angles of defined facial
features - which cannot easily be concealed by beards, eyeglasses or makeup.
The ideal solution - All of this makes face recognition ideal for high traffic areas
open to the general public, such as:

Airports and railway stations

Corporations

Cash points

Stadiums

Public transportation

Financial institutions

Government offices

DEPARTMENT OF ECE

Page 4

FACE RECOGNITION USING NEURAL NETWORKS

Businesses of all kind

1.3 Introduction to Neural Networks

Ever since eternity, one thing that has made human beings stand apart from the rest of
the animal kingdom is, its brain .The most intelligent device on earth, the Human brain is
the driving force that has given us the ever-progressive species diving into technology and
development as each day progresses.
Due to his inquisitive nature, man tried to make machines that could do intelligent job
processing, and take decisions according to instructions fed to it. What resulted was the
machine that revolutionized the whole world, the Computer (more technically speaking the
Von Neumann Computer). Even though it could perform millions of calculations every
second, display incredible graphics and 3-dimentional animations, play audio and video but it
made the same mistake every time.
Practice could not make it perfect. So the quest for making more intelligent device
continued. These researches lead to birth of more powerful processors with high-tech
equipments attached to it, super computers with capabilities to handle more than one task at a
time and finally networks with resources sharing facilities. But still the problem of designing
machines with intelligent self-learning, loomed large in front of mankind. Then the idea of
initiating human brain stuck the designers who started their researches one of the
technologies that will change the way computer work Artificial Neural Networks.
What is a Neural Network?
Neural Network is the specified branch of the Artificial Intelligence.
In general, Neural Networks are simply mathematical techniques designed to
accomplish a variety of tasks. Neural Networks uses a set of processing elements (or nodes)
loosely analogues to neurons in the brain (hence the same, neural networks). These nodes are
interconnected in a network that can then identify patterns in data as it is exposed to the data.
In a sense, the network learns from the experience just as people do. Neural networks can be
configured in various arrangements to perform a range of tasks including pattern recognition,
data mining, classification, and process modeling.

DEPARTMENT OF ECE

Page 5

FACE RECOGNITION USING NEURAL NETWORKS

An Artificial Neural Network (ANN) is an information processing paradigm that is

inspired by the way biological nervous systems, such as the brain, process information. The
key element of this paradigm is the novel structure of the information processing system. It is
composed of a large number of highly interconnected processing elements (neurons) working
in unison to solve specific problems. ANNs, like people, learn by example. An ANN is
configured for a specific application, such as pattern recognition or data classification,
through a learning process. Learning in biological systems involves adjustments to the
synaptic connections that exist between the neurons. This is true of ANNs as well.

1.4 Use of Neural Networks

Neural networks, with their remarkable ability to derive meaning from complicated or
imprecise data, can be used to extract patterns and detect trends that are too complex to be
noticed by either humans or other computer techniques. A trained neural network can be
thought of as an "expert" in the category of information it has been given to analyse. This
expert can then be used to provide projections given new situations of interest and answer
"what if" questions.

Other advantages include:

1. Adaptive learning: An ability to learn how to do tasks based on the data given for
training or initial experience.
2. Self-Organisation: An ANN can create its own organisation or representation of the
information it receives during learning time.
3. Real Time Operation: ANN computations may be carried out in parallel, and
special hardware devices are being designed and manufactured which take
advantage of this capability.
4. Fault Tolerance via Redundant Information Coding: Partial destruction of a
network leads to the corresponding degradation of performance. However, some
network capabilities may be retained even with major network damage.
5. Neural networks are able to represent any functions. Therefore they are called
Universal Approximators
DEPARTMENT OF ECE

Page 6

FACE RECOGNITION USING NEURAL NETWORKS

6. There are several neural network models available to choose from in a particular
problem.
7. Due to increased accuracy, results in cost saving.
8. Neural networks can be retained using additional input variables and number of
individuals. Once trained they can be called on to predict in a new patient.

CHAPTER-2
Human and Artificial Neurons - Investigating the similarities
2.1 How the Human Brain Learns?
Much is still unknown about how the brain trains itself to process information, so
theories abound. In the human brain, a typical neuron collects signals from others through a
host of fine structures called dendrites. The neuron sends out spikes of electrical activity
through a long, thin stand known as an axon, which splits into thousands of branches. At the
end of each branch, a structure called synapse converts the activity from the axon into
electrical effects that inhibit or excite activity from the axon into electrical effects that inhibit
or excite activity in the connected neurons. When a neuron receives excitatory input that is
DEPARTMENT OF ECE

Page 7

FACE RECOGNITION USING NEURAL NETWORKS

sufficiently large compared with its inhibitory input, it sends a spike of electrical activity
down its axon. Learning occurs by changing the effectiveness of the synapses so that the
influence of one neuron on another changes.

Figure 2.1 :Components of a neuron

Figure 2.2: The synapses

2.2 From Human Neurons to Artificial Neurons

DEPARTMENT OF ECE

Page 8

FACE RECOGNITION USING NEURAL NETWORKS

We conduct these neural networks by first trying to deduce the essential features of neurons
and their interconnections. We then typically program a computer to simulate these features.
However because our knowledge of neurons is incomplete and our computing power is
limited, our models are necessarily gross idealisations of real networks of neurons.

Figure 2.3: The neuron model

CHAPTER-3
AN ENGINEERING APPROACH
3.1 A simple neuron
An artificial neuron is a device with many inputs and one output. The neuron has two
modes of operation; the training mode and the using mode. In the training mode, the neuron
can be trained to fire (or not), for particular input patterns. In the using mode, when a taught
input pattern is detected at the input, its associated output becomes the current output. If the
input pattern does not belong in the taught list of input patterns, the firing rule is used to
determine whether to fire or not.

DEPARTMENT OF ECE

Page 9

FACE RECOGNITION USING NEURAL NETWORKS

Figure 3.1: A simple neuron

3.2 Basic Structure of Artificial Neural Network:

Input layer:
The bottom layer is known as input neuron network in this case x1 to x5 are
Input layer neurons.
Hidden layer:
The in-between input and output layer the layers are known as hidden layers where the
knowledge of past experience / training is there.
Output Layer:
The topmost layer which give the final output. In this case z1 and z2 are output neurons.

DEPARTMENT OF ECE

Page 10

FACE RECOGNITION USING NEURAL NETWORKS

Figure 3.2 Basic Structure of Artificial Neural Network

3.3 Pattern Recognition - an example

An important application of neural networks is pattern recognition. In machine
learning, pattern recognition is the assignment of a label to a given input value. An example
of pattern recognition is classification, which attempts to assign each input value to one of a
given set of classes (for example, determine whether a given email is "spam" or "non-spam")
Pattern recognition can be implemented by using a feed-forward (figure 1) neural network
that has been trained accordingly. During training, the network is trained to associate outputs
with input patterns. When the network is used, it identifies the input pattern and tries to
output the associated output pattern. The power of neural networks comes to life when a
pattern that has no output associated with it, is given as an input. In this case, the network
gives the output that corresponds to a taught input pattern that is least different from the given
pattern.

DEPARTMENT OF ECE

Page 11

FACE RECOGNITION USING NEURAL NETWORKS

Figure 3.3: Network for pattern recognition

For example:
The network of figure 1 is trained to recognise the patterns T and H. The associated patterns
are all black and all white respectively as shown below.

Figure 3.4: Pattern 1: T and H

If we represent black squares with 0 and white squares with 1 then the truth tables for the 3
neurons after generalisation are;
Table 3.1 Top Neuron
X11:

X12:

X13:

OUT:

DEPARTMENT OF ECE

Page 12

FACE RECOGNITION USING NEURAL NETWORKS

Table 3.2 Middle Neuron

X21:

X22:

X23:

OUT:

0/1

0/1

0/1

0/1

Table 3.3 Bottom Neuron

X21:

X22:

X23:

OUT:

From the tables it can be seen the following associations can be extracted:

Figure 3.5: Pattern 2

In this case, it is obvious that the output should be all blacks since the input pattern is almost
the same as the 'T' pattern.

DEPARTMENT OF ECE

Page 13

FACE RECOGNITION USING NEURAL NETWORKS

Figure 3.6: Pattern 3

Here also, it is obvious that the output should be all whites since the input pattern is almost
the same as the 'H' pattern.

Figure 3.7: Pattern 4

Here, the top row is 2 errors away from the T and 3 from an H. So the top output is black.
The middle row is 1 error away from both T and H so the output is random. The bottom row
is 1 error away from T and 2 away from H. Therefore the output is black. The total output of
the network is still in favour of the T shape.

DEPARTMENT OF ECE

Page 14

FACE RECOGNITION USING NEURAL NETWORKS

CHAPTER 4
ARCHITECTURE OF NEURAL NETWORKS
4.1 Feed-forward networks
Feed-forward ANNs (figure 1) allow signals to travel one way only; from input to
output. There is no feedback (loops) i.e. the output of any layer does not affect that same
layer. Feed-forward ANNs tend to be straight forward networks that associate inputs with
outputs. They are extensively used in pattern recognition. This type of organisation is also
referred to as bottom-up or top-down.

4.2 Feedback networks

Feedback networks (figure 1) can have signals travelling in both directions by
introducing loops in the network. Feedback networks are very powerful and can get
extremely complicated. Feedback networks are dynamic; their 'state' is changing continuously
until they reach an equilibrium point. They remain at the equilibrium point until the input
changes and a new equilibrium needs to be found. Feedback architectures are also referred to
as interactive or recurrent, although the latter term is often used to denote feedback
connections in single-layer organisations.

Figure 4.1: An example of a simple feed forward network

DEPARTMENT OF ECE

Page 15

FACE RECOGNITION USING NEURAL NETWORKS

Figure 4.2: An example of a complicated network

4.3 Network layers

The commonest type of artificial neural network consists of three groups, or layers, of
units: a layer of "input" units is connected to a layer of "hidden" units, which is connected to
a layer of output" units. (See Figure 4.1)
The activity of the input units represents the raw information that is fed into the
network.
The activity of each hidden unit is determined by the activities of the input units and
the weights on the connections between the input and the hidden units.
The behaviour of the output units depends on the activity of the hidden units and the
weights between the hidden and output units.
This simple type of network is interesting because the hidden units are free to construct
their own representations of the input. The weights between the input and hidden units
determine when each hidden unit is active, and so by modifying these weights, a hidden unit
can choose what it represents.
We also distinguish single-layer and multi-layer architectures. The single-layer
organisation, in which all units are connected to one another, constitutes the most general
DEPARTMENT OF ECE

Page 16

FACE RECOGNITION USING NEURAL NETWORKS

case and is of more potential computational power than hierarchically structured multi-layer
organisations. In multi-layer networks, units are often numbered by layer, instead of
following a global numbering.

4.4 Advantages
When an element (Artificial neuron) of the neural network fails, it can continue
without any problem by their parallel nature.
A neural network learns and does not need to be reprogrammed.
It can be implemented in any application.
If there is plenty of data and the problem is poorly understood to derive an
approximate model, then neural network technology is a good choice.
There is no need to assume an underlying data distribution such as usually is done in
statistical modeling.
Neural networks are applicable to multivariate non-linear problems.
The transformations of the variables are automated in the computational process.
A neural network can perform tasks that a linear program cannot.

4.5 Applications of Face Recognition

Passport control at terminals in airports

Participant identification in meetings
System access control
Scanning for criminal persons

CHAPTER 5
CONCLUSION AND FUTURE SCOPE
DEPARTMENT OF ECE

Page 17

FACE RECOGNITION USING NEURAL NETWORKS

CONCLUSION
In this paper, we have proposed an intelligent face recognition system with the
following two desirable features: one-pass incremental learning and automatic generation of
training data. This system can be implemented with limited hardware constraints and is
suitable for the use in small devices where hardware capabilities are restricted such as home
security systems. A memory-based learning approach (accumulating and retraining all
previous data) may possibly obtain better recognition results but it is infeasible for large
datasets like image streams. From the online recognition experiments, we can conclude that
introducing the incremental learning function into the system is quite effective in the sense
that the system can enhance its recognition performance automatically without any
administrator intervention.

FUTURE SCOPE
Several open questions still remain in our face recognition system. First, the face
detection method introduced here is still rather immature in terms of the computation costs
and accuracy. Moreover, the robustness for image variations in rotations, size, illumination,
etc. must be improved.
Here, we evaluated the recognition performance only for small datasets of Japanese
people. From the aspect of security systems, such simple evaluations are useless. Hence, the
evaluation on the robustness for the larger datasets is necessary in practical use.
There are a number of directions for future work. The main limitation of the current
system is that it only detects upright faces looking at the camera. Separate versions of the
system could be trained for each head orientation, and the results could be combined using
arbitration methods similar to those presented here.
Preliminary work in this area indicates that detecting proles view of faces is more
difcult than detecting frontal views, because they have fewer stable features and because the
input window will contain more background pixels.

We have also applied the same algorithm for the detection of car tires and human eyes,
althoughmore work is needed.Even within the domain of detecting frontal views of faces,
more work remains.When an image sequence is available, temporal coherence can focus
attention on particular portions of the images.
DEPARTMENT OF ECE

Page 18

FACE RECOGNITION USING NEURAL NETWORKS

As a face moves about, its location in one frame is a strong predictor of its location
in next frame. Standard tracking methods, as well as expectation-based methods [2], can be
applied to focus the detectors attention. Other methods of improving system performance
include obtaining more positive examples for training, or applying more sophisticated image
preprocessing and normalization techniques.

REFERENCES
1. ELECTRONICS FOR YOU- Part 1 April 2001 & Part 2 May 2001

DEPARTMENT OF ECE

Page 19

FACE RECOGNITION USING NEURAL NETWORKS

2. ELECTRONIC WORLD - DECEMBER 2002

3. MODERN TELEVISION ENGINEERING- Gulati R.R
4. IEEE IN TELLIGENT SYS TEMS - MAY/JUNE 2003
5. WWW.FACEREG.COM
6. WWW. IMAGESTECHNOLOGY.COM
7. WWW.IEEE.COM

DEPARTMENT OF ECE

Page 20