TRIANGLE BASED AUTOMATIC

FACE RECOGNITION SYSTEM

USING 3D GEOMETRIC FACE
FEATURE
Presented By :
Blessy Mariam Markose
S7 AEI
Roll No : 11
1

OBJECTIVE
A new approach for face recognition system
based on 3D geometric features.
Generation of an automatic personal
identification system with improved speed and
accuracy.
Determination of structure of an object with a
developed algorithm by measurement of face
features.

INTRODUCTION
Face recognition is one of the most important
applied aspects of visual perception.
The most challenging computer vision
problem.
Has great importance in many applications.
Development of an algorithm for improved
accuracy.
Based on perspective projection of a triangle.

LIMITATIONS OF 2D SYSTEMS

Faces are considered as a flat surface.

Difference in orientation ignored.
Chance of defocus and noise.
Variation from pose and lightning.
Occlusions.
Variations in expressions.
Similarity for different individuals like twins.

A NEW APPROACH
Most of earlier researches focus around 2D
intensity images.
Face is a 3D convex object .
Need to find a robust feature set for unique
description of a human face.
An automatic face recognition system.
Provides a reliable recognition even with
varying conditions.
Based on 3D geometric features.
5

FACE RECOGNITION PROCESS

Face detection
algorithm

Acquisition System
Images acquired by camera or scanner.
Camera : Canon
Focal length : 24mm.
Frontal and slant view taken.

Preprocessing
Includes :
Resizing
Converting to grayscale
Improving image contrast
De-blurring
Noise filtering etc.

Feature Point Extraction

1.
2.
3.
4.

A region approximation algorithm developed.

Eye-Mouth detection.
Face Boundary detection.
Weighting eye-mouth triangles.

Face Detection Algorithm

10

Lighting compensation and skin tone

detection

(a) a yellow-biased face image;

(b) a lighting compensated image;
(c) skin regionsof (a) shown in white;
(d) skin regions of (b)
11

Construction of eye maps

Cb2 , (Cr)2, Cb/Cr : normalized to [0,255]

: grayscale dilation
: erosion
12

Construction of mouth map

n : the number of pixels within the face mask.

: ratio of the average Cr2 to the average Cr/Cb

13

Computation of face boundary

Verification of eye-mouth triangle is done by :

i. Luma variations.
ii. Geometry and orientation of the triangle.
iii. Presence of a face boundary around the triangle
14

3D Face Parameters
Based on perspective projection of a triangle.
Estimated using the face feature points.
Computes the 3D measurements of any 3
points (feature points) on a face.
Feature points are usually derived from the
eyes and middle of the mouth.

15

Obtaining 3D parameters of face

Specified triangles are drawn for frontal and
slant view.
Triangles drawn by connecting between eyes
and lips.
Computes 3D measurements of :
Each side of triangles.
Angles between them.

16

Euclidean distance approach

Computes length of edges.
For n-space,
d(p,q) = (ni=1 (qi-pi)2)
In 3D,
d = (p1-q1)2+(p2-q2)2+(p3-q3)2
Squared euclidean distance
d2 = (p1-q1)2+(p2-q2)2+(p3-q3)2
17

Perspective Projection of A 3D
Triangle
d3

d2

The three feature points are denoted by :

d1

P1(X1,Y1,Z1)
P2(X2,Y2,Z2)
P3(X3,Y3,Z3)

The sides of the triangle are given by :

18

 In 3D euclidean space, distance is :

2

19

Cosine rule
Computes Orientation parameter.
By law of cosines,
d12 = d22+d32-2d2d3CosP1
d22 = d12+d32-2d1d3CosP2
d32 = d12+d22-2d1d2CosP3

20

Matching Process
Ensures improved performance of face
recognition.
Comparison of acquired and database images.
Equality in calculated and stored
measurements ensured.
Indicates whether the person are same or
different.

21

Face Database
(frontal and slant view)

22

Possible Triangles between seven

points

23

EXPERIMENTS AND RESULTS

Single Triangle Matching

24

Compare result from two viewing

images and multi triangle (different
person)

25

RR Recognition Rate
ER Error rate
ST Single triangle
MT Multi triangle
26

FOR BETTER RESULTS

Recognition errors due to :
Rounding error.
False matching of feature points.
RR can be enhanced by :
Using geometric feature.
Stereo Imaging technique.

27

APPLICATIONS

Personal Identification.
Employee access to high security areas.
Human-machine interfaces.
Image retrieval.
Security system.
Credit-card verification.
Criminal identification.
Teleconferences.

28

CONCLUSION
Simple and efficient system.
Perspective transformation between 2D and
3D.
Feature extraction using face detection
algorithm.
Euclidean distance approach to compute length
of edges.
Cosine rule for orientation parameter.
Higher accuracy than 2d recognition.
29

REFERENCES
1.

2.
3.
4.

5.

Moe Ma Ma Tin and Myint Myint Sein, University of

Computer Studies, Yangon, Haling Township, Yangon,
Myanmar.
Instrumentation and Measurement Technology Conferen
ce, 2009. I2MTC '09. IEEE
; Issue Date : 5-7 May 2009 , On page(s): 895 899.
Rein-lien hsuy,mohamed abdel-mottalebz, anil K. Jainy.
Face Detection In Color Images; Appears in IEEE
TRANS. Pami, vol. 24, no. 5, pp. 696-706, may 2002.
Chellapa P., Wilson C., and Sirohey S., Human and
Machine Recognition of Faces: A Survey, Proceedings
of IEEE, vol. 83, no. 5, pages 705-740, 1995.
Brunelli R., and Poggio T. Face Recognition: Features
versus Templates, IEEE Trans. on Pattern Analysis and
Machine Intelligence, vol. 15, no. 10, pages 1042-1052,
1993.
www.wikipedia.org

30

Thank You

31

Any Queries

32