Attendance manager Using Face Detection And

Recognition
Project – I
Submitted in partial fulfillment of the requirements for the degree of
Bachelor of Engineering in "Computer Engineering”
by:
Zubeda Idrisi VU1F1415024
Akash Kharvi VU1F1415017
Shahid Shaikh VU1F1415016
Neha Rai VU1F1415036

Under the guidance of

Mrs. Asha Rawat(Internal)

Department of Computer Engineering

Padmabhushan Vasantdada Patil Pratishthan’s College of Engineering
Vasantdada Patil Educational Complex, Eastern Express Highway, Near Everard Nagar, SIon,
Chunabhatti , Mumbai – 400022

UNIVERSITY OF MUMBAI
2017-18

CERTIFICATE OF APPROVAL
1
 Project title: Attendance manager Using Face Detection And Recognition
Submitted by:
Zubeda Idrisi VU1F1415024
Akash Kharvi VU1F1415017
Shahid Shaikh VU1F1415016
Neha Rai VU1F1415036
In partial fulfilment of the degree of B.E. in “Computer Engineering” is approved.

Guide(s): Examiner (s):

1. Internal Mrs. Asha Rawat 1.________________

2. External _______________ 2._________________

Project Convener HOD

(COMP.)

Principal
(PVPPCOE)

2
 ACKNOWLEDGEMENT

We take this opportunity to express our sincere gratitude to Mrs. Asha Rawat for her
valuable guidance in this PROJECT REPORT without which the PROJECT REPORT would not
have been completed. We are very much grateful for her untiring assistance in this report and she
has been encouraging us in eliminating the errors. The report has been developed as a result of
her valuable advice.

We are also grateful for the cooperation, valuable suggestion rendered by “Mr.Mahavir
Devmane” , as a head of computer department and all other teaching staff of the computer
department. We are greatly indebted to management of our college and express appreciation and
thanks to our principal “Dr. Alam N Shaikh” , for coordinating keen interest and providing
necessary facilities in completing the SEMINAR REPORT.

We are thankful to our classmates and friends for their support and being such a good
company. We extend our gratitude to researchers and scholars whose papers and thesis have been
utilized in our seminar report.

We can say in words that we must at outset tende our intimacy for receipt of affectionate
care to PVPPCOE for providing such a stimulating atmosphere and conductive environment.

3
 ABSTRACT

This research aims at providing a system to automatically record the students’ attendance
during lecture hours in a hall or room using facial recognition technology instead of the
traditional manual methods.

Face is a complex multidimensional structure and needs a good computing techniques for
detection and recognition. Face recognition is as a two-dimensional recognition problem. The
face recognition is a process of comparing the given face with the face database. The purpose is
to find a face in database, which has the highest similarity with the given face.Attendance
management has always been a problem since it includes a lot of manual work and records to be
handled. This paper uses techniques like face Detection and Recognition to overcome these
problems. This paper incorporates the system which on just a mouse click will produce the
attendance report of student thereby reducing the manual efforts.This system will thus enable
automated attendance processing which will limits errors which are prone to manual-based
systems.

The objective behind this research is to thoroughly study the field of pattern recognition
( facial recognition) which is very important and is used in various application like identification
and detection.

4
 TABLE OF CONTENTS

Caption Page No
List of Figures

Chapter 1
Introduction…………………………………………………………………….……….7-8
1.1 Introduction…………………………………………………………………………..7
1.1.1 Biometrics…………………………………………………………………..7
1.2 Aim and Objectives……………………………………………………………….….7-8
1.3 Motivation for the work…………………………………………………...................8
1.4 Scope of Project…………………………………………………………...................8

Chapter 2
Literature Survey and Problem Specification…………………………………….......9-11
2.1 Introduction…………………………………………………………………………..9
2.2 Existing System……………………………………………………………………....9
2.2.1 Overall procedure…………………………………………………………...10
2.2.2 Advantages………………………………………………………………….10
2.2.3 Disadvantages……………………………………………………………....11
2.3 Need of New System…………………………………………………………………11
2.4 Problem Definition…………………………………………………………………...11

Chapter 3
Design and Implementation…………………………………………………………….12-16
3.1 Proposed System………………………………………………………………………12
3.1.1 Principal Component Analysis (PCA)............................................................12
3.1.2 EigenFace Approach………………………………………………………...12
3.1.3 Advantages of PCA method………………………………………………....12-13
3.2 Design………………………………………………………………………………...13-15
3.2.1 All UML Diagrams………………………………………………………….13
3.3 Algorithms …………………………………………………………………………...16

Chapter 4………………………………………………………………………………...17
Conclusion……………………………………………………………………………….17
4.1 Summary……………………………………………………………………………...17
4.2 Future Scope………………………………………………………………………….17

Chapter 5………………………………………………………………………………...18
References………………………………………………………………………………..18
5.1 References…………………………………………………………………………....18

5
 LIST OF FIGURES

Figure No. Caption Page No.

2.1 Illustration of the original algorithm……………………..10

3.1 Use Case Diagram………………………………………..13

3.2 Flowchart…………………………………………………14

3.3 Data Flow Diagram………………………………………14

3.4 Sequence Diagram……………………………………….15

6
 CHAPTER NO 1
Introduction

1.1. Introduction
Everyday actions are increasingly being handled electronically, instead of pencil and paper
or face to face.This growth in electronic transactions results in great demand for fast and
accurate user identification and authentication.In this paper, we propose a system that takes the
attendance of students for classroom lecture. Our system takes the attendance automatically using
face recognition.Here a face is undeniably connected to its owner expect in the case of identical
twins. The core technology is face detection, which is essential to identify a student which is
done using biometrics. It can be used to automatically recognize an individual.

1.1.1 Biometrics
A biometric is a unique, measurable characteristic of a human being that can be used to
automatically recognize an individual or verify an individual’s identity.Biometrics is used in the
process of authentication of a person by verifying or identifying that a user requesting a network
resource is who he, she, or it claims to be, and vice versa. There are many types of biometric
system like fingerprint recognition, face detection and recognition, iris recognition etc.
Biometrics can measure both physiological and behavioral characteristics.
● Physiological biometrics: This biometrics is based on measurements and a derived
from direct measurement of a part of the human body.
● Behavioral biometrics: this biometrics is based on measurements and data derived
from an action.

1.2. Aim and Objectives of the project

1.2.1 Aim
Our aim is to thoroughly study the field of pattern recognition ( facial recognition) which
is very important and is used in various application like identification and detection.
Also our aim is to build an Attendance marking system with the help of facial recognition
owing to the difficulty in the manual as well as other traditional means of attendance system.

1.2.2 Objective
● To reduce the manual work for attendance.
● Automated update in the database without human intervention.
● Proxy attendance is eliminated.
● Automatic attendance of students are marked using face detection and recognition
● Implement robust, efferent face recognition system based on facts found in the research.
1.3. Motivation for the work
Taking attendance in large classes is:
7
 ● Cumbersome
● Repetitive
● Consumes valuable class time
So, our motivation is to overcome all these problems.

1.4. Scope of the Project

Face detection and recognition is an emerging field of research with many challenges such
as large set of images, improper illuminating conditions. Principal Component Analysis (PCA)
face recognition method is used to design the proposed system. Intensity normalization technique
is used for handling bad illuminated images.

CHAPTER NO 2
Literature Survey
2.1 Introduction
8
 With the development of image sensor technology, the AdaBoost-based face detections are
widely used in many monitoring sensor networks and mobile-camera-based applications. Fast
face detection with high detection accuracy and low power consumption in such kinds of
applications is very important. Since the AdaBoost-based face detection exhibits characteristics
of data computation in dual direction and data diversity, we propose an AdaBoost-based face
detection system using parallel configurable architecture with optimized computation. The
architecture consists of parallel configurable arrays and two-level shared memory systems. It
achieves dual-direction-based integral image computation that improves parallel processing
efficiency and enables the subwindow adaptive cascade classification for data diversity, which
further improves the detection efficiency in diverse face detection. Compared with the state-of-
the-art works, this work achieves maximal performance of 30 frames/s at 1080p detection speed
and extreme low power consumption.

2.2 Existing System

An AdaBoost-Based Face Detection System
We divide the current implementations of AdaBoost-based face detection system into three
categories, which are introduced in the following discussion. First, many works optimize the
algorithm on general-purpose architectures. These general-purpose architectures have the
computation flexibility because they are programmable. However, the sequential instruction
execution and frequent memory accessing limit the efficiency of integral image computation.
Since the algorithm is characterized by huge amounts of computation , exploiting the parallelism
of the algorithm by using multicore- or multiprocessor-based hardware architectures, including
the General Public Utilities, is an effective way to improve the processing capability. However,
the power consumption of these works is large, which makes them lack the adaptability in diverse
detection scenes.
Second, in order to achieve real-time detections, some works implemented application-
specified integrated circuits (ASICs). These works achieve fast computation on the integral
image by ASIC implementations, but the fixed circuits make it lack the flexibility of cascade
classification for data diversity. Kyrkou and Theocharides proposed a flexible parallel
architecture based on the systolic array to improve the processing efficiency of integral image
computation. This architecture can be used in several different applications by training different
classifiers; however, its integral image is computed only in one direction, and it lacks the design
considerations for data diversity.
Third, the flexible hardware such as a field-programmable gate array (FPGA) has also
been used to process the detection algorithm. The FPGA can be reconfigured to accelerate the
algorithm and adjust the parameters to achieve the computation flexibility on the detection
accuracy and computation time. However, these FPGAs are fine-grained and statically
reconfigurable, which bring the extra power consumption and limit the processing efficiency. The
integral image computation is the key part in the algorithm and exhibits dual-direction
computation; meanwhile, the cascade classification exhibits the flexibility requirements for data
diversity. The contributions of our work can be concluded in three aspects.

9
 Fig. 2.1. Illustration of the original algorithm

2.2.1 Overall procedure

First, we propose the dual-direction-based integral image computation. It can improve the
parallel processing efficiency of the integral image computation.
Second, we propose the subwindow adaptive classification mechanism. Based on history
parameters of subwindows, we predict the new parameters for the current frame to reduce the
redundant data and useless computations.
Finally, we propose a parallel flexible architecture based on these methods. The
experimental results show that this architecture can achieve high processing speed and low power
consumption in the AdaBoost-based face detection. It also shows strong computation flexibility
in diverse face detections.

2.2.2 Advantages
● It uses integral image computation that is dual-direction-based integral which
enhances efficiency of parallel processing.
● High processing speed.
● Low power consumption for face detection.
● Improves the processing speed and reduces.

2.2.3 Disadvantages
● Adaboost is very useful in face detection but also a known fact that boosting increases the
overall complexity of the system.
● It is particularly useful for relatively "simple" learners.

2.3 Need of New System

10
 The Adaboost is very useful in face detection but also a known fact that boosting increases
the overall complexity of the system. So, it is particularly useful for relatively "simple" learners.
And that's the reason why there is need for the new system to overcome these limitations.

2.4 Problems Definition

Attendance Management System using face detection and recognition is software
developed for daily student attendance in schools, colleges and institutes. It facilitates to access
the attendance information of a particular student in a particular class. This system will also help
in evaluating attendance eligibility criteria of a student. By just a click on the mouse, the system
will be able to produce the student's’ attendance report thus reducing the need for manual labour
which is prone to human errors and time consuming.This application is built for automating the
processing of attendance. It also enhances the speed of performing attendance task easily.

CHAPTER NO 3
Design and Implementation

11
3.1 Proposed System
3.1.1 Principal Component Analysis (PCA)
Principal component analysis (PCA) was invented in 1901 by Karl Pearson Images of
faces, represented as high-dimensional pixel arrays, often belong to a manifold of intrinsically
low dimension. PCA does the reduction of variables into smaller number of variables which are
called Principal Components which will account for the most of the variance in the observed
variable. The major advantage of PCA is using it in eigenface approach which helps in reducing
the size of the database for recognition of a test images. Goal of PCA is to reduce the
dimensionality of the data by retaining as much as variation possible in our original data set.
In this technique eigenvectors with highest eigenvalue is created. The eigenvector are
derived from the covariance matrix of the probability distribution over the high dimensional
vector space of face images.The eigenfaces themselves from a basis set of all images used to
construct the covariance matrix. The PCA feature vector are extracted. To recognize a particular
input query face ,the system compares the face’s feature vector to the feature vector of the
database faces using Euclidean distance nearest neighbour classifier. The images are stored as
their feature vectors in the database which are found out projecting each and every trained image
to the set of Eigenfaces obtained. PCA is applied on Eigenface approach to reduce the
dimensionality of a large data set.

3.1.2 EigenFace Approach:

Eigenfaces are a set of Eigen vector used in the Computer Vision problem of human face
recognition. EigenFace method is adequate and efficient method to be used in face recognition
due to its simplicity, speed and learning capability. The Eigenfaces are Principal Components of a
distribution of faces, or the Eigenvectors of the covariance matrix of the set of the face images.
In this method we have to extract the relevant information from a face image, encode it
efficiently and compare one face encoding with a database of faces encoded similarly. A simple
approach to extracting the information content in an image of a face is to somehow capture the
variation in a collection of face images. These eigenvectors can be a set of features that together
characterize the variation between face images. Each individual face can be represented exactly
in terms of a linear combination of the eigenfaces. Each face image can be represented exactly in
terms of linear combination of the Eigenfaces. The number of possible Eigen faces is equal to the
number of face image in the training set. In linear algebra, Eigenvector is a vector that is scaled
by linear transformation that is EigenValue . It is a property of matrix.

3.1.3 Advantages of PCA method

● The major advantage of the PCA technique is it uses Eigen Face approach which is fast in
recognition.
● The another advantage of PCA is using it in eigenface approach which helps in reducing
the size of the database for recognition of a test images.
● The PCA technique is easy to implement. PCA is applied on Eigenface approach to reduce
the dimensionality of a large data set.

3.2 Design
3.2.1 All UML Diagrams
The Unified Modeling Language (UML) is a language for specifying, visualizing and
constructing the artifacts of software system as well as for business models. GRADY BOOCH,
IVAR JACOBSON and JAMES RUMBAUGH are the founders of the UML. The UML notation
is useful for graphically depicting Object Oriented Analysis and Object Oriented Design (OOA
12
and OOD) modules. The unified modeling language is a standard language for specifying,
Visualizing, Constructing and documenting the software system and its components.
Diagrams are graphical presentation of set of elements. Diagrams project a system, or
visualize a system from different angles and perspective.

Figure 3.1: Usecase Diagram:

Figure 3.2 Flowchart

13
Figure 3.3 DataFlow Diagram
Level 0:

14
Level 1:

Figure 3.4 Sequence Diagram :

15
3.3 Algorithms
Algorithm for PCA method
Each face is represented by Γ 1 , Γ 2 , Γ 3 , … . Γ m . Feature vector of a face is stored in a
Ν × Ν matrix. Now, this two dimensional .vector is changed to one dimensional vector.
Average face image can be calculated as
1 ❑
ψ=( ) ∑ m Γ i
Μ i=1
As ψ=(Γ 1 + Γ 2 + Γ 3 +…+ Γ m )/M
i=¿ Γ i−Ψ
Each face differs from the average by which is called mean centered image.
φ¿
A covariance matrix is constructed as c= A AT
where A=[ϕ 1 , ϕ 2, ϕ 3, … ϕM ] of size Ν 2 × Ν 2 .
Consider the eigenvectors ⋃ i of A T A A T A such that
T
A A Χ i =λi Χ i
T
A A ( A Χ i)=λi ( A Χ i )
Eigenvectors corresponding to A A T can now be easily calculated now with reduced
dimensionality where A Χ i is the Eigenvector and λi is the Eigenvalue. The Eigenvectors of
the covariance matrix A A T are A Χ i which is denoted by ∪i .
That are called Eigenfaces. The faces are discarded for which Eigenvalues are zero thus
reducing the Eigenface space to an extent. The Eigenfaces are ranked according to their
usefulness in characterizing the variation among the images.
16
 The test image, Γ , is projected into the face space to obtain a vector, as Ω
T
Ω=∪ ( Γ k −Ψ )
The distance of Ω to each face is called Euclidean distance and defined by
2 2
ϵ k =∥ Ω−Ωk ∥ k =1,2… m
A face is classified as belonging to class k when the minimum ∈k is below some
chosen threshold θc . otherwise the face is classified as unknown.
θc , is half the largest distance between any two face images:
1
Chosen threshold θc =( )max j , k ∥ Ω j−Ωk ∥ where j,k= 1,2...m
2
If ϵ ≥θ c then input image is not even a face image and not recognized.
If ϵ <θ c and ∈k ≥ θc for all k then input image is a face image but it is recognized as 12
unknown face.
If ϵ <θc and ∈k < θc for all k then input images are the individual face image
associated with the class vector. The face will be recognized.

CHAPTER NO 4
Conclusion

4.1 Summary
The present project will be developed to meet the aspirations indicated in the modern age.
An attempt has been made through this project to. It will provide Various features required by
user’s. It will take attendance for a classroom lecture by using face detection and recognition by
using PCA algorithm in its implementation.thus,it will automate the attendance system.

4.2 Future Scope

Approach of camera planning based on the result of the position estimation in order to
improve face detection effectiveness. In further work, we intend to improve face detection
effectiveness by using the interaction among our system, the students and the teacher. On the
other hand, our system can be improved by integrating video-streaming service and lecture
archiving system, to provide more profound applications in the field of distance education, course
management system (CMS) and support for faculty development (FD).

17
 CHAPTER NO 5
References

5.1 References

[1] Avenir K. Troitsky Assistant Professor, Department of Cybernetics, National Research

Nuclear University “MEPhI“(Moscow Engineering Physics Institute), 31, Kashirskoe
highway, Moscow, 115409, Russia Feb. 2013.

[2] Y.-L. Tian An AdaBoost-Based Face Detection System Using Parallel Configurable
Architecture With Optimized Computation.

[3] Face Recognition Detection by Probabilistic Decision Based.

[4] Face Recognition using EigenFaces.

18