IJSRD - International Journal for Scientific Research & Development| Vol.

4, Issue 03, 2016 | ISSN (online): 2321-0613

Prediction of Changes on Facial Structure in Anaplasty using Kinect
Ms. Arati Choudhari1 Ms. Ashlesha Waghmare2 Ms.Gautami Bhake3 Ms.Ruchita Tetu4
Department of Computer Technology
Rajiv Gandhi College of Engineering and Research, Wanadongari, Nagpur
Abstract— now a day, plastic surgeons uses only traditional Feature extraction is the process of transforming
model to show after effects of surgery. In traditional model large amount of input data to the reduced set of features in
includes clay model does not show accurate dimension of terms of image. After applying this procedure on input
one’s particular face. Using this system plastic surgeons will image, we will get 3-D data model and that 3-d data model
able to predict changes on face without doing any operation link with Patient Health Record (PHR).PHR contains
procedures such as Anaplasty. This project is aimed at to attributes of patient such as Name, Age, Sex, and Date of
predict the facial changes in anaplasty using this Birth
revolutionary 3D game sensor. Anaplasty is termed as
surgical operation involving reconstruction or reformation of II. LITERATURE SURVEY
any structure using healthy tissue, usually in the course of Samarth Bharadwaj attention increasing popularity of plastic
cosmetic procedures. It is essential that the operating surgeon surgery and its effect on automatic face recognition has
has accurate and up to date information about defect face of attracted attention from the research community. However,
patient. At the present instance, patients do not know the the nonlinear variations introduced by plastic surgery remain
effect of anaplasty prior to surgery. We proposed a novel tool difficult to be modelled by existing face recognition systems
that helps to find face with effects of surgery. To make this [1]
. In this research, a multi objective evolutionary granular
system Kinect technology is used. algorithm is proposed to match face images before and after
Key words: Plastic Surgeons, Kinect, Anaplasty plastic surgery. The algorithm first generates no disjoint face
granules at multiple levels of granularity. The granular
I. INTRODUCTION information is assimilated using a multi objective genetic
In recent years, plastic surgery has become popular approach that simultaneously optimizes the selection of
worldwide. People take facial plastic surgery to correct feature extractor for each face granule along with the
feature defects or improve attractiveness and condense. weights of individual granules.
According to the statistics from American Society for Mayank Vatsa advancement and affordability is
Aesthetic Plastic Surgery from 1997 to 2011, there has been leading to the popularity of plastic surgery procedures.
over 197% increase in the total number of cosmetic Facial plastic surgery can be reconstructive to correct facial
procedures. The above statistical recognized lead to a feature anomalies or cosmetic to improve the appearance [2].
practical requirement on identity authentication after plastic Both Corrective as well as cosmetic surgeries alter the
surgery [1]. Especially, for face- based biometrics, plastic original facial information to a large extent thereby posing a
surgery poses a great challenge, because not only local skin great Challenge for face recognition algorithms. 1)
texture but also face components such as eyelid and nose Preparing a face database of 900 individuals for plastic
might be disturbed or reshaped in plastic surgery [1]. Even surgery, and 2) Providing an analytical and experimental
the holistic appearance of face may greatly change because underpinning of the effect of plastic surgery on face
of the global face plastic surgery such as face lift or skin recognition algorithms.
peeling. Matching post-surgery images with pre-surgery Rajesh Kumar Gupta proposed the Principal
images becomes an arduous task for automatic face Component Analysis (PCA) which decomposes a face
recognition algorithms. Plastic surgery procedures induce image into a small set of characteristic feature images called
intra face (face image versions of the same person) Eigen faces and recognition is performed by projecting a
dissimilarity, which are obstruction to robust face new face onto a low dimensional linear “face space” defined
recognition. by the Eigen faces, followed by computing the distance
Kinect is Real time motion sensing input device between the resultant position in the face space and those of
developed by Microsoft. It consists of 2 cameras 1. RGB known face classes [4]. The objective of the Principal
(Red, Green, Blue) 2. IR Depth (Infrared Depth) and one Component Analysis (PCA) is to take the total variation on
microphone array. RGB image provides the texture and the training set of faces and to represent this variation with
appearance whereas depth map provides the distance of each just some
pixel from the sensor. An RGB-D image captured using Little variables. When we are working with great
consumer devices such as Kinect is fundamentally different amounts of images, reduction of space dimension is very
from a 3D image captured using range sensors due to the important. PCA intends to reduce the dimension of a group
manner in which they capture the target. Kinect captures or space so that the new base describes the typical model of
RGB-D image by utilizing an infrared laser projector the group. The image space is highly redundant when it
combined with a monochrome CMOS sensor. 3D sensors on describes faces. This happens because each pixel in a face is
the other hand utilize specialized high quality sensors to highly correlated to the others pixels. The objective of PCA
obtain accurate range and texture image [3]. is to reduce the dimension of the work space.
3D face recognition approaches utilize techniques Richa Singh and Afzel Noore proposed
such as Principal Component Analysis (PCA) and Linear experimental and analytical comparison of face recognition
Discriminant Analysis (LDA) to characterize a 3D face algorithms on a plastic surgery database of 506 individuals.
model [4]. The experimental results indicate that existing face

All rights reserved by www.ijsrd.com 659
Prediction of Changes on Facial Structure in Anaplasty using Kinect
(IJSRD/Vol. 4/Issue 03/2016/179)

recognition algorithms perform poorly when matching pre in an appropriate lower dimensional space. PCA can be used
and post-surgery face images. The results also suggest that it to reduce the dimensions of an image but the main features
is imperative for future face recognition systems to be able are retained of an original image. The input images are very
to address this important issue and hence there is a need for noise due to different lightning conditions, pose etc.
more research in this important area.
B. Local Binary Pattern (LBP):
III. PROPOSED WORK LBP is very good means of feature description. The LBP
operator was originally designed for texture description. The
Today there is a widespread acceptance that cosmetic LBP operator assigns a label to every pixel of an image by
surgery is beneficial and even desirable, and given this thresholding the 3x3-neighborhood of each pixel with the
increasing realization, the number of plastic surgery centre pixel value and considering the result as a binary
operations undertaken around the globe has soared within number. A local binary pattern is called uniform if the
the last several decades when an individual undergoes binary pattern contains at most two bitwise transitions from
plastic surgery, the facial features are reconstructed either 0 to 1 or vice versa when the bit pattern is considered
globally or locally. In general, this process changes the circular [6]. In the computation of the LBP histogram, the
appearance. In this paper we are providing 3D model to patterns used are uniform so that the histogram has a
show the future impact of cosmetic surgery. The steps separate bin for every pattern which is uniform and all non-
involved in the proposed work are shown in figure The uniform patterns are assigned to a single bin. The original
Kinect 2.0 is used for capturing 3-D images using RGB LBP operator was using the 8 pixels being the central pixel
(Red, Green, and Blue) camera and IR depth sensor camera. as a threshold.
After capturing the face image point cloud is generated. After applying this procedure on the input image,
Point cloud is a set of data points in some coordinate defects will remove from that input image. Now formatted
system. In a three-dimensional coordinate system, image will consider as 3-D data model. This 3-D model will
these points are usually defined by X, Y, and Z coordinates, link to Patient Health Record (PHR).
and often is intended to represent the external surface of an
object. Point clouds may be created by 3D scanners. Point
cloud is converted into the meshing. Meshing is the process
of obtaining an appropriate mesh (or grid) is termed mesh Current face recognition algorithms mainly focus on
generation (or grid generation). For feature extraction two Handling pose, expression, illumination, aging and disguise.
algorithms are used: a) Principal Component Analysis Plastic surgery is becoming prevalent due to advances in
(PCA) b) Local Binary Pattern (LBP). technology, Affordability, and the speed with which these
procedures can be performed. The procedures can
A. Principle Component Analysis (PCA): significantly Change the facial regions both locally and
globally, altering. The appearance, facial features and
texture. Existing face Recognition algorithms generally rely
on this information. And any variation can affect the
recognition performance. We have studied the algorithms
which are used to extract features for 3D face recognition.
As 3D face recognition is more challenging approach rather
than 2D face recognition this algorithms are useful for 3D.
Principal Component Analysis (PCA) applied to any data
identifies the combination of attributes (principal
components, or directions in the feature space) that account
for the most variance in the data.

The authors are gratefully acknowledged the support and
generosity to Ms.Aarti Choudhari, from department of
computer technology, Rajiv Gandhi College of Engineering
and Research for their useful conversation and comments
during an earlier draft of the paper.

[1] Himanshu S. Bhatt, Samarth Bharadwaj, Richa Singh
Fig1.Proposed Work and Mayank Vatsa “Recognizing Surgically Altered
PCA is derived from the Eigen vectors. The input images Face Images Using Multi objective Evolutionary
are very noisy due to different lightning conditions, pose etc. Algorithm”. IEEE transactions on information forensics
The Eigen vector which deals with main features of any and security, Vol. 8, no. 1, January 2013.
input is known as the Principal Component of that input. [2] Richa Singh, Mayank Vatsa, Himanshu S. Bhatt,
PCA is linear transformation of an input image that maps Samarth Bharadwaj, Afzel Noore, Member, IEEE, and
data from a high dimensional space to a lower dimensional Shahin S. Nooreyezdan. “Plastic Surgery: A New
sub-space [5]. PCA approximates vectors by finding a basis Dimension to Face Recognition”. IEEE transactions on

All rights reserved by www.ijsrd.com 660
Prediction of Changes on Facial Structure in Anaplasty using Kinect
(IJSRD/Vol. 4/Issue 03/2016/179)

information forensics and security, Vol. 5, no. 3,
September 2010.
[3] M. De Marsico, M. Nappi, D. Riccio, and H. Wechsler,
“Robust face recognition after plastic surgery using
local region analysis,” in Proc. Int. Conf. Image
Analysis and Recognition, vol. 6754, pp.191–200,
[4] Rajesh Kumar Gupta, Umesh Kumar Sahu. “Real Time
Face Recognition under Different Conditions”.
International Journal of Advanced Research in
Computer Science and Software Engineering. Volume
3, Issue 1, ISSN: 2277 128X, January 2013.
[5] Di Huang, Caifeng Shan, Mohsen Ardabilian, Yunhong
Wan, and Liming Chen. “Local Binary Patterns and Its
Application to Facial Image Analysis: A Survey”. IEEE
transactions on systems, man, and cybernetics—part c:
applications and reviews, vol. 41, no. 6, November
[6] M. Pietikäinen, a Hadid, G Zhao, T Ahonen. “Computer
Vision Using Local Binary Patterns”. DOI
Limited 2011.
[7] Ms. S. S. Ghatge, Prof V. V. Dixit. “Face Recognition
under varying illumination with Local binary pattern”.
International Journal of Advanced Research in
Electrical, Electronics and Instrumentation Engineering
Vol. 2, Issue 2, February 2013.
[8] Gaurav Goswami, Student Member, IEEE, Mayank
Vatsa, Senior Member, IEEE, and Richa Singh
IEEE.”RGB-D Face Recognition with Texture and
Attribute Features.

All rights reserved by www.ijsrd.com 661