 Aims at creating computational machines

that have perceptual and sensory ability.

 Use camera and microphone to identify user

actions and emotions
The term BLUE EYES
 BLUE in the term stands for Bluetooth,
which enables reliable wireless
communication
 EYES , because the eye movement enables

us to obtain a lot of interesting and

important information.
 To built a machine that can understand
your emotions
 A pc that can listen, talk or scream
 Verify your identity, feels your presence
and interact with you.
 Emotion Mouse
 Manual And Gaze Input Cascaded (MAGIC)
 Artificial Intelligent Speech Recognition
 Simple User Interest Tracker (SUITOR)
 Simplest way
 People spend approximately 1/3 of their

total computer time touching input device

 Physiological data is obtained and
emotional state is determined
 A user model will be built that reflects the

personality of user
 Measurement of heart rate, temperature,
galvanic skin response (GSR), general
somatic activity
 Heart rate was measured with chest strap

sensor, temperature with thermocouple

attached to a digital multimeter (DMM), GSR
also with DMM, somatic movement with
computer mouse movements
 Six basic emotions are anger, fear, sadness,

disgust, joy and surprise

 Firstly, a multidimensional procedure was
used to determine dimensionality of data
 Fit the physiological similarities and dis-

similarities into four dimensional table

 Secondly, discriminant function analysis
was used to determine mathematic function
that would distinguish the six emotional
state.
 Suggest that all four physiological variables

are sufficient to distinguish the six states

 To dynamically redefine the home position of the
pointing cursor to be at the close vicinity of the target
 Reduce the cursor movement needed for target
selection
 Click on the target with a regular manual input device
 Two magic pointing techniques

a) Liberal
b) Conservative
 Improvement over the traditional eye gaze system
 Reduce physical effort and fatigue, greater accuracy
and naturalness and faster speed than traditional eye
gaze system
 Unnatural to overload a perceptual channel with a
motor control task
 The subconscious jittery motion of eyes
 Eye, a primary perceptual device is not a control
organ
 Target not selected if not looked at for a set
threshold
 Target selected if stared at without user intention
 To warp the cursor to every new object user
looks at
 User take control of the target by hand near the

target or ignore it and search for next

 “Pro active” since cursor

wait on every potential

target
 “over active” when user

merely looking at the

target
 Does not warp the cursor target until the manual
input device has been actuated
 Cursor is warped to gaze area reported by the

eye tracker
 Steer the cursor towards the target to complete

the target acquisition

 Cursor position is offset

to the intersection of
manual actuation vector
and the boundary of
gaze area
 Reduction of manual stress and fatigue
 Practical accuracy level
 A more natural mental model for the user
 Faster than pure manual pointing
 Improved subjective speed and ease of use
 Liberal approach is distracting when the
user is trying to read
 The motor action computation cannot start

until the cursor appears

 In conservative approach, uncertainty of the

exact location prolong the target acquisition

time
 Rely on a single light source that is off or on the axis
 Illumination from an off axis source generate a dark
pupil image
 On axis generate a bright pupil image
 Use two infrared time multiplexed light sources
composed of two IR LED’s
 Pupil detection is realized by

subtracting dark pupil image

from bright pupil image
 After thresholding difference

largest connected component

is identified as pupil
 Input words are scanned and matched against
internally stored words
 Identification causes some action to be taken
 User speaks to the computer through
microphone
 Filtered and fed to ADC and then stored in RAM
 Binary representation become standard ,
against which future are compared
 pattern matching is designed to look for the
best fit because of variations in loudness, pitch,
frequency difference, time gap etc.
 To control weapons by voice commands
 Pilot give commands to computers by speaking
into microphones
 For making airline and hotel reservations
 For making reservations, canceling reservations
or making enquiries
 Can be connected to word processors and
instead of writing, simply dictate to them
 Help by fetching more information at
desktop
 Notice where the user’s eyes focus on the

screen
 Fills a scrolling ticker on a computer screen

with information related to user’s task

 Ex. If reading headline ,pops up the story in

the browser window

BLUE EYES ENABLED DEVICES

 POD
Technology used in
cars

 PONG
A Robot
BLUE EYES technology can be used :
 In retailing record and interpret customer

movements
 In automobile industry
 In video games
 To create “Face Responsive Display” and

“Perceptive Environment”
 Provide more delicate and user friendly
facilities in computing devices
 Gap between the electronic and physical

world is reduced
 The computers can be run using implicit

commands instead of the explicit

commands
 Thank u…

ANY
QUESTIONS ???