Sie sind auf Seite 1von 10

TKR COLLEGE OF ENGINEERING & TECHNOLOGY

Meerpet, Hyderabad

PAPER PRESENTATION

ON

BLUE EYES TECHNOLOGY

Presented By

K.ASHISH KUMAR I.V.SAI MANOJ


CSE III BTECH CSE III BTECH
kumawathash@gmail.com ivsaimanoj@gmail.com
Phno-9291537617 phno-9885696940
ABSTRACT the computer the human power. We all have
some perceptual abilities. That is we can
understand each other’s feelings. For
BLUE EYES is a technology, which
example we can understand ones emotional
aims at creating computational machines
state by analyzing his facial expression. If
that have perceptual and sensory abilities
we add these perceptual abilities of human
like those of human beings. The basic idea
to computers would enable computers to
behind this technology is to give computer
human power.
These cues are analyzed to determine the
user’s physical, emotional, or informational
Blue in this term stands for Bluetooth,
state. More efficient and effective HCI
which enables reliable wireless
mainly it works on Paul Ekman’s facial
communication and the eyes work together
expression theory which related to Anger,
with human beings as intimate partners.
Fear, Sadness, Disgust, Joy,
because the eye movement enables us to
surprise.
obtain a lot of interesting and important
information.

Is it possible to create a computer


which can interact with us as we interact
each other? For example imagine in a fine
morning you walk on to your computer
room and switch on your computer, and then
it tells you “Hey friend, good morning you
seem to be a bad mood today. And then it
opens your mail box and shows you some of
the mails and tries to cheer you. It seems to EMOTION MOUSE made by galvanic skin
be a fiction, but it will be the life lead by response (GSR), heart rate, skin
“BLUE EYES” in the very near future. The temperature, general somatic activity (GSA).
basic idea behind this technology is to give
Galvanic skin response (GSR) includes brain involvement using eye motility
Measuring the Electrical Resistance of the analysis.
skin. The one component of polygraph
How can we make computers "see" and
devices is used and its work usually based
"feel"?
on acupuncture point. gaze pointing is
used .which is useful for who have Hand
Blue Eyes uses sensing technology to
unavailable. IBM Almaden Eye-tracker is
identify a user's actions and to extract key
used.
Human error is still one of the most information. This information is then
frequent causes of catastrophe and analyzed to determine the user's physical,
ecological disasters. The main reason is that emotional, or informational state, which in
the monitoring systems concern only the turn can be used to help make the user more
state of the processes where as human productive by performing expected actions
contribution to the overall performance of or by providing expected information. For
the system is left unsupervised. Since the example, a Blue Eyes-enabled television
control instruments are automated to a large could become active when the user makes
extent, a human operator becomes a passive eye contact, at which point the user could
observer of the supervised system, which then tell the television to "turn on".
results in weariness and vigilance drop.
In the future, ordinary household
Thus, he may not notice important
devices -- such as televisions, refrigerators,
changes of indications causing financial or
and ovens -- may be able to do their jobs
ecological consequences and a threat to
when we look at them and speak to them.
human life. It therefore is crucial to assure
that the operator’s conscious brain is
Blue Eyes system can be applied in
involved in an active system supervising
every working environment requiring
over the whole work time period. It is
permanent operator's attention- at power
possible to measure indirectly the level of
plant control rooms, at captain bridges, at
the operator’s conscious brain is involved in
flight control centers and professional
an active system supervising over the whole
drivers.
work time period. It is possible to measure
indirectly the level of operator’s conscious
INTRODUCTION Blue Eyes perceptual abilities to computers would
Monitoring Human-Operator System enable computers and humans to work
together more as partners. Toward this end,
the Blue Eyes project aims at creating
computational devices with the sort of
perceptual abilities that people take for
granted.

What is Blue Eyes?


BLUE EYES is a technology, which
aims at creating computational machines
that have perceptual and sensory abilities
like those of human beings. The basic idea
behind this technology is to give computer
human power.
For example, we can understand
humans’ emotional state by his facial
expressions. If we add these perceptual
abilities to computers, we would enable
them to work together with human beings as
Animal survival depends on highly intimate partners. It provides technical
developed sensory abilities. Likewise, means for monitoring and recording human-
human cognition depends on highly operator’s physiological condition.
developed abilities to perceive, integrate,
What is Blue Eyes not?
and interpret visual, auditory, and touch
information. Without a doubt, computers • Doesn’t predict nor interfere with
would be much more powerful if they had operator’s thoughts.
even a small fraction of the perceptual
• Cannot force directly the operator to
ability of animals or humans. Adding such
work.
How are blue and eyes related?
As the idea is to monitor and record
operator’s basic physiological parameters,
the most important physiological activity is
the movement of eyes. For a computer to
sense the eye movement, wiring between
operator and the system is required. But, this
is a serious limitation of the operator’s
mobility and disables his operations in large
control rooms.
So utilization of wireless technology
becomes essential which can be
implemented through blue tooth technology.

CREATING HUMAN
POWER TO
COMPUTERS

• It uses non-obtrusive sensing


method, employing most modern
video cameras and microphones to
identify the users’ actions through
the use of imparted sensory abilities.
• The blue eyes system checks the
physiological parameters like eye
movement, heart beat rate and blood
oxygenation against abnormal and
undesirable values and triggers user- OVERALL SYSTEM
defined alarms when necessary.
• Blue eyes technology requires DIAGRAM
designing a personal area network
The overall system diagram of the
linking all the operators and the
structure of blue eye technology consists of
supervising system.
the following peripherals and each of them
• As the operator using his sight and
has their own importance in the
hearing, senses the state of the
functionality.
controlled system, the supervising
system will look after his
DATA ACQUISITION UNIT:
physiological condition.
• The use of a miniature CMOS • It maintains Bluetooth connections.
camera integrated into the eye
• Gets information from the sensor.
movement sensor will enable the
• Sends information over the wireless
system to calculate the point of gaze
connection.
and observe what the operator is
• Delivers the alarm messages sent
actually looking at.
from the Central System Unit (CSU)
• Introducing voice recognition
to the operator.
algorithm will facilitate the
• Handles personalized ID cards.
communication between the operator
JazzMultisensor:
and the central system and simplify
• It’s an eye movement sensor, to
authorization process.
provide necessary physiological data
in Data Acquisition Unit (DAU).
• It supplies raw digital data

STRUCTURE regarding eye position, the level of

Blue eyes system consists of a mobile blood oxygenation acceleration

measuring device called Data Acquisition along horizontal and vertical axes

Unit (DAU) and a central analytical system and ambient light intensity.

called Central System Unit (CSU). • Eye movement can be measured


using direct infrared oculographic
transducers.
HD44780 - small LCD display
24C16 - I2C EEPROM (on a
removable ID card)
CENTRAL SYSTEM UNIT: MC145483 – 13bit PCM codec
Jazz Multisensor interface
• Maintains blue tooth connections in beeper and LED indicators, 6 AA
batteries and voltage level monitor
the other side.
• CENTRAL SYSTEM UNIT:
• Buffers incoming sensor data. Central System Unit hardware is
the second peer of the wireless
• Performs on-line data analysis.
connection. The box contains a
• Records the conclusion for further Bluetooth module (based on
ROK101008) and a PCM codec for
exploration. voice data transmission. The module is
• Provides visualization interface. interfaced to a PC using a parallel, serial
and USB cable. The audio data is
accessible through standard minijack
THE HARDWARE sockets to program operator's personal
• DATA ACQUISITION UNIT: ID cards we developed a simple
programming device. The programmer is
Data Acquisition Unit is a mobile
interfaced to a PC using serial and
part of the Blue eyes system. Its main
PS/2(power source) ports. Inside, there
task is to fetch the physiological data
is Atmel 89C2051 microcontroller,
from the sensor and to send it to the
which handles UART transmission and
central system to be processed. To
I2C EEPROM (ID card) programming.
accomplish the task the device must
manage wireless Bluetooth connections THE SOFTWARE
(connection establishment, Blue Eyes software's main task is to
authentication and termination). Personal look after working operators'
ID cards and PIN codes provide physiological condition. To assure
operator's authorization. Communication instant reaction on the operators'
with the operator is carried on using a condition change the software performs
simple 5-key keyboard, a small LCD real time buffering of the incoming data,
display and a beeper. When an real-time physiological data analysis and
exceptional situation is detected the alarm triggering. The Blue Eyes
device uses them to notify the operator. software comprises several functional
Voice data is transferred using a small modules system core facilitates the
headset, interfaced to the DAU with transfers flow between other system
standard mini-jack plugs. The Data modules(E.g. transfers raw data from the
Acquisition Unit comprises several Connection Manager to data analyzers,
hardware modules processed data from the data analyzers to
Atmel 89C52 microcontroller - GUI controls, other data analyzers, data
system core logger etc.). The System Core
Bluetooth module (based on fundamental are single-producer-multi-
consumer thread safe queues. Any
ROK101008)
number of consumers can register to pulse rate analyzer - uses blood
receive the data supplied by a producer. oxygenation signal to compute operator's
Every single consumer can register at pulse rate
any number of producers, receiving custom analyzers - recognize other
therefore different types of data. behaviors than those which are built-in
Naturally, every consumer may be a the system. The new modules are created
producer for other consumers. This using C4.5 decision tree induction
approach enables high system scalability algorithm
– new data processing modules (i.e. • VISUALISATION:
filters, data analyzers and loggers) can This module provides a user
be easily added by simply registering as interface for the supervisors. It enables
a costumer. them to watch each of the working
• CONNECTION MANAGER: operator’s physiological condition along
It is responsible for managing the with a preview of selected video source
wireless communication between the and related sound stream. All the
mobile Data Acquisition Units and the incoming alarm messages are instantly
central system. The Connection Manager signaled to the supervisor. The
handles: Visualization module can be set in an
communication with the CSU off-line mode, where all the data is
hardware fetched from the database. Watching all
searching for new devices in the the recorded physiological parameters,
covered range alarms, video and audio data the
establishing Bluetooth connections supervisor is able to reconstruct the
connection authentication course of the selected operator’s duty.
incoming data buffering The physiological data is presented
sending alerts. using a set of custom-built GUI controls:
• DATA ANALYSIS: a pie-chart used to present a
This module performs the analysis percentage of time the operator was
of the raw sensor data in order to obtain actively acquiring the visual information
information about the operator’s
physiological condition. The separately A VU-meter showing the present value
running Data Analysis module of a parameter time series displaying a
supervises each of the working
operators. The module consists of a history of selected parameters' value.
number of smaller analyzers extracting
different types of information. Each of FEATURES OF THE
the analyzers registers at the appropriate
Operator Manager or another analyzer as SYSTEM
a data consumer and, acting as a
producer, provides the results of the
analysis. The most important analyzers • Visual attention monitoring (eye
are:
motility analysis).
saccade detector - monitors eye
movements in order to determine the • Physiological condition monitoring
level of operator's visual attention
(pulse rate, blood oxygenation).
• Operator’s position detection • It can reconstruct the course of
(standing, lying). operator’s work.
• Wireless data acquisition using
Super yacht BLUE EYES Has
Bluetooth technology.
Accommodation:
• Real-time user-defined alarm
triggering. The sizeable luxury yacht motor yacht
• Physiological data, operator's voice BLUE EYES can sleep up to 12 passengers
and overall view of the control room and 14 qualified crew.
recording recorded data playback.
• database. Defining alarm conditions.
ADVANTAGES
• Configuring logging tools.
• It has the ability to gather
• Creating new analyzer modules.
information about you and interact
with you through special techniques
like facial recognition, speech
APPLICATIONS
recognition, etc.
• It can even understand your Blue Eyes system can be applied in
emotions at the touch of the mouse. every working environment requiring
• It can verify your identity, feel your permanent operator's attention.
presence, and start interacting with
you. • At power plant control rooms.
• The machine can understand what a • At captain bridges.
user wants, where he is looking at, • At flight control centers.
and even realize his physical or • Professional drivers.
emotional states.
• It realizes the urgency of the CONCLUSION
situation through the mouse.
• For instance if you ask the computer Thus blue eye technology is a
to dial to your friend at his office, it dynamic tool with long history and
understands the situation and capability to adapt to new levels of
establishes a connection. technology.
• The wireless link between the
sensors worn by the operator and the
supervising system makes it possible
to improve overall reliability, safety
and assures proper quality of system
performance.
• These new possibilities can cover
areas such as industry,
transportation, military command
centers or operation theaters.
• Researchers are attempting to add
more capabilities to computers that
will allow them to interact like
humans, recognize human presents,
talk, listen, or even guess their
feelings.