Blue eye technology

( blue eyes –
Human operator
monitoring system )
 Agenda
•Motivation
•What is
BlueEyes ?  Motivation
•Physiological
foundations
 What is BlueEye technology ?
•System
 What is BlueEyes ?
design  System designing
•System  System overview
implementation
 DAU
•Future
improvements
 CSU
•Project work
 Data security
summary  IBM research
•System  Conclusion
demonstration
 Motivation
•Motivation
•What is
BlueEyes ?
•Physiological
 Human error - a frequent reason of
foundations
•System
catastrophes and ecological disasters
design
•System
implementation
•Future -temporary indisposition
improvements
•Project work
-weariness
summary
•System
-oversight
demonstration
What is blue eye
technology ?
 The BLUE EYES technology
aims at creating
computational machines that
have perceptual and sensory
ability like those of human
beings.

 
How can we make
computers “see” and
“feel” ?
 Blue eyes uses sensing technology to
identify a user’s actions and to extract
key information.
 Information is then analyzed to
determine the user’s physical
,emotional ,or informational state.
 What is BlueEyes ?
•Motivation
•What is
BlueEyes ?
 The complex solution for human-operator monitoring:
•Physiological
foundations – Visual attention monitoring
•System – Physiological condition
design
– Operator’s position detection
•System
implementation – Wireless data acquisition using bluetooth
•Future – Real time user defined alarm triggering
improvements
– Recorded data playback
•Project work
summary
•System
demonstration
What is BlueEyes not?
 Doesn’t predict nor interfere with
operator’s thoughts
 Cannot force directly the operator to
work
 Applications of BlueEyes
•Motivation
•What is
BlueEyes ?
•Physiological
 Generic control rooms
foundations
•System
(System can be applied in every working environment
design requiring permanent operator’s attention)
•System
implementation – Power station
•Future – Captain bridge
improvements
•Project work – Flight control centers
summary
– Operating theatres – anesthesiologists
•System
demonstration
 BlueEyes - benefits
•Motivation
•What is
BlueEyes ?
•Physiological
foundations
•System
 Prevention from dangerous incidents
design
•System
implementation  Minimization of
•Future
improvements – ecological consequences
•Project work
summary – financial loss
•System
demonstration – a threat to a human life

 The reconstruction
of the course of
operator’s work
Implementation and
engineering
considerations
-THREE groups of users
 OPERATOR -a person whose physiological parameters are
supervised
- authorization in the system
- receiving alerts
 SUPERVISOR – a person responsible for analyzing operator’s

condition and performance.

 SYSTEM ADMINISTRATORS- maintains the system

deliver tools for adding

- new operator’s to the database
- defining alarm conditions
- configuring logging tools
- creating new analyzer modules
Designing
 A personal area network for linking
all the operators and the supervising
system
 Two major units
- DAU (data acquisition unit )
- CSU (central system unit )
 System overview
•Motivation
•What is
BlueEyes ? Data Acquisition Unit Central System Unit
•Physiological
foundations
Atmel 89C52 Connection Visualization
•System Bluetooth Bluetooth Manager Module
design microcontroller
•Objectives
Jazz Data
•System Data Analysis
Multisensor Logger
overview
•DAU
•CSU

•System Bluetooth technology provides

implementation
•Future
means for creating a Personal
improvements Area Network linking the
•Project work
summary operators and the central
•System
demonstration
system.
 The eye movement
•Motivation sensor
•What is
BlueEyes ?
•Physiological  Off-shelf eye movement sensor – Jazz
foundations
•System multisensor
design
•System
implementation
 Supplies raw digital data regarding
•Future
improvements
- Eye position
•Project work
summary
- Level of blood oxygenation
•System
demonstration - Acceleration along horizontal and
vertical axes
- Ambient light intensity
Jazz multisensor

Jazz Multisensor
Jazz
DAU
The DAU consists of the following components
 ATMEL 8952 microcontroller
 BLUE TOOTH MODULE – supports synchronous voice
data transmission
 PCM CODEC –used to transmit operator’s voice and
central system sound feedback
 UART –communication between bluetooth module and
microcontroller (115200 bps)
 MAX232 –level shifter
 ALPHAUNUMERIC LCD display
 LED indicators
 ID CARD interface
DAU - components

microphone MC 145483
earphone PCM codec

Jazz Multisensor Bluetooth

module
Beeper Atmel 89C52

UART
microcontroller
LCD display
UART MAX232
LED indicators
BlueEyes
Data Acquisition Unit
ID card Simple
interface keyboard
ID card
Microcontroller & blue
tooth module
EEPROMS & the PCB
 Implementation - DAU
•Motivation
•What is
BlueEyes ?
•Physiological

PCM codec board Microcontroller board

foundations
•System
design
•System
implementation

•DAU
•CSU
•Future
improvements
Bluetooth module
Batteries and
•Project work
summary
•System
voltage level monitor
demonstration
 DAU - features
•Motivation
•What is Data Acquisition Unit
BlueEyes ?
•Physiological
foundations
 Lightweight
Atmel 89C52
•System
design microcontroller
Bluetooth  Runs on batteries - low
•Objectives power consumption
Jazz
•System
overview Multisensor  Easy to use - does not
•DAU disturb the operator
•CSU
working
•System
implementation
 ID cards for operator
•Future authorization
improvements
•Project work  Voice transmission using
summary
•System
hardware PCM codec
demonstration
 CSU - features
•Motivation
•What is Central System Unit
BlueEyes ?  Connection
•Physiological
foundations management Connection Visualization
•System Bluetooth Manager Module
design
•Objectives
 Data
•System processing Data Analysis
Data
Logger
overview
•DAU  Visualization
•CSU
 Data recording
•System
implementation
 Access
•Future
improvements
verification
•Project work
summary
 System maintenance
•System
demonstration
CSU – components
 CONNECTION MANAGER – main task to
perform low-level blue tooth communication
 DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data in order to
obtain information about operator’s
physiological condition
 DATA LOGGER MODULE – provides support
for storing the monitored data.
 VISULAIZATION MODULE – provides user
interface for the supervisors
 CSU - Visualization
•Motivation Module
•What is
BlueEyes ?
•Physiological
 Raw and processed data visualization
foundations
•System
using:
design – VU-meters
•Objectives
•System – pie-charts
overview
•DAU – time series
•CSU

•System
implementation
•Future
 audio and video
improvements
•Project work data playback
summary
•System
demonstration
 Data security
•Motivation
•What is
BlueEyes ?
•Physiological  Only registered mobile devices
foundations
•System can connect to the system
design
•Objectives  Bluetooth connection authentication
•System
overview
•DAU
 Bluetooth connection encryption
•CSU  Access rights restrictions
•System
implementation
 Personal and physiological data
•Future
improvements encryption
•Project work
summary
•System
demonstration
IBM research
 BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the
physiological attributes which are
correlated to emotions using
correlation model
-by simply touching the mouse ,the
computer will be able to determine a
person’s emotional state.
 BLUE EYE enabled TELEVISION – could
become active when the user makes
an eye contact.
Conclusion
 In the near future ,ordinary
household devices- such as
television , refrigerators ,ovens
may be able to do their jobs when
we look at them and speak to
them.
 Future applications of blue eye
technology is limitless
References

 www.seminar4u.com
 www.howstuffswork.com
 www.cs.put.poznan.com
 www.whitepapers.com
 www.ibmresearchcenter.com
 www.almaden.ibm.com
•Motivation
•What is

Thank you
BlueEyes ?
•Physiological
foundations
•System
design

BlueEyes
•System
implementation
•System
demonstration

Human-Operator
•Future
improvements
•Project work
summary

Monitoring System