BLUE EYES TECHNOLOGY

BLUEEYES TECHNOLOGY
ABSTRACT
Blue Eyes technology is all about making people get interacted with computers like the way people interact with their mom,dad,friends, teachers etc .Imagine that person is working in his computer till late night and then he feels sleepy at that time, then his computer wishes him GOOD NIGHT .It seems to be surprising but this is what is going to happen in near future. The main aim of this technology is to make computers understand human emotions, feelings and work accordingly. The technology aims in creating devices that can recognize and use natural input, such as facial expressions which determines the user mood at a particular moment of time and then depending on user mood the computer works. Blue Eyes Technology is used to extract key information about the user which is then analyzed to determine the user's physical, emotional, or informational state, which in turn can be used to help make the user more productive by performing expected actions or by providing expected information. In the future, ordinary household devices -- such as televisions, refrigerators, fans washing machines and ovens -- may be able to do their jobs when we look at them and speak to them. Blue Eyes system is thus a versatile system which can be modified to cater to the working environment. INTRODUCTION Blue Eyes is the name of a human recognition venture which was started by IBM. Every living being has its own perceptual abilities by which they can understand others feelings .If we can add these abilities to computers then the humans and computers can work more like partners rather than like a master-slave which makes the working environment healthier and productive. Now suppose a person starts his computer to search an important file then his computer understands how important is that file to its user and immediately gives his file. Imagine that you are in a society where you can interact with computers. You are at your home and your household devices listen to you and work accordingly .You are in front of your personal computer that can listen, talk, and can even guess your feelings. It can gather information about you and interact with you through special techniques like facial recognition, speech recognition, pulse etc. It can even understand your emotions at the touch of the mouse. It verifies your identity, feels your presense, and starts interacting with you. The way we Humans identify things depends primarily on the ability to perceive, interpret, and integrate audiovisuals and sensoring information. To make computers to work together with human beings as intimate partners, Researchers are attempting to add more capabilities to computers that will allow them to interact like humans, recognize human presence , talk, listen, and can even guess their feelings. The BLUE EYES technology is all about creating computational machines that have all the qualities like those of a human beings such as perceptual and sensory ability. It uses most modern video cameras and microphones to identify the users actions through the use of imparted sensory abilities so the machine can understand what a user wants, where he is looking at, and even realize his physical or emotional states.

EMOTION MOUSE In order to create interactive computers, the computer must be in a position to gain information about the user. This can be achieved through facial expression, voice recognition, pulse rate, touch etc. When a user touches a computer input device such as mouse information relating to his emotion state is generated which would then be related to the task the user is currently doing on the computer. So over a period of time a user model is built in order to gain a sense of the user's personality by matching a persons emotional state at that particular moment and the context of the expressed emotion, over a period of time the persons personality is being exhibited. In this way by giving the computer a longitudinal understanding of the emotional state of its user,

BLUE EYES TECHNOLOGY

the computer could adapt a working style which fits with its users personality which makes the work more productive. By observing normal computer usage people spend approximately most of their total operating time touching their input device like mouse which can explore the possibility of detecting emotion through touch. SIMPLE USER INTEREST TRACKER (SUITOR) Computers would have been much more powerful, had they gained perceptual and sensory abilities of the living beings on the earth. What needs to be developed is an intimate relationship between the computer and the humans. And the Simple User Interest Tracker (SUITOR) is a revolutionary approach in this direction. By observing the Webpage a netizen is browsing, the SUITOR can help by fetching more information at his desktop. By simply noticing where the users eyes focus on the computer screen, the SUITOR can be more precise in determining his topic of interest. It can even deliver relevant information to a handheld device. The success lies in how much the suitor can be intimate to the user. HOW A COMPUTER RECOGNIZE VARIOUS EMOTIONAL STATES There are basically six emotional states namely anger, fear, sadness, disgust , joy and surprise. These six emotional states can be distinguished using four physiological measures including pulse rate, galvanic skin response (GSR), general somatic activity (GSA) and temperature. There was an experiment involving six participants attached to devices to record measurements including pulse, galvanic skin response (GSR), temperature, somatic movement and blood pressure. The participants were instructed to mimic facial expressions which corresponded to the six basic emotions .This data was then subjected to two analyses of which the first one is multidimensional scaling(MDS)which suggested the physiological similarities and dissimilarities of six emotional states fit within four dimensional model and the second analyses was the discriminant function analyses which used mathematic functions to distinguish six emotional. These measurements were taken from the hand. The amount of conductivity of the skin is best taken from the fingers and any change in the temperature of finger would predict the emotion. GSA can be measured by change in movement in the computer mouse.

By matching a persons emotional state and the context of the expressed emotion, over a period of time the persons personality is being exhibited. Therefore, by giving the computer a longitudinal understanding of the emotional state of its user, the computer could adapt a working style which fits with its users personality. MANUAL AND GAZE INPUT CASCADED (MAGIC) POINTING Manual And Gaze Input Cascaded, pointing, dubbed MAGIC is an approach where pointing appears to the user to be a manual task, so unnecessary selection and unintended jumps to a web page can be avoided. MAGIC pointing is more advantageous than the traditional gaze pointing and manual pointing in its fastness, accuracy and naturalness. DRAWBACKS OF EXISTING GAZE POINTING TECHNIQUES There are two drawbacks, the first one is that the eye gaze is not precise enough to control scrollbars, hyperlinks, and slider handles. Secondly sometimes our eye movements are voluntarily controlled while at other times it is driven by some external events but If one does not look at a target continuously for a set threshold (e.g., 200 ms), the target will not be successfully selected. On the other hand, if one stares at an object for more than the set threshold, the object will be selected, regardless of the users intention. In order to overcome these drawbacks They designed a technique in which pointing and selection remained primarily a manual control as well as by gaze tracking. This technique involves in bringing the position of pointing cursor inside eye gaze area. Once the cursor position had been redefined, the user would need to only make a small movement to, and click on, the target with a regular manual input device. ADVANTAGES OF MAGIC POINTING TECHNIQUE 1. Manual stress and fatigue can be reduced, since the cross screen long-distance cursor movement is eliminated from manual control. 2. It is more accurate when compared to traditional pure gaze pointing whose accuracy is limited by the nature of eye movement where as in the MAGIC pointing techniques hand

BLUE EYES TECHNOLOGY

complete the pointing task, so it is more accurate than any other manual techniques. PARTS OF BLUE EYES SYSTEM There are two major parts of blue eyes system which constitute the hardware of the system DATA ACQUISITION UNIT Data Acquisition Unit performs the operation of fetching the physiological data from the sensor and send it to the central system for processing. To accomplish this task the device manages wireless Bluetooth connection. Communication with operator is carried out using a simple 5-key keyboard, small LCD display and a beeper. Voice data is transferred using a small headset interfaced to DAU. COMPONENTS OF DATA ACQUISITION UNIT Atmel 89C52 microcontroller Bluetooth module HD44780- small LCD display 24C16-I2C EEPROM MC145483-13bit PCM codec Jazz Multisensor interface Beeper and LED indicators CENTRAL SYSTEM UNIT Central System Unit hardware is the second peer of the wireless connection. The box contains a Bluetooth module (based on ROK101008) and a PCM codec for voice data transmission. The module is interfaced to a PC using a parallel, serial and USB cable. The audio data is accessible through standard minijack sockets To program operator's personal ID cards we developed a simple programming device. The programmer is interfaced to a PC using serial and PS/2(power source) ports. Inside, there is Atmel 89C2051 microcontroller, which handles UART transmission and I2C EEPROM (ID card) programming COMPONENTS OF CENTRAL SYSTEM UNIT Connection manager Data Analysis Module Data Logger Module Visualization module Connection Manager is responsible for managing the wireless communication between the mobile Data Acquisition Units and the central system. The Connection Manager handles: ommunication with the CSU hardware c searching for new devices in the covered range establishing Bluetooth connections

connection authentication incoming data buffering sending alerts Data Analysis module performs the analysis of the raw sensor data in order to obtain information about the operators physiological condition. The module consists of a number of smaller analyzers extracting different types of information. The most important analyzers are: saccade detector - monitors eye movements in order to determine the level of operator's visual attention pulse rate analyzer - uses blood oxygenation signal to compute operator's pulse rate custom analyzers - recognize other behaviors than those which are built-in the system. The new modules are created using C4.5 decision tree induction algorithm. Visualization module provides a user interface for the supervisors. It enables them to watch each of the working operators physiological condition along with a preview of selected video source and related sound stream. All the incoming alarm messages are instantly signaled to the supervisor. The Visualization module can be set in an off-line mode, where all the data is fetched from the database. Watching all the recorded physiological parameters, alarms, video and audio data the supervisor is able to reconstruct the course of the selected operators duty. a pie-chart used to present a percentage of time the operator was actively acquiring the visual information A VU-meter showing the present value of a parameter time series displaying a history of selected parameters' value

APPLICATIONS Blue Eyes is developing wayfor computers to anticipate users' wants by gathering video data on eye movement and facial expression. Your gaze might rest on a Web site heading, for example, and that would prompt your computer to find similar links and to call them up in a new window. BlueEyes software makes sense of what the cameras see to answer key questions for retailers, including, How many shoppers ignored a promotion? How many stopped? How long did they stay? Did their faces register boredom or

BLUE EYES TECHNOLOGY

delight? How many reached for the item and put it in their shopping carts? BlueEyes works by tracking pupil, eyebrow and mouth movement. When monitoring pupils, the system uses a camera and two infrared light sources placed inside the product display. Current interfaces between computers and humans can present information vividly, but have no sense of whether that information is ever viewed or understood. In contrast, new real-time computer vision techniques for perceiving people allows us to create "Face-responsive Displays" and "Perceptive Environments", which can sense and respond to users that are viewing them. Using stereo-vision techniques, we are able to detect, track, and identify users robustly and in real time. This information can make spoken language interface more robust, by selecting the acoustic information from a visually-localized source. Environments can become aware of how many people are present, what activity is occuring, and therefore what display or messaging modalities are most appropriate to use in the current situation. CONCLUSION Till now we have seen that many technologies focus on making the machines more powerful than the existing ones but this is the first time ever when a technology is been developed to make a relation between mankind and machines, which is named as BLUE EYES technology .The technology provides user friendly relations

with computing devices .The day is not far when this technology will launch in market and push its way into your house , making you more lazy. It may even reach your hand held mobile device. REFERENCES: www.bluenetworks.or/nemo/drafts www.ibmresearchcenter.com www.almaden.ibm