-(WIRELESS)

The basic idea behind this technology is to give ABSTRACT Our paper deals with BLUE EYES TECHNOLOGY. Blue eye is a technology, which aims at creating computational machines that have perceptual and sensory abilities like those of human beings. computer human power. For example, we can understand humans emotional state by his facial expressions. If we add these perceptual abilities to computers, we would enable them to work partners. together It with human beings as intimate provides

technical

means

for

realizes the urgency of the situation through the mouse.For instance if you ask the computer to

monitoring and recording human-operators physiological condition.It ability to has the gather

dial to your friend at his office, it understands the situation and establishes a connection.It can reconstruct the course of operators work.

information about you and interact with you through techniques recognition, recognition, etc. like special facial speech

It can even understand your emotions at the touch of the mouse.It can verify your identity, feel your presence, and start interacting with you.The machine can understand what a user wants, where he is looking at, and even realize his physical or emotional states.It

INTRODUCTION: Imagine you in a world where humans interact with computers. You are sitting in front of your personal computer that can listen, talk, or even scream aloud. It has the ability to gather

even guess their feelings.

EMOTIONCOMPUTING:

One goal of human computer interaction (HCI) is to make an adaptive, smart computer system. This type of project could possibly include gesture recognition, facial recognition, eye tracking, speech recognition, etc. Another way to information People computers non-invasive obtain about use to a their obtain,

information about you and interact with you through techniques recognition, recognition, cognition like special facial speech etc.Human depends

primarily on the ability to perceive, interpret, and integrate and information. abilities to audio-visuals sensoring Adding computers

extraordinary perceptual would enable computers to work together with human beings as intimate partners. Researchers are attempting to add more capabilities to computers that will allow them to interact recognize like humans, human

person is through touch.

store and manipulate data using their computer. In order to start creating smart gaining about the proposed computers, must user. method the start Our for computer

information

presents, talk, listen, or

gaining user information

through touch is via a computer input device, the mouse. From the physiological data obtained from the user, an emotional state may be determined which would then be related to the task the user is currently doing on the computer. Over a period of time, a user model will be built in order to gain a sense of the user's personality. The scope of the project is to have the computer adapt to the user in order to create a better working environment where the user is more productive. The first steps towards realizing this goal are described here. Rosalind Picard (1997) to describes the why emotions are important computing community. There are two aspects of affective computing: giving the computer the ability to detect emotions and

giving the computer the ability emotions to express for emotions. Not only are crucial rational decision making as Picard describes, but emotion detection is an important adaptive system. An step to an computer adaptive,

smart computer system has been driving our efforts to detect a persons emotional state. By matching a persons emotional state and the context of the expressed emotion, over a period of time the is persons being personality

exhibited. Therefore, by giving the computer a longitudinal understanding of the emotional state of its user, the computer could adapt a working style which fits with its users personality. The result of this collaboration could increase productivity for the user. One way of gaining information from a user non-intrusively is

by video. Cameras have been used to detect a persons emotional state (Johnson, information 1999). We have explored gaining through touch. One obvious place to put sensors is on the mouse. observing Through normal Based on facial expression work, we see a correlation between a persons emotional state and a persons physiological measurements. Selected works from Ekman and others on measuring facial behaviors describe Ekmans Facial Action Coding System (Ekman and Rosenberg, 1997). One of his experiments involved record pulse, response temperature, movement pressure. recorded measurements FACIAL EXPRESSION: participants expressions basic emotions. as and He galvanic participants certain skin (GSR), somatic blood then the the were which He attached to devices to measurements including

computer usage (creating and editing documents and surfing the web), people approximately touching incredible their amount spend 1/3 of

their total computer time input of device. Because of the time spent touching an input device, we will explore the possibility of detecting through touch. emotion

instructed to mimic facial corresponded to the six defined the six basic emotions as anger, fear, sadness, disgust, joy and

surprise. Six participants were trained to exhibit

the facial expressions of the six basic emotions. While each participant exhibited expressions, physiological associated were measures with taken these the changes affect The were

that made

all

four variables significant, to the

physiological nonredundant contributions

functions that distinguish the six states. Moreover, these analyses indicate that are persons of our these sufficient reliably four measures to a physiological determine

assessed.

GSR, heart rate, skin temperature and general somatic activity (GSA). These data were then subject to two analyses. For the first analysis, a multidimensional scaling (MDS) procedure was used to determine the dimensionality data. This suggested of the the analysis that

specific need into to these a non-intrusive these

emotional state. Because incorporate measurements small, taking

form, we will explore measurements from the hand. The amount of conductivity of the skin is best taken from the fingers. However, the other measures may not be as obvious or robust. We hypothesize in that the changes

physiological similarities and dissimilarities of the six emotional states fit within a four dimensional model. For the second analysis, a discriminant determine mathematic function the functions analysis was used to

temperature of the finger are reliable for prediction of emotion. We also hypothesize the GSA can be measured by change

that would distinguish the six emotional states. This analysis suggested

in

movement

in

the

eliminated by warping the cursor to the eye gaze area, which encompasses the target. Two specific MAGIC techniques, conservative analyzed, and pointing one one and

computer mouse. MAGIC-POINTING: This work explores a new direction in utilizing eye gaze for computer considered input. as Gaze an tracking has long been alternative or potentially superior pointing method for computer input. We believe exist gaze that with many fundamental limitations traditional In pointing.

liberal, were designed, implemented with an eye tracker we developed. They were then tested in a pilot study. This early stage exploration showed that the MAGIC pointing techniques might offer many including physical traditional pointing, than traditional advantages, reduced effort and manual greater gaze

particular, it is unnatural to overload a perceptual channel such as vision with a motor control task. We therefore dubbed (Manual and propose an alternative approach, MAGIC

fatigue as compared to

accuracy and naturalness pointing, and possibly faster speed than manual pointing. The pros and cons in of light the of data two both and techniques are discussed performance

Gaze Input Cascaded) pointing. With such an approach, pointing appears to the user to be a manual task, used for fine manipulation selection. large cursor However, of movement portion and a the is

subjective reports.

intelligent. machines

It

makes and

smarter

more useful, and is less expensive than natural intelligence. language Natural processing

(NLP) refers to artificial intelligence methods of communicating with a computer in a natural language like English. The main objective of a NLP program input is to and understand

initiate action. The input words are scanned and matched against internally stored known words. Identification of a key word causes some THE TECHNOLOGY: Artificial intelligence action to be taken. In this way, (AI) involves two basic ideas. First, it involves studying processes the of thought human computer language. one in No can ones special communicate with the

commands or computer language are required. There is no need to enter programs language software. SPEECHRECOGNITION: in special forcreating-

beings. Second, it deals with representing those processes via machines (like computers, robots, etc). AI is behavior of a machine, which, if performed by a human being, would be called

many times a second. Each sample represents different amplitude of the signal .Evenly spaced of the vertical lines represent the amplitude audio filter output at the instant of sampling. Each value is then converted The user speaks to the a computer through to a binary number to the proportional

amplitude of the sample. A central processor unit (CPU) controls the input circuits that are fed by the ADCS. A large RAM (random access memory) stores all the digital values in a buffer area. This digital information, representing the spoken word, is now accessed by the CPU to process it further. The normal speech has a frequency range of 200 Hz to 7 kHz. difficult Recognizing as it a has telephone call is more bandwidth limitation of 300 Hz to3.3 kHz.As explained spoken earlier, words the are

microphone, which, in used; a simple system may contain a minimum of three filters. The more the number of filters used, the higher the probability of accurate recognition. switched Presently, capacitor

digital filters are used because these can be custom-built in integrated circuit form. These are smaller and cheaper amplifiers. than The active filter filters using operational output is then fed to the ADC to translate the analogue signal into digital word. The ADC samples the filter outputs

processed by the filters

and ADCs. The binary representation of each of these words becomes a template words These or are standard, compared. are against which the future templates

input subtracted

words from

are the

corresponding values in the templates. If both the values are same, the difference is zero and there is perfect match. If not, the subtraction some produces

stored in the memory. Once the storing process is completed, the system can go into its active mode and is capable of identifying spoken words. As each word is spoken, it is converted into binary equivalent starts and stored in RAM. The computer then searching and compares the binary input pattern with the templates. t is to be noted that even if the same speaker talks the same text, there are always slight variations in amplitude or loudness of the signal, pitch, frequency difference,

difference or error. The smaller the error, the better the match. When the best match occurs, the word is identified and displayed on the screen or used in some other manner. process The takes search a

considerable amount of time, as the CPU has to make many comparisons before recognition occurs. This necessitates use of very high-speed processors. A large RAM is also required as even though a spoken word may last only a few hundred milliseconds, but the same is translated into many thousands of digital words. It is important to note that alignment of words and

time gap, etc. Due to this reason, there is never a perfect match between the template and binary input word. The values of binary

templates matched

are

to

be in

SUITOR can be more precise in determining his topic of interest. It can even deliver relevant information handheld to device. a The

correctly

time, before computing the similarity score. This process, termed as dynamic time warping, recognizes that different speakers pronounce the same words at different speeds as well as elongate different parts of the same word. SUITOR: Computers would have been much more powerful, had they gained living perceptual beings on and the sensory abilities of the earth. What needs to be developed is an intimate relationship between the computer and the humans.By observing the Webpage a netizen is browsing, the SUITOR can help by fetching more information at his desktop. eyes By simply on the the noticing where the users focus computer screen,

success lies in how much the suitor can be intimate to the user. IBM's research question, to Myron BlueEyes simple according

project began with a

Flickner, a manager in Almaden's USER group: Can more we effective exploit user nonverbal cues to create interfaces? One such cue is gazethe direction in which a person is looking. Flickner and his colleagues have created some new techniques for tracking a person's eyes and have incorporated this technology gaze-tracking into two

prototypes. One, called SUITOR (Simple User Interest Tracker), fills a scrolling computer ticker screen on a with

information related to the

user's

current

task.

operators acceleration, accompanies displacement visual axis of

visual which large the (saccades industrial

SUITOR knows where you are looking, what applications pages you you may are be running, and what Web browsing. "If I'm reading a Web page about IBM, for instance," says Paul Maglio, the Almaden cognitive scientist who invented SUITOR, "the system presents the latest stock price or business news stories that could affect IBM. If I read the headline off the ticker, it pops up the story in a browser window.

attention along with head

larger than 15 degrees). Complex environment can create a danger of exposing the operator affect his to toxic cardiac, and systems. signal substances, which can circulatory pulmonary lethysmographic

Thus, on the grounds of taken from the forehead skin surface, the system computes heart beat rate and blood oxygenation. The BLUEEYES system checks above parameters against triggers Quite abnormal or

SYSTEMOVERVIEW: BLUEEYES system technical the provides means for basic most

undesirable values and user-defined often in an to alarms when necessary. emergency situation speak expressing problem.

monitoring and recording operators The physiological parameters. important parameter is saccadic activity1, which enables the system to monitor the status of the

operators themselves verbally

their surprise or stating the Therefore, the operators

voice, parameters overall operating

physiological and of room an the are view

implementation of the DAU we needed a piece of software to establish and test Bluetooth We connections.

recorded. This helps to reconstruct the course of operators term system work and This of a provides data for longanalysis. consists

therefore created a tool called Blue Dentist. The tool provides support for controlling the currently connected local Bluetooth device device. Its functions are: management&connectio n management. To test the possibilities of and the performance

mobile measuring device and a central analytical system. Bluetooth providing interface sensors unit. TOOLSDEVELOPED: In creating the hardware part of the DAU which various the During we built us a to development enabled board, worn The mobile module wireless between by the device is integrated with

remaining parts of the Project Kit (computer, camera software) and we database created tool The

operator and the central

BlueCapture data from

supports capturing video various sources (USB web-cam, industrial camera) and storing the data in the MS SQL Server database. Additionally,

the application performs sound recording. After filtering and removing insignificant fragments (i.e. silence) the audio data is stored in the

mount, connect and test peripheral microcontroller. the devices cooperating with

database. program recorded software database

Finally, plays

the the

surveillance systems that record customer using research BlueEyes Almaden's and interpret from project. software movements, BlueEyes

audiovisual to measure system and to

stream. We used the

software

performance

optimize some of the SQL queries (e.g. we replaced correlated SQL queries with of have cursor the been operations). Since all the components application

makes sense of what the cameras see to answer key questions for retailers, including, how many shoppers ignored a promotion? How many stopped? How long did they stay? Did their faces register delight? boredom How or many

tested thoroughly they were reused in the final software, additionally which reduced

reached for the item and put it in their shopping carts? BlueEyes works by tracking and pupil, mouth When eyebrow

testing time. We also created a simple tool for recording Multisensor measurements. The program reads the data using a parallel port and writes it to a file. Jazz

movement.

monitoring pupils, the system uses a camera and two infrared light sources placed inside the product display. One

APPLICATIONS: 1. Researchers from IBM Center in San Jose, CA, report that a number of large retailers have implemented

light source is aligned with the camera's focus; the other is slightly off axis. When the eye looks into the camera-aligned light, the pupil appears

bright to the sensor, and the software registers the customer's attention. This is way it captures the person's buying BlueEyes been some of income is the and preferences. actively in leading incorporated

games.Typically targeting of commercial toys, and is were enabling not feasible Computer the experiences business.The integration children's technologies computers new that play

commercially Play QX3

retailoutlets. 2. Blue Eyes can be applied in the automobile industry. By simply touching a computer input device such as a mouse, the computer determine system a is designed to be able to person's emotional state. For cars, it could be useful to help with critical decisions like: "I know you want to get into the fast lane, but I'm afraid I can't do that. Your too upset right now" and therefore assist in drivingsafely. 3. We could see its use in video games where, it could give playing individual video challenges to customers

until recently. The Intel Microscope,

Me2Cam with Fun Fair, and the Computer Sound Morpher commercially smart toy are available products

developed by the Intel Smart Toy Lab in. One theme that is common across these PCconnected toys is that users interact with them using a combination of visual, audible and tactile input modalities. 4. The familiar and useful come from things things' we recognize. appearance Many of our favorite communicate their use; they show the change in & output

their value though patina. As technologists we are now poised to imagine a world where computing objects communicate with us in-situ; where we are. We use our looks, feelings, and actions to give the computer the experience it needs to work with us. Keyboards and mice to will not continue dominate

vividly,

but

have is

no ever

sense of whether that information viewed or understood. In contrast, new real-time computer people allows vision us to and which techniques for perceiving create "Face-responsive Displays" "Perceptive Environments", can sense and respond to users that are viewing them. Using stereovision techniques, we are able to detect, track, and identify users robustly and in real time. This information spoken selecting the can make language acoustic from a can

computer user interfaces. Keyboard input will be replaced in large measure by systems that know what require we want and less explicit

communication. Sensors are gaining fidelity and ubiquity presence to and record actions;

interface more robust, by information Environments

sensors will notice when we enter a space, sit down,liedown,pump,iron ,etc. 5. Current interfaces between computers and humans can present information CONCLUSION: The

visually-localized source. become aware of how many people are present.

nineties

witnessed

quantum leaps interface designing for improved

man EYES

machine technology

interactions. The BLUE ensures a convenient way of simplifying the life by providing more delicate and user friendly facilities in computing devices. Now that we have proven the method, the next step is to the of gather the less cumbersome to about and improve hardware.Instead using modules information use smaller

user, it will be better to intrusive units. REFERENCE: www.wherisdoc.com www.fixya.com www.penniblack56.grati sphphost.info/blue-eyestechnology www.scribd.com/doc/13 763040/Blue-EyesTechnology