Gesture Recognition

NAVEEN GUPTA 2306011 4th YEAR COMPUTER SCIENCE

Contents
1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11.

Introduction History Concept Some hand gestures Input Devices Applications Some examples Challenges Future Scope Conclusion Thank You

Introduction
Interaction with computers are not comfortable experience Hand gesture recognition becomes important

Interactive human-machine interface and virtual environment Interpreting human gestures via mathematical algorithms Richer bridge between machines and humans Enables humans to interface with the machine and interact naturally without any mechanical devices

History
Neural Networks 1945 - a process called Optical Character Recognition (OCR) June 1995 - Intel Workshop on Automatic Face and Gesture Recognition 2001 - Intel expects the code and lead to the development of computer vision

applications such as face recognition, gesture recognition 2009 - Microsoft is already making your breakfast table-top your computing screen.

Concept
Based on Artificial Intelligence able to recreate the capabilities of the human mind Intelligence of machines and the branch of computer science which

aims to create it. Based on the idea that computers behave like humans Includes : game playing, robotics, neural networks etc.

Hand Gesture Recognition

Input Devices
The ability to track a person's movements and determine what gestures they may be performing can be achieved through various tools, some of which are:
Depth Aware Cameras Stereo Cameras Controller-based gestures

Single Camera

Depth Aware Cameras

A depth map of what is being seen through the

camera at a short range is drawn

Used for 3D recognition
Effective for hand gestures

Stereo Cameras
Contains two or more lenses Stereo photography Or a combo of two cameras whose relation to one-another are

known 1st lens for focussing on the object 2nd lens to capture the image

Controller Based Gestures

act as an extension of the body when gestures are performed, some of their motion can be

conveniently captured by software. Example : Mouse gestures Wii Remote

Mouse gesture for back in Opera-user holds down the right mouse button, moves the mouse left, and releases the right mouse button.

Single Camera
Normal camera where the resources would not be convenient greater possibility of accessibility to a wider audience not as effective as stereo or depth aware

cameras.

Applications:

Sign language recognition

- movement of hands, body, lip patterns and body language

For socially assistive robots

Directional Indication through pointing Control through facial gestures Alternative computer interfaces

Applications:

Immersive Game Technology Virtual Controllers

Affective Computing
Remote Control

Can be used for weather presentations at any no. of stations

A space-age virtual game with attendees as Starfleet cadets was created by HoloPoint.

Interact with digital content such as advertising on a dynamic display with an array of over 70 special effects

This technology was also used in CNN Head-quarters.

Challenges
Limitations on equipment used Image Noise

Background Noise
Resolution and quality

Gorilla Arm

Future Scope
Eye gesture recognition recognize winking, eyebrow raising, eyes being

closed deliberately, and deliberate eye movements left, right, up , down etc But some limitations.

Recognition software showing it's best estimates of the pupil, eyebrow and eye locations.

Future Scope
The future of this technology is very bright and in this year,2009,

Microsoft will launch its breakfast table top, which will be considered a huge achievement. Progress will be made in recognizing gestures through the above mentioned eye gesture method and hopefully all its limitations would be overcome. Hence, in the coming 4-6 years, this technology will attain great heights.

Conclusion

Way to interact with computers without any mechanical devices. Illiterate person can also operate a computer system More effective and friendly for human computer interaction Vision-based interfaces for intelligent human computer interaction Based on the concept of artificial intelligence. Can be used for advertising New emerging technology

Will bring about a big revolution in IT