SIXTH SENSE TECHNOLOGY

SYNOPSIS
ABSTRACT Sixth Sense Technology integrates digital information into the physical world and its objects, making the entire world your computer. It can turn any surface into a touch-screen for computing, controlled by simple hand gestures. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs. It also supports multi user and multi touch provisions. Sixth Sense device is a mini-projector coupled with a camera and a cell phone - which acts as the computer and your connection to the Cloud, all the information stored on the web. The Sixth Sense prototype is used to implement several applications that have shown the usefulness, viability and flexibility of the system. RELATED WORK/BACKGROUND: The exploration of this sixth sense technology started with a question as to why we cant use a computer to interact with the physical world. Pranav Mistry, 28 year old, of Indian origin is the mastermind behind the sixth sense technology. This literally started with a mouse that comes with a ball in it and two rollers that actually guides the movement. So taking out rollers from another mouse totally there are four rollers.Using these a system interface device was formed.With this whatever you do in physical world will be reflected in the digital world. The device sees what we see but it lets out information that we want to know while viewing the object. It can project information on any surface, be it a wall, table or any other object and uses hand / arm movements to help us interact with the projected information. The device brings us closer to reality and assists us in making right decisions by providing the relevant information, thereby, making the entire world a computer. INTRODUCTION 'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. The hardware components are coupled in a pendant like mobile wearable device. The Sixth Sense prototype is comprised of a pocket projector, a mirror, colored markers and a camera. The camera, mirror and projector are connected wirelessly to a bluetooth smart phone device that can easily fit into the user's pocket. A software then processes the data that is collected by

the capturing device and produces analysis. The software that is used in sixth sense device is open source type. We grew up interacting with the physical objects around us. And there areenormous numbers of them that we useeveryday. Unlike our most computingdevices these objects are much more fun touse. When you talk about objects oneanother thing that automatically comes tothat thing is gestures how we manipulatethe objects. We use gestures not only tointeract with each other but also to interactwith each other COMPONENTS The devices which are used in sixth sense technology are : 1. 2. 3. 4. 5. Camera Coloured Marker Mobile component Projector Mirror

IMPLEMENTATION The Sixth Sense technology works as follows: - It captures the image of the object in view and tracks the users hand gestures. - There are colour markers placed at the tips of users fingers. Marking the users fingers with red, yellow, green and blue coloured tape helps the webcam to recognize the hand gestures. The movements and arrangement of these markers are interpreted into gestures that act as a interaction instruction for the projected application interfaces. - The smartphone searches the web and interprets the hand gestures with help of the coloured markers placed at the fingertips - The information that is interpreted through the smartphone can be projected onto any surface. - The mirror reflects the image onto the desired surface. PERFORMANCE ANALYSIS Sixth Sense technology is the science of tomorrow with the aim of connecting the digital world with the physical world seamlessly, eliminating hardware devices. The SixthSense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system. The true power of Sixth Sense lies on its potential to connect the real world with the Internet, and overlaying the information on the world itself. The key here is that Sixth Sense

recognizes the objects around you, displaying information automatically and letting you access it in any way you want, in the simplest way possible. Although the miniaturisation of computing devices allows us to carry computers in our pockets, there had been no link between the digital devices we carry and our interactions with the physical world, and our speech in a efficient level. Clearly, this has the potential of becoming the ultimate transparent user interface for accessing information about everything around us. If they can get rid of the colored finger caps and it ever goes beyond the initial development phase, that is. But as it is now, it may change the way we interact with the real world and truly give everyone complete awareness of the environment around us.