Technical Seminar

T. Sai Manikantesh 08QC1A0421

Touch Screen
A touch screen is a computer display screen & is also an input device.

Fig: Picture shows a touch screen example

User interacts with computer by touching pictures or words on the screen. Here, the application through touch screen is operated only on the system or mobile. In the absence of system, application cannot be run. This is the main reason why we created Omni- Touch where we can operate an application anywhere.

Fig: Picture shows an Omni-touch example

Omni-Touch
Microsoft Research and Carnegie Mellon University have created a wearable projection system that turns pads of paper, walls or even a user's own hands into graphical, interactive surfaces. Omni Touch, a wearable system that projects any multi-touch interface onto everyday surfaces A new prototype can transform a notebook into a notebook computer, a wall into an interactive display, and the palm of your hand into a smart phone display. The palm of the hand could be used as a phone keypad, or as a tablet for jotting down notes.

Maps projected onto a wall could be panned and zoomed with the same finger motions as a conventional multi touch screen.

Description
Before projection was possible only on screen and could be operated on skin. A new wearable projection system can turn any surface into an ad-hoc interactive touch screen, from the palm of your hand to an entire wall.

Fig: picture depicting projection of the Omni-touch

What it contains?
Omni-touch is made up of Kinect sensor consisting of Pico projector and depth camera This sensor should be worn on the shoulder as shown in image below.

Fig: Picture shows a kinect sensor

Images of Kinect sensor

Fig: Picture shows the kinect sensor

From left to right is an IR laser projector, RGB camera, and IR camera. Between the RGB camera and IR laser is simply a green LED for status - it plays no role in the actual optical system.

Fig: Picture shows the processor of the kinect sensor- PS 1080Sc

Fig: Picture shows the working of the kinect sensor

Kinect uses a structured light IR projector and sensor system something widely used in both industrial manufacturing and inspection.
The principle of structured light sensing is that given a specific angle between emitter and sensor, depth can be recovered from simple triangulation. Expand this to a predictable structure, and the corresponding image shift directly relates to depth

Fig: Picture the cell site of an object scanned by the camera

Role of Camera:
The camera acquires depth information about the scene by emitting a patterned beam of infrared light and using the reflections to calculate where surfaces are in the room. So if any object like your hand or notebook makes a movement, the. change in movement is identified and measured according to the movement made by it before making the movement. Consider you move your hand, the camera identifies the change and makes a measurement of the movement. So, you need not consider any additional calibration instrument.

Using a depth-sensing camera, users finger movements are tracked, allowing them to control applications by tapping or dragging their fingers, much as they would with a touch screen. The device also allows for user flexibility far beyond the capability of your phone or tablet. Omni Touch is also itself capable of intelligently choosing the best display setting, so the user doesn't have to readjust with each new surface. The screen is sensitive enough to use by existing Microsoft touch recognition software, making it possible to send a text by drawing characters one by one In tests performed by the Microsoft, users have been able to punch in numbers into a keypad projected onto their hands and write on a virtual notepad on a table.

MultiTouch Finger Tracking

Finger segmentation

Finger click detection

Figure : finger is hovering(left) and clicked(right)

figure: finger slice

Surface Segmentation and Tracking

Images of Live Examples

Test surfaces

Applications
to punch numbers into a calculator projected on their palms zoom in on a map projected on the wall with a single finger providing ways to integrate human senses with technology

allows the wearer to use their hands, arms and legs as graphical, interactive surfaces
use as computer for - checking email or surfing or to chat or to play To listen music To use as a mobile for calling a friend or play games

Advantages
It is flexible to any surface. We can use it in any condition like even while jogging or walking. Through the kinect sensor we can scan the environment in a 2-dimensional way.

Disadvantage:
The main disadvantage is with the size of the kinect sensor. But, surely in the near future the size will be decreased to the size of the match box. Another disadvantage is the cost of the equipment

 This presentation described and evaluated proof of concept implementation of omnitouch. The dedicated touch surfaces can now move into the environment,in an adhoc fashion. A user styudy of this technology showed that dragging performance and touch accuracy approached the sensitivity of conventional screens

References
Anandtech.com Technicalreview.com Wikipedia

YouTube
Omnitouchinternational.com