EYEEYE- CONTROLLED WHEELCHAIR

PROJECT MEMBERS RINKU LAL GAUTAM PRAFUL CHUGHA NEHA WADHVA RAJIV PARWANI PROJECT
GUIDE Mrs. ARCHANA SINGHI
B.E. ELECTRONICS & TELECOMMUNICATIONS (2010-2011) WATUMULL INSTITUTE OF ELCTRONI
CS ENGINEERING & COMPUTER TECHNOLOGY.
TOPIC SURVEY
1.RAMAN AMPLIFIER 2.MOBILE CONTROLLED ELECTRICAL APPLIANCES 3.CONTROLLED WHEELCH
AIR
9/11/2009
EYE CONTROLLED WHEELCHAIR
2
CONTROLLING WHEELCHAIR
1.JOYSTICK CONTROLLED 2.SENSOR CONTROLLED 3.EYE CONTROLLED
9/11/2009
EYE CONTROLLED WHEELCHAIR
3
CONTENTS
1. OBJECTIVE. 2. ABSTRACT. 3. INTRODUCTION. 4. VARIOUS EYE TRACKING MECHANISMS.
5. DETAILED BLOCK DIAGRAM. 6. CIRCUITS. 7. SOFTWARE LOGIC. 8. WHEEL MECHANISM. 9
. FUTURE SCOPE. 10.REFERENCES. 11.A PIECE OF ADVISE.
9/11/2009
EYE CONTROLLED WHEELCHAIR
4
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
OBJECTIVE
Improve quality of handicapped patients¶ life.
Lets patients maneuver with the wheelchair more conveniently and avoid calamities
. The optical pupil tracking and wheelchair control are combined to provide mobil
ity to completely paralysed people. Two different research domains, namely, the o
ptical pupil tracking and wheelchair control are combined to provide a control d
evice for people with physical disabilities.
The domain of this project is ³Human-Computer Interface
(HCI)´.
9/11/2009
EYE CONTROLLED WHEELCHAIR
5
ABSTRACT
Describes an eye-control wheelchair, based on ³Human-Computer Interface (HCI)´. Cons
ists of a standard electric wheelchair with an onboard computer, electric circui
ts and a graphic user interface run by the computer. This control technique coul
d be useful in multiple applications, such as mobility and communication aid for
handicapped persons primarily helping patients suffering from quadriplegic and
paraplegic diseases.
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
INTRODUCTION
A wheelchair aid¶s persons with moderate/severe physical disabilities or chronic d
iseases.

Various kinds of interface have been developed for wheelchair control such as joy
stick control,heart beat and through censors. Difficulty in maneuvering . Mistakes
in maneuvering the wheelchair may bring calamities such as overturn,fall out of
the wheelchair,etc.
9/11/2009
EYE CONTROLLED WHEELCHAIR
7
VARIOUS TYPES OF EYE TRACKING MECHANISMS
There are three systems that can be used to compute the position of pupil .They
are as follows: 1.Electro-Oculogram method(EOG)method. 2. Lens System . 3. Head
Mounted Camera System.
EOG METHOD PROCEDURE.
The electrodes will be attached
ll be used . One electrode will
r to the side of the right eye.
and another below the left eye.
to the user¶s face . A total of five electrodes wi
be placed to the side of the left eye and anothe
One electrode will be placed above the left eye
A fifth electrode will be attached by the ear.
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
ADVANTAGES AND OF EOG METHOD. METHOD.
Electrodes methods:
ADVANTAGES
Both eyes can be recorded together Least expensive Simple to use
DISADVANTAGES
DRAWBACKS
It is limited to horizontal and vertical movements Poor accuracy for absolute posi
tioning
9/11/2009
EYE CONTROLLED WHEELCHAIR
10
LENS SYSTEM PROCEDURE
A non slipping contact lens fits over corneal bulge.
Tracking is recorded by affixing a magnetic coil or mirror to the lens. Mechanis
m employing lens to detect eye movements is shown in the figure.
HEAD MOUNTED CAMERA METHOD
PROCEDURE 1.Uses a camera to capture eye images, and tracks pupil motion by mean
s of image processing program. 2. The centre position of the moving pupil is com
puted at the computer. 3. The calculated result is then transmitted to the power
ed wheelchair through serial port.
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
3. Head Mounted Camera method
ADVANTAGES Doesn¶t restrict the user¶s head movements. DRAWBACKS More awkward to use t
han the desk-based system as the user has to have instrument mounted to head
9/11/2009 EYE CONTROLLED WHEELCHAIR 13
TYPES OF DETAILED BLOCK DIAGRAM
There are 2 types of block diagrams for eye controlled wheelchair. 1.WIRELESS. T
he wireless version of the wheelchair suits the scenario where similar wheelchai
rs operate within a certain region (such as hospitals etc) . 2.WIRED Works on th
e similar lines as the one employing wireless means of communication It does not
involve the encoder²decoder and the transmitter²receiver modules.
WIRELESS BLOCK DIAGRAM COMPONENTS
1.COMPUTER. 2.OPTO-ISOLATOR. 3.ENCODER(HT12E). 4.TRANSMITTER MODULE. 5.RECEIVER
MODULE TUNED TO 315 MHZ. 6.DECODER. 7.MOTOR DRIVING CIRCUIT.
EXPLANATION OF COMPONENTS IN DETAIL
1.COMPUTER. Computer terminal serves the main purpose of accepting real time vid
eo from source (webcam\ stored video) . Processes it to generate motor actuation
signals. Sampling real time video at a considerably higher rate and generate a
series of images. Processed to determine the eye movements using image processin
g. Corresponding actuation signals are released through the parallel port.
EXPLANATION OF COMPONENTS IN DETAIL
2.ISOLATOR Additional stage used for isolation of transmitter circuitry and comp
uter port. . We use MCT2E opto-isolator. 3.ENCODER. Main purpose of encoder IC i
s to synchronize the movement of receiver . encoder used here is HT12E . 4.TRANS
MITTER MODULE. ASK technique of modulation is used . Carrier frequency chosen is
315MHz. RF module is used. ¼ wave antenna (17 cm) is used to radiate signals.
EXPLANATION OF COMPONENTS IN DETAIL
5.RECEIVER MODULE. The receiver, tuned to 315 MHz, is basically an ASK demodulat
or . It gives digital data stream at its output, which is further decoded. 6.DEC
ODER. Converts the serial data stream into parallel data. HT12D decoder IC is us
ed . 7.MOTOR DRIVERS. Decoded data is used for controlling the operation of the
motors. Used to switch the motors to move in clockwise or anticlockwise directio
n.
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
DETAILED BLOCK DIAGRAM
Wireless
OPTO ISOLATOR ENCODER
TRANSMITTER MODULE
RECEIVER MODULE DECODER MOTOR DRIVING CIRCUIT
9/11/2009
EYE CONTROLLED WHEELCHAIR
19
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
DETAILED BLOCK DIAGRAM
Wired
OPTO ISOLATOR
MOTOR DRIVING CIRCUIT
9/11/2009
EYE CONTROLLED WHEELCHAIR
20
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
CIRCUIT DIAGRAM (MOTOR DRIVE CIRCUIT)
9/11/2009
EYE CONTROLLED WHEELCHAIR
21
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
ALGORITHM
STEP 1: Start STEP 2: Reset the system¶s initial values. STEP 3: Set the counter v
alue to zero. STEP 4: Take Real Time Video from Source (Camera or Webcam or stor
ed video). STEP 5: Convert Real Time Video into frames. STEP 6: Store the frames
in form of matrix. STEP 7: Prepare the digital negative of the matrix. STEP 8:
Determine the quadrant in which pupil lies. STEP 9: Is there any change in direc
tion? If YES go to STEP 3, else go to next step. STEP 10: Increment counter valu
e by 1. STEP 11: Is counter value greater than threshold value? If NO go to STEP
4, if YES determine the direction of movement. STEP 12: Generate activation sig
nals for the relay motor driving circuit. Go to STEP 4 and continue.
9/11/2009 EYE CONTROLLED WHEELCHAIR 22
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
Start Reset Initial values Set Counter value to zero Take Real Time Video from s
ource Divide the video into frames Store the frames in form of matrix Determine
the quadrant
FLOWCHART
Yes
Any change in direction?
No
Increment Counter value by 1
Is counter value greater than threshold ?
No
Determine direction Generate activation signals
Yes
9/11/2009
EYE CONTROLLED WHEELCHAIR
23
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
OUTOUT OF MATLAB
Eye Image
Negative
POSITION:
CENTER
9/11/2009
EYE CONTROLLED WHEELCHAIR
24
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
Wheel Mechanism
FORWARD MOVEMENT
ANTI CLOCKWISE CLOCKWISE
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
Wheel Mechanism
LEFT MOVEMENT
ANTI CLOCKWISE ANTI CLOCKWISE
CLOCKWISE
RIGHT MOVEMENT
CLOCKWISE
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC WHEEL MECHANISM FUTURE SCOPE REFERENCES
FUTURE SCOPE
Faster processing Lens controlled Brain Controlled Multi-Application Auto Mobili
ty System . Impact on bollywood.sanjay leela bhansali is making a movie in which
he uses a wheel chair controlled by the patients heart beat.
9/11/2009 EYE CONTROLLED WHEELCHAIR 27
OBJECTIVE INTRODUCTION PROPOSED SYSTEM VARIOUS EYE TRACKING MECHANISMS DETAILED
BLOCK DIAGRAM CIRCUITS SOFTWARE LOGIC FUTURE SCOPE REFERENCES
REFERENCES
[1] A. Haro, M. Flicker and I. Essa, ³Detection and tracking eyes by using their p
hysiological properties, dynamics and appearance,´ Proceedings of IEEE CVPR 2002.
[2] P. Smith, M. Shah, N. Lobo, ³Monitoring head/eye motion for driver alertness u
sing one camera,´ Proceedings of the International Conference on Pattern Recogniti
on, 2000. [3] C. Morimoto, Eye Tracking, 2003, http://www.ime.usp.br/~hitoshi/fr
amerate/node2.html [4] Robert J.K. Jacob. "Eye Movement-Based Human-Computer Int
eraction Techniques: Toward Non-Command Interfaces". HumanComputer Interaction L
ab. Naval Research Laboratory. Washington, D.C. [5] Reference Manual, Intel Imag
e Processing Library, Document 663791-005, Intel Corporation, 2000, http://www.c
s.nott.ac.uk/~jzg/nottsvision/ipldoc.pdf [6] www.matlabcentral.com
9/11/2009
EYE CONTROLLED WHEELCHAIR
28
A PIECE OF ADVISE TO THE VIEWERS
Please respect and help people who are disabled According to our group they are
not disabled but differently abled and far more superior than all of us . They a
re people with a golden and a strong heart. This project we have made from our h
eart and our brain has assisted us. This project is close to our heart.
FAMOUS ACHIEVERS
STEPHEN HAWKING Dr. SURESH ADVANI CHRISTOPHER REEVES FRANKLIN D. ROOSEVELT
9/11/2009
EYE CONTROLLED WHEELCHAIR
30
THANK YOU
9/11/2009
EYE CONTROLLED WHEELCHAIR
31