Drivers hypo vigilance detection by video features analysis (blink, yawn, gaze direction) on 200Hz IR video Fusion with

h EEG information. information

Some researchers at DIS department (Image and Signal department) of GIPSA-lab are working on face analysis since more than 20 years (face ce recognition, facial expression classification, facial features segmentation). segmentation In 2009, a prelimi liminary work about hypovigilance detection tection has been done during during the PhD work of Antoine Picot [1, [1 2, 3]. A system based both on video information i and EEG EG information has been developped. developp As a result of the phD work, it has been demonstrated that hypovigilance can be detected by analysing blink frequency only if video is acquired at high frequency (more than 200Hz). The Innov+ start-up wants to develop a smartphones smartphone embedded mbedded application dedicated to the drivers s hypovigilance detection in order to provide an alert to the driver. Such kind of application could be very useful for safety ety reason but also for economic reason (especially ( for insurance company). The aim of the proposed phD work is to start with the system developed by Antoine Picot in order to make it more efficient and reliable. Some ideas could be investigated: The initial system is related on blink analysis only. It could be interesting to consider others facial information such as yawn frequency, gaze direction and head motion. In order to provide an application able to work night and day, it will be necessary to use an infra-red acquisition acquisiti device. The first study would be to evaluate the performance of Picots s system when dealing with IR images. images Database acquisition sition will be required in order to evaluate the performance of the proposed system. A collaboration with the CIEN lab of Strasbourg bourg will be consider because this lab has a drivers driver simulator. The rules for video and EEG information fusion will have to be improved improve in order to increase the reliability of the proposed system. The phD work is going ng to take place at GIPSA-lab GIPSA located cated in Grenoble, France under the supervision of prof. Alice CAPLIER. processin programming ogramming (Matlab and / or C Required knowledge: image and signal processing, language). [1]
A. Picot, S. Charbonnier, A. Caplier )n%line line detection of dro*siness !sin+ brain and /is!al information, IEEE Trans on Systems, Man, and Cybernetics , Part A- Sytems and .!mans, /ol!me 4 , Iss!e ", pp. #$4%##&, ##&, May '( .

[2] A. Picot, S. Charbonnier, A. Caplier Capl EOG based drowsiness detection : Comparison between a
fuzzy system and two supervised learning lear classifiers 18th World Congress of the International Federation of Automatic Control (IFAC), Milan, Italie, septembre 2011.

[3] Picot, S. Charbonnier, A. Caplier Capl Drowsiness detection based on visual signs: blinking analysis based on high frame rate video. video I2MTC '10 - International Instrumentation and Measurement Technology Conference, tats-Unis (2010). Mathmatiques Campus universitaire, , Grenoble Place : GIPSA-lab/DIS, 11 rue des Mathmatiques, Supervisor : Alice Caplier, full professor, professor Mail : alice.caplier@gipsa-lab.grenoble lab.grenoble-inp.fr