Mind Reading Computers

Contents

Introduction
Computational Model
Goal of Mind Reading
How does it Work
Process
Techniques
 Contents
Algorithm
Database
Application
Advantages
Disadvantages
Conclusion
Reference
 Introduction
Mental states are expressed through
facial expressions and vocal nuances
and gestures.
This can be used to interact with
machines.
Theory of mind reading- Mental states
guide prediction of actions.
 Computational Model of mind reading
Based on psychology, computer vision and
machine learning.
Laboratory at the University of Cambridge
has developed mind-reading machines.
Mind-reading machines computers that
implement a computational model of mind-
reading to infer mental states of people
from their facial signals.
 Goal of Mind Reading

Enhances human-computer interaction.

Improve the productivity of the user.
Enable applications to initiate interactions with
and on behalf of the user, without waiting for
explicit input from that user.
 How does it work
Measuring the volume and oxygen level of
the blood around the subject's brain
It is done using technology called
functional near-infrared spectroscopy
(fNIRS).
Futuristic head band is used
 How does it work

The results are often

compared to an MRI, but
can be gathered with
lightweight, non-invasive
equipment
Example: Detecting Overwork.
Measuring mental workload, frustration and
distraction
Process of Mind Reading
 Techniques

Facial Affect Detection

It is done using hidden Markov Model,
Neural Network processing or active
appearance model.

Emotional Classification
Classification by Paul Ekman
Anger, Fear, Happiness,
Disgust ,Sadness, Surprise.
 Techniques

Facial Electromyography
It is used to measure the electrical activity of the
facial muscles. Muscles used are corrugator
supercilii muscle and others.
Galvanic Skin Response
It is a measure of skin conductivity, which is
dependent on how moist the skin is.
Blood Volume Pulse
It is measured by a process called
photoplethysmography. It produces a graph
indicating blood flow through the extremities.
 Mind Reading Database
Data recorded has to be matched with subjects data.
First data base was created FAU Aibo Emotion Corpus for CEICES (Combining Efforts for
Improving Automatic Classification of Emotional User States).
Two widely used databases
CK+
JAFFE
 Applications

Mind Controlled Wheelchair

Web Search
Marketing.
Screening suspected terrorists
Converts Thoughts into Speech.
Help Paralytic Patients.
Mind Controlled Wheelchair

Developed from the University o

Electro-Communications in Japan
Works by mapping brain wave
when you think about moving left
right, forward or back
The result of this is that you can
move the wheelchair solely with
the power of your mind.
 Web Searches

"This proved we could browse the web

without touching a keyboard.
Each letter was represented by a unique pair
of number co-ordinates.
Software correctly picked up the signals 92
per cent of the time.
These were used to silently spell
"NASA" into a web search engine using the
program.
 Future Projects

We are working with a major car

manufacturer to implement this system in
cars to detect driver mental states such as
drowsiness, distraction and anger.

Imagine a future where we are surrounded

with mobile phones, cars and online services
that can read our minds and react according
 Disadvantages

70 percent accuracy
Number of factors causes FMRI results
variance.
Individual brains differ, so scientists need
to study a subject's patterns before they
can train a computer.
Tapping Brains for Future Crimes
 Disadvantages

The preliminary tests may have been

successful because of the short lengths of
the words.
The initial success "doesn't mean it will
scale up", he told New Scientist.
Legal scholars question the foundational
principles of predicting emotions based
on heart beat and facial expression
through computer
 Conclusion
Tufts University researchers have begun a
three-year research project.
If successful, will allow computers to respond
to the brain activity of the computer's user.