STANDARDIZED BRAIN MUSIC THERAPY

ASSISTED LIVING – 6TH APRIL 2011

ADRIAN ATTARD TREVISAN & LEWIS JONES

www.braInmus Ic.net
 SCOPE FOR RESEARCH

“Despite advances in technology, opportunities for active participation

and basic communication with the outside world are limited for people
with differentiated physical and mental deficits, especially those with
severe complex disabilities”

Miranda et. al (2003)

“Delta brainwaves are present in abnormally high levels when Autism

Spectrum Disorder patients are awake “

Ayers (2000)
 OBJECTIVES

CREATE THE TECHNICAL METHODOLOGY TO EXTRACT AND

ANALYSE EEG DATA FROM AN INEXPENSIVE 2-CHANNEL DEVICE,
WITH THE SAME ACCURACY AS IT IS CURRENTLY ACHIEVED WITH
32-CHANNEL HIGH-END CLINICAL APPARATUS.
(THE METHODOLOGY NEEDS TO BE AS STANDARD AS POSSIBLE IN ORDER TO BE USED WITH ANY
EEG COLLECTING DEVICE)

CREATE A STANDARD PROCEDURE FOR THE ESTABLISHMENT OF

“BRAIN MUSIC THERAPY” SESSIONS USING THE PROPOSED
METHODOLOGY. THE MAIN AIM OF THE THERAPY IS TO SUPPRESS
A TYPE OF BRAINWAVE (e.g. DELTA WAVES IN AUTISTIC PATIENTS)
AND TO STIMULATE OTHER BRAINWAVES, SUCH AS ALFA AND
BETA
 THE BRAIN MUSIC SYSTEM

Project’s key areas

1. 2. 3. 4.

?
Brain Signal Applied Output
Signals Computation

Flow mode of the Brain Music System

 BRAIN SIGNALS

4 major types of brainwaves present in a

human: BETA, ALFA, THETA and
DELTA.

All 4 types are present at each given time,

with 1 of the 4 being dominant.

Each of the 4 major brainwaves is

associated with a particular state of mind.

In “normal” humans the ALFA and BETA

waves are associated with waking activities,
whilst THETA is associated with relaxation
and meditation, and DELTA is mostly
associated with sleeping.

In a number of neurological conditions,

such as Autism Spectrum Disorder, the
DELTA wave is dominant all the time (even
when the person is awake).
 REAL LIFE "EEG" REPRESENTATION

EEG OUTPUT

• When going through any EEG collecting device , the signal is complex and a
number of mathematical algorithms need to be applied in real time in order
to be able to separate the signals into their original state
 LORETA

• LORETA is a data analysis method used to interpret and model data from an EEG
representation

• In order to be effective, this method usually needs at least 19 channels of EEG data
(needing 19 electrodes on the scull)

• This type of analysis method is associated with clinical environments due to its
particular needs (expensive 19-channel clinical type of EEG)
 MODIFIED LORETA
Pioneered in the Brain Music System , with published peer
reviewed results

Modified LORETA methodology enables the system to obtain and

predict information from just 2 or 3 EEG channels.

Data is augmented before being saved in.edf format (European

Standard EEG data file), simplifying the process to be used on any suitable
software (we used WINEEG as a standard).

This modification enables smaller devices (having 2 or 3 electrodes rather

than 19) to be less invasive, while still being able to monitor clinical
standard EEG data.

In the case of the Brain Music System, this enables the system to be
portable and to serve therapeutic sessions or general use outside of a
clinical setting.
 MODIFIED LORETA

What is the difference from the original LORETA ?

It is important to have a A clip on each ear is

clear reading from the
boundary in order to be
able to calculate the
difference in voltage by
the cranium's absorption
important as to give a
neutral output ( since ear
lobe's cartilage is
supposed to be without
electrical activity

Studies by Filatreau et al ,
suggests that the signals
It is important to have a
collected are over 60%
clear reading from the
more reliable in the
boundary in order to be
central area compared to
able to calculate the
the rest of the skull
difference in voltage by
the cranium's absorption
 MODIFIED LORETA

• Once data is collected from the

identified brain zones, an approximation
algorithm augments the pre-saved data
in real time, in order to have "virtual
channel approximations" to be used
during the data computation

• For use in the Brain Music System, this

means that the music produced in real
time represents current level of
brainwave activity (close to what a 19-
channel clinical EEG would produce)
 STUDY TO COMPARE MODIFIED LORETA
( BRAIN MUSIC SYSTEM) with LORETA
( CLINICAL EEG SETUPS)

10 “Normal” Subjects

15 seconds active EEG recording per subject

Eyes open and active ( not dormant as to not stimulate the Delta waves)

Auditory Stimuli presented ( not visual)

Presented in a quiet envoirenment

SAMPLE SUBJECT
 OUTCOMES

Beta wave range is clearly the most present in

●

thereadings of the Brain Music System (results are

similar to those of the published studies of
Hofstadter K, Steenson)

●
Throughout the analysis of brain waves, Beta is the
m ost significant form of wave (with the highest mean)
, followed by Theta and Alpha respectively.
The least form of brain wave consistently present
was the Delta, which, since the experim ent needed
subjects to rem ain assertive, had consistently lower
figures in each of the ten subjects.
 MUSICAL ENGINE
( DATA PROCESSING)
 DATA PROCESSING

•The frequency band controls the Generative

System (effecting the music composition)

•The Signal Complexity controls the music

interpretation
(we can focus on tempo or musical grammar )

Difference in Signal =
difference in tempo and musical
grammar

Digram represents the Musical Engine adapted from the idea

presented by Hofstadter K (keeping in mind the system's power
limitations)
 GENERATIVE RULES

Frequency
Frequency
band 1
band 2
begin Frequency Frequency
band 2 band 1
Etc
Frequency Frequency .
band 3 band 4

Frequency Frequency
band 4 band 3

Generative rule Generative rule

1 2

1 st musical representation of 2 seconds is

The generative system adds together a rule with another ,
automatically generated by our system – not
adding a short sequence with the next one
biologically produced. After that, the system uses the
N100 rule, collecting data automatically every 80-120
milliseconds, using the previous musical
representation as an auditory stimulus to trigger the
response used for the next data collection point.
BRAIN MUSIC THERAPY
 BRAIN MUSIC THERAPY ( BMT)

• It is a therapy based on "Sonified Neurofeedback “with the auditory pathway (ears) acting as a
direct input to certain areas within the brain

• Scientific literature shows that brainwaves are adapted by a quantified amount each time a
person listens to a particular piece of music

• By an initial monitoring of the brainwaves (using QEEG), a properly designed program can be
sketched and implemented with goals for each session

QEEG
Data
TESTING Adapted EEG
and EEG Analyzed ,
compar ed with Music pr esented
Analysis , Collection to subject
needs and
( Goals for
goals and
ther apy
modified
established)
 BRAIN MUSIC SYSTEM
( HARDWARE / SOFTWARE)
 BRAIN MUSIC
SYSTEM
Hardware :

•First “Scientifically proven” headset that is comparable to commercial

high-end EEG systems

•Unique electrode positioning and built in algorithms makes it powerful

as a computer device ( replacing a typical mouse for bed ridden

patients with relevance in Assisted Living ) or a therapeutic system
for a number of neurological conditions ( including Autism)

• Easy to wear ( making it possible for young children to use) due to its
unique minimal design

•Using BlueTooth can connect to both mobile devices and computers

alike ( developed drivers can be easily adapted to any Operating
System)

Software

• Connects automatically to the headset using the built in detector

• Compatible to any device that has a USB connection.

• Easy to use ( due to its large icons and ability to be used on a touch
screen)

• Can be run for therapeutic purposes or for any other modular use
PROJECT
PUBLICATIONS

Published Books:

Attard Trevisan , A. (2010) “ Introduction to Brain Music

System” , Sonified Books , UK

Project Website : www.brainmusic.net

 REFERENCES

Arslan, B., Brouse, A., Castet, J., Lehembre, R., Simon, C., Filatriau, J. J. and Noirhomme, Q. "Real
Time Music Synthesis Environment Driven with Biological Signals", Proceedings of IEEE
International Conference on Acoustics, Speech, and Signal Processing, 2009.

Coutinho, E. Miranda, E. R. and Cangelosi, A . "Towards a Model for

Embodied Emotions", Proceedings of the Workshop on Affective Computing: Towards Affective
Intelligent Systems, 2005

Filatriau, J. J., Lehembre, R., Macq, B., Brouse, A. and Miranda, E. R.. "From EEG signals to a world of
sound and visual textures" 2007.

Groves Bob. “Brain music therapy tunes into trouble ; Waves used to help with ups, downs”. The Record,
2005.

Gruzelier J. & Egner, T. “Critical validation studies of neurofeedback”. Child

and Adolescents Psychiatric Clinics of North America, 2005 14 83-104.
.
Hofstadter, K. Investigate the use of EEG data for the purposes of sonification and visualisation in a
creative environment. Creative Music Technology.2009, Anglia Ruskin University.

Ito, Shin-ichi et al. “The Proposal of the EEG Characteristics Extraction

Method in Weighted Principal Frequency Components Using the RGA.” SICE-ICASE International Joint
Conference 18.21 (2006): 1152 – 1155. Print
 REFERENCES

Gruzelier J. & Egner, T. “Critical validation studies of neurofeedback”. Child

and Adolescents Psychiatric Clinics of North America, 2005 14 83-104.

Hofstadter, K. Investigate the use of EEG data for the purposes of sonification and visualisation in a
creative environment. Creative Music Technology.2009, Anglia Ruskin University.

Ito, Shin-ichi et al. “The Proposal of the EEG Characteristics Extraction

Method in Weighted Principal Frequency Components Using the RGA.” SICE-ICASE International Joint
Conference 18.21 (2006): 1152 – 1155. Print.

Johnson, Don. Discrete Fourier Transform (DFT). Connections, 1 Oct. 2009.

Livingstone, D. and Miranda, E a). "ORB3 - Musical Robots within an Adaptive Social Composition
System", Proceedings of the International Computer Music Conference 2005

Livingstone, D. and Miranda, E. R. "Composition for Ubiquitous Responsive

Environments", Proceedings of the International Computer Music Conference,
Miami, 2004.

Megan, K. & Writer, C. S. Sooted by your brainwaves ; Therapeutic when

Converted to music. Hartford Courant. STATEWIDE ed. 2009.
 REFERENCES

Miranda, E R. "Brain-Computer music interface for composition and

performance", International Journal on Disability and Human Development,
2006 5(2):119-125.

Miranda, E. R. "On the Music of Emergent Behaviour: What can Evolutionary

Computation Bring to the Musician?", Leonardo 2003, Vol. 36, No. 1, pp.55-58.

Miranda, E. R. and Boskamp, B. "Steering Generative Rules with the EEG: An

Approach to Brain-Computer Music Interfacing", Proceedings of Sound and
Music Computing, 2005.

Miranda, E. R., Sharman, K., Kilborn, K., Duncan, A. "On Harnessing the
Electroencephalogram for the Musical Braincap", Computer Music Journal
2003, Vol. 27, No. 2, pp. 80-102.

Zhang, Q. and Miranda, E. R. "Multi-Agent Simulation for Generating

Expressive Music Performance", Proceedings of World Congress on Social Simulation, 2008.