RNS INSTITUTE OF TECHNOLOGY

3rd International Conference on

Data Engineering and Communication Systems
Dec 19-20, 2019
Jointly Organized by
Departments of CSE and ISE

Paper ID : 157
A Computational Intelligence Paradigm
with Human Computer Interface Learning
Kiran Waghmare
CDAC Mumbai

Dr Reeja S R
Associate Professor,
Dayanand Sagar University
Agenda
 Introduction
 Related Work
 Proposed Methodology
 Model
 Algorithm
 Experimental Results and Observations
 Conclusions
 References

03/05/2020 ICDECS-2019, RNSIT 2

Introduction: Biosignal
• A biosignal is any signal in human beings that can
be continually measured and monitored.

 ECG (Electrocardiogram)
 EEG (Electroencephalogram)
 EMG (Electromyogram)
 EOG (Electrooculogram)
 Galvanic skin response
 MEG (Magneto encephalography)

03/05/2020 3
Human Computer Interface

• Method of communication of Brain with external

devices.
• Communication using Thoughts of Brain (EEG) without
using any Muscle control, especially for people who are
in “lock in syndrome” or paralyzed.

Input

03/05/2020 4
EEG
Electroencephalography (EEG) is the
recording of electrical activity along the
scalp

EEG measures voltage fluctuations resulting

from ionic current flows within the neurons
of the brain

German physiologist and psychiatrist Hans

Berger (1873-1941) recorded the first human
EEG in 1924
03/05/2020 5
 NeuroFeedback
• Neurofeedback is direct training
of brain function, by which the
brain learns to function more
efficiently.

• Nothing but attaching sensors to

the body for purpose of acquiring
biological signals such as:
• ECG, EEG,EMG,EOG, etc

• Neurofeedback is a type of
biofeedback for brain electrical
activities.
03/05/2020 6
Way to get EEG Biosignal

03/05/2020 ICDECS-2019, RNSIT 7

Frequency Distribution of
EEG

Ref: [(2) A K Jain et al.,2000] [(3)PLC Rodrigues et al.,2017 ] [(4)Lotte et

al., 2007]
03/05/2020 ICDECS-2019, RNSIT 8
Problem Definition

Small Training sets: Signal-to noise ratio:

Processing depends on Poor ration is very challenging,
unknown parameters, most of so sensitive measures are hard
the dynamics are still to obtain. Hence, Noise and
uncovered. outliers are part of it.

Non stationary: Time information:

Relative brain activity is small Large collections of neurons
compared to interfering are involved in many different
artifacts and compared to activities, not just one, hence
brain background activity, also brain activity pattern varies
rapidly varies over time from time to time.

03/05/2020 Ref: [(6) S Solhjoo et al,2005] [[11) Ghanbari et al., 2012] [[13] Kuo et 9
 Objectives of Study

To study the EEG Signals with respect to various HCI applications

To study the various Classifier algorithms used in HCI Applications

which make use of EEG Signals for Prediction

To analyze the EEG signals as a Pattern Recognition System and focus

on the properties based classifiers used to design them for better
performance

10
Related Work

03/05/2020 ICDECS-2019, RNSIT 11

Proposed Methodology

• Module 1: Input EEG Signals

• Module 2: Signal Processing
• Pre processing, Feature Extraction and Classification
• Module 3: Output results for executing different HCI applications

03/05/2020 ICDECS-2019, RNSIT 12

Classification Algorithm
• Time variations of EEG:
• EEG signals activity patterns varies due to frequency
bands,
• it may results into curse of dimensionality and time,
• we can classify the EEG signals as follows:
1. Feature concatenation from different time segments
2. Combine the different time segments for classification
3. Dynamic classification

Therefore, Mandatory to select most appropriate classifier

for set of features with its properties of available classifier

03/05/2020 ICDECS-2019, RNSIT 13

Taxonomy of Classification Algorithms

• Linear Classifier
• E.g., LDA
• Neural Network Classifier
• E.g., Multilayer
Perceptron
• Non-Linear Bayesian
Classifier
• E.g., HMM
• Nearest Neighbor
Classifier
• E.g., kNN

03/05/2020 ICDECS-2019, RNSIT 14

Experimental Results and Observations

• Based on Classifier Algorithms Survey,

• evaluated algorithms are classified based on properties of
classification algorithms for various BCI applications.

• Generative, discriminative, static, dynamic, stable, unstable,

regularized etc.

03/05/2020 ICDECS-2019, RNSIT 15

 Observations
Generative Discriminative Static Dynamic
• Informative • Use Class • Use single • Can classify
classifier, membership feature the sequence
• Classify the to classify a vector, cannot of feature
feature feature vector take into vectors and
vector, by directly account thus catch
computing temporal temporal
the likelihood information dynamics
of each class
&choose most
likely • E.g., • E.g., Hidden
• E.g., SVM Multilayer Markov
• E.g. Bayes Perceptron Model
Quadratic

03/05/2020 ICDECS-2019, RNSIT 16

Observations

Stable Unstable Regularized

• Low complexity • Small variations • Complexity is

• Small variations leads to large handled in order
does not affect change in training to prevent
the performance set which affects overtraining
the performance • Good
generalization
• E.g., Linear • E.g., Multilayer performance
Discriminant Perceptron
Analysis • E.g., kNN

03/05/2020 ICDECS-2019, RNSIT 17

Experimental Results and Observations

03/05/2020 ICDECS-2019, RNSIT 18

 Advantages
Classifier Type Algorithms Reference Paper Disadvantages Accuracy
GertPfurtscheller et al. Easy implementation with linear
FLDA Complex operations with matrices 96%
2000 Kuo et al. 2016 decision boundry and fast classification
RFLDA Alexander et al. 2000 Faster and more accurate classification More complex with gaussian 97%
assumptions training time
Linear Classifier
LINEAR SVM P.L.C. Rodrigues1et al. Better accuracy with complex Computationaly expensive 92%
2017 nonlinear data points
Time consuming Training process
RBF SVM Ghanbari et al. 2014 Handles overfitting easily 90%
with multiple classes
MLP Ghanbari et al. 2014 Low computation time feature have maximum variance 90%
BLR NN Li, Y et al. 2014 Reduce problem complexity depends upon scaling of data 80%
TD NN Goyal et al. 2016 Data driven and self adaptive requires huge processing time 90%
GD NN Kumar et al 2015 noise tolerance extensive memory requirements 90%
Fatemeh Safari et al easily identify complex
Gaussian NN handles overfitting 72%
2010 relationsbetween variables
Neural Network LVQ NN Li, Y et al. 2014 Easy to use with less features difficult to know how many 60%
Classifier neurons and layers are necessary
Vladimir AMaksimenko
PERCEPTRON et al 2018 Easy to implement slow learning 83%
requires hardware to handle the
RBF NN Kumar et al 2015 Handles real life problems real situations 78%
PE GNC T. Felzer et al. 2003 effcient learning requires high processing time 85%
Fatemeh Safari et al
FUZZY ARTMAP NN handles uncertainty efficiently gives precise solutions 94%
2010
freedom to manipulate the training large number of unstructured
HMM Hsu, W.et al.2015 78%
and verification process parameters
powerful modeling tool than statistical unable to handle higher order
IO HMM S. Chiappa et al, 2004 77%
Non-linear methods correlation
Bayesian Classifier sensitive to input data as all
BAYES QUADRATIC Z. A. Keirn et al. 1996 suitable for small dataset 81%
features are equally important
BAYES GRAPHICAL Prediction with tolerance to corelated Outliers existance with complex
MODEL B. Blankertz et al. 2002 input models 90%

KNN Effective,
B. Blankertz et al. 2002 classifier Non-parametric, robust time consuming classifier with high 78%
Nearest Neighbour computational cost
Classifier MANALOBBIES F. Cincotti et al, 2003 correlation among variables tends to overclassify 71%
DISTANCE

03/05/2020 ICDECS-2019, RNSIT 19

Conclusions and Future Work
• Classification results were not prominently evident for all
classifiers
• Linear classifier classify with highest accuracy of 90%
• Neural Network classifier ranges from 70% to 90%
• Non linear Bayesian classifier ranges from 78% to 90%
• Nearest Neighbor classifier ranges from 70% to 78%

• Property based classification techniques are the

foundation for making HCI applications more effective with
intelligence.
• Study of existing paper of classification survey reveals the
benefits of classifier property based prediction
• Further study will lead to new automated intelligent
technique for improved accuracy for HCI applications
03/05/2020 ICDECS-2019, RNSIT 20
 References and Thank you
• Vallabhaneni A, Wang T, and He B. Brain computer interface,. In He B (Ed): Neural Engineering, Kluwer Academic/Plenum Publishers, pages 85–
122, 2005.
• A.K. Jain, R.P.W. Duin, and J. Mao. Statistical pattern recognition : A review. IEEE Transactions on Pattern Analysis and Machine Intelligence,
22(1):4–37, 2000
• P.L.C. Rodrigues1, F. Bouchard1, M.Congedo1, C.Jutten, DIMENSIONALITYREDUCTIONFORHCICLASSIFICATIONUSIN G RIEMANNIANGEOMETRY‖
7th Graz Brain-Computer nterface Conference (HCI 2017), Sep 2017
• Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007). A review of classification algorithms for EEG•based brain computer
interfaces. Journal of neural engineering, 4
•
D. Balakrishnan and S. Puthusserypady. Multilayer perceptrons for the classification of brain computer interface data. In Proceedings of the IEEE
31st Annual Northeast Bioengineering Conference, 2005.
• S. Solhjoo and M. H. Moradi. Mental task recognition: A comparison between some of classification methods. In BIOSIGNAL 2004 International
EURASIP Conference, 2004.
• G.A. Carpenter, S. Grossberg, N.Markuzon, J.H.Reynolds, and D.B. Rosen. Fuzzy artmap: A neural network architecture for incrementalsupervised
learning of analog multidimensional maps. IEEE Transactions on Neural Networks, 3:698–713, 1992.
• C M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, 1996.
• S. Rezaei, K. Tavakolian, A. M. Nasrabadi, and S. K. Setarehdan. Different classification techniques considering brain interface applications. Journal
of Neural Engineering, 3:139–144, 2006.
• William Penny and Stephen Roberts, ―Experiments with an EEG-based computer interface,‖ Technical report, Imperial College,
• Ghanbari, A. A., Broumandnia, A., Navidi, H., and Ahmadi, A. (2012),
• ―Brain Computer Interface with Genetic Algorithm‖, International Journal of Information and Communication Technology Research, Vol. 2
No. 1, Pp: 79–86.
• Goyal, A., Samadani, A., Guerguerian, A. and Chau, T. (2016), ―An Online Three-Class Transcranial Doppler Ultrasound Brain Computer
Interface‖, Neuroscience Research. http://doi.org/10.1016/j.neures.2015.12.013.
• Kuo, C., Knight, J. L., Dressel, C. A., Chiu, A. W. L.,. (2012),
• ―Non-Invasive BCI for the Decoding of Intended Arm Reaching Movement in Prosthetic Limb Control‖, American Journal of Biomedical
Engineering, Vol. 2, No. 4, Pp: 155–162.
03/05/2020 ICDECS-2019, RNSIT 21