JBiSE  Vol.7 No.8 , June 2014
Individual Classification of Emotions Using EEG
ABSTRACT
Many studies suggest that EEG signals provide enough information for the detection of human emotions with feature based classification methods. However, very few studies have reported a classification method that reliably works for individual participants (classification accuracy well over 90%). Further, a necessary condition for real life applications is a method that allows, irrespective of the immense individual difference among participants, to have minimal variance over the individual classification accuracy. We conducted offline computer aided emotion classification experiments using strict experimental controls. We analyzed EEG data collected from nine participants using validated film clips to induce four different emotional states (amused, disgusted, sad and neutral). The classification rate was evaluated using both unsupervised and supervised learning algorithms (in total seven “state of the art” algorithms were tested). The largest classification accuracy was computed by means of Support Vector Machine. Accuracy rate was on average 97.2%. The experimental protocol effectiveness was further supported by very small variance among individual participants’ classification accuracy (within interval: 96.7%, 98.3%). Classification accuracy evaluated on reduced number of electrodes suggested, consistently with psychological constructionist approaches, that we were able to classify emotions considering cortical activity from areas involved in emotion representation. The experimental protocol therefore appeared to be a key factor to improve the classification outcome by means of data quality improvements.

Cite this paper
Valenzi, S. , Islam, T. , Jurica, P. and Cichocki, A. (2014) Individual Classification of Emotions Using EEG. Journal of Biomedical Science and Engineering, 7, 604-620. doi: 10.4236/jbise.2014.78061.
References
[1]   Rottenberg, J., Gray, R.D. and Gross, J.J. (2007) Emotion Elicitation Using Films. Oxford University Press, London, 9-28.

[2]   Janssen, J.H., IJsselsteijn, W.A. and Westerink, J.H. (2013) How Affective Technologies Can Influence Intimate Interactions and Improve Social Connectedness. International Journal of Human-Computer Studies, 72, 33-43.

[3]   Pell, M.D., Monetta, L., Paulmann, S. and Kotz, S.A. (2009) Recognizing Emotions in a Foreign Language. Journal of Nonverbal Behavior, 33, 107-120.
http://dx.doi.org/10.1007/s10919-008-0065-7

[4]   Chanel, G., Ansari-Asl, K. and Pun, T. (2007) Valence-Arousal Evaluation Using Physiological Signals in an Emotion Recall Paradigm. IEEE International Conference on Systems, Man and Cybernetics, Montreal, 7-10 October 2007, 2662-2667.

[5]   Davidson, R.J., Ekman, P., Saron, C.D., Senulis, J.A. and Friesen, W.V. (1990) Approach-Withdrawal and Cerebral Asymmetry: Emotional Expression and Brain Physiology: I. Journal of Personality and Social Psychology, 58, 330-341.
http://dx.doi.org/10.1037/0022-3514.58.2.330

[6]   Lindquist, K.A., et al. (2012) The Brain Basis of Emotion: A Meta-Analytic Review. Behavioral and Brain Sciences, 35, 121-143.
http://dx.doi.org/10.1017/S0140525X11000446

[7]   Hatada, T., Sakata, H. and Kusaka, H. (1980) Psychophysical Analysis of the “Sensation of Reality” Induced by a Visual Wide-Field Display. SMPTE Journal, 89, 560-569.
http://dx.doi.org/10.5594/J01582

[8]   Zhao, J. (2006) The Effects of Induced Positive and Negative Emotions on Risky Decision Making. Talk Presented at the 28th Annual Psychological Society of Ireland Student Congress, Maynooth, May 2006, 22 p.

[9]   Estrada, C.A., Isen, A.M. and Young, M.J. (1997) Positive Affect Facilitates Integration of Information and Decreases Anchoring in Reasoning Among Physicians. Organizational Behavior and Human Decision Processes, 72, 117-135.
http://dx.doi.org/10.1006/obhd.1997.2734

[10]   Lerner, J.S., Tetlock, P.E. (1999) Accounting for the Effects of Accountability. Psychological Bulletin, 125, 255-275.
http://dx.doi.org/10.1037/0033-2909.125.2.255

[11]   Gross, J.J., Sutton, S.K. and Ketelaar, T. (1998) Affective-Reactivity Views. Personality and Social Psychology Bulletin, 24, 279-288.
http://dx.doi.org/10.1177/0146167298243005

[12]   Schutte N.S., Malouff, J.M. and Bhullar, N. (2009) The Assessing Emotions Scale. Assessing Emotional Intelligence. Springer, Berlin, 119-134.

[13]   Knez, I. (1995) Effects of Indoor Lighting on Mood and Cognition. Journal of Environmental Psychology, 15, 39-51.
http://dx.doi.org/10.1016/0272-4944(95)90013-6

[14]   Anderson, C.A., Deuser, W.E. and De Neve, K.M. (1995) Hot Temperatures, Hostile Affect, Hostile Cognition, and Arousal: Tests of a General Model of Affective Aggression. Personality and Social Psychology Bulletin, 21, 434-448.
http://dx.doi.org/10.1177/0146167295215002

[15]   Flynn, J.E. (1977) The Effect of Light Source Color on User Impression and Satisfaction. Journal of the Illuminating Engineering Society, 6, 167-179.

[16]   Burroughs, H.E., Hansen, I. and Shirley, J. (2011) Managing Indoor Air Quality. Fairmont Press, Lilburn, 149-151.

[17]   Jakobs, E., Manstead, A.S. and Fischer, A.H. (2001) Social Context Effects on Facial Activity in a Negative Emotional Setting. Emotion, 1, 51-69.
http://dx.doi.org/10.1037/1528-3542.1.1.51

[18]   Fridlund, A.J., Kenworthy, K.G. and Jaffey, A.K. (1992) Audience Effects in Affective Imagery: Replication and Extension to Dysphoric Imagery. Journal of Nonverbal Behavior, 16, 191-212.
http://dx.doi.org/10.1007/BF00988034

[19]   Mehrabian, A. (1996) Pleasure-Arousal-Dominance: A General Framework for Describing and Measuring Individual Differences in Temperament. Current Psychology, 14, 261-292.
http://dx.doi.org/10.1007/BF02686918

[20]   Levenson, R.W. (1988) Emotion and the Autonomic Nervous System: A Prospectus for Research on Autonomic Specificity. Social Psychophysiology and Emotion: Theory and Clinical Applications, Wiley, London, 17-42.

[21]   Philippot, P. (1993) Inducing and Assessing Differentiated Emotion-Feeling States in the Laboratory. Cognition & Emotion, 7, 171-193.
http://dx.doi.org/10.1080/02699939308409183

[22]   Gross, J.J. and Levenson, R.W. (1995) Emotion Elicitation Using Films. Cognition & Emotion, 9, 87-108.
http://dx.doi.org/10.1080/02699939508408966

[23]   Schaefer, A., Nils, F., Sanchez, X. and Philippot, P. (2010) Assessing the Effectiveness of a Large Database of Emotion-Eliciting Films: A New Tool for Emotion Researchers. Cognition and Emotion, 24, 1153-1172.
http://dx.doi.org/10.1080/02699930903274322

[24]   Davis, M.H. (1983) The Effects of Dispositional Empathy on Emotional Reactions and Helping: A Multidimensional Approach. Journal of Personality, 51, 167-184.
http://dx.doi.org/10.1111/j.1467-6494.1983.tb00860.x

[25]   Davis, M.H. (1980) A Multidimensional Approach to Individual Differences in Empathy. JSAS Catalog of Selected Documents in Psychology, 10, 85.

[26]   Schutte, N.S., Malouff, J.M., Hall, L.E., Haggerty, D.J., Cooper, J.T., Golden, C.J. and Dornheim, L. (1998) Development and Validation of a Measure of Emotional Intelligence. Personality and Individual Differences, 25, 167-177.
http://dx.doi.org/10.1016/S0191-8869(98)00001-4

[27]   Fontaine, J.R., Scherer, K.R., Roesch, E.B. and Ellsworth, P.C. (2007) The World of Emotions Is Not Two-Dimensional. Psychological Science, 18, 1050-1057.
http://dx.doi.org/10.1111/j.1467-9280.2007.02024.x

[28]   Valenzi, S., Islam, T. and Cichocki, A. (2013) Mixed Approach to Emotion Assessment. Poster Presented at Annual Meeting of the Society for Neuroscience, San Diego, 12 November 2013, 263.

[29]   Barrett, L.F., Mesquita, B., Ochsner, K.N. and Gross, J. (2007) The Experience of Emotion. Annual Review of Psychology, 58, 373-403.
http://dx.doi.org/10.1146/annurev.psych.58.110405.085709

[30]   Phillips, M.L., Drevets, W.C., Rauch, S.L. and Lane, R. (2003) Neurobiology of Emotion Perception I: The Neural Basis of Normal Emotion Perception. Biological Psychiatry, 54, 504-514.
http://dx.doi.org/10.1016/S0006-3223(03)00168-9

[31]   Coan, J.A., Allen, J.J. and Harmon Jones, E. (2001) Voluntary Facial Expression and Hemispheric Asymmetry over the Frontal Cortex. Psychophysiology, 38, 912-925.
http://dx.doi.org/10.1111/1469-8986.3860912

[32]   Tomarken, A.J., Davidson, R.J. and Henriques, J.B. (1990) Resting Frontal Brain Asymmetry Predicts Affective Responses to Films. Journal of Personality and Social Psychology, 59, 791-801.
http://dx.doi.org/10.1037/0022-3514.59.4.791

[33]   Wheeler, R.E., Davidson, R.J. and Tomarken, A.J. (1993) Frontal Brain Asymmetry and Emotional Reactivity: A Biological Substrate of Affective Style. Psychophysiology, 30, 82-89.
http://dx.doi.org/10.1111/j.1469-8986.1993.tb03207.x

[34]   Lindsley, D.B. and Wicke, J. (1974) The Electroencephalogram: Autonomous Electrical Activity in Man and Animals. Bioelectric Recording Techniques, 1, 3-83.
http://dx.doi.org/10.1016/B978-0-12-689402-8.50008-0

[35]   Russell, J.A. (1980) A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39, 1161-1178.
http://dx.doi.org/10.1037/h0077714

[36]   Ansari-Asl, K., Chanel, G. and Pun, T. (2007) A Channel Selection Method for EEG Classification in Emotion Assessment Based on Synchronization Likelihood. EUSIPCO 2007, 15th European Signal Processing Conference, Poznan, 3-7 September 2007, 1241-1245.

[37]   Rizon, M., Murugappan, M., Nagarajan, R. and Yaacob, S. (2008) Asymmetric Ratio and FCM Based Salient Channel Selection for Human Emotion Detection Using EEG. WSEAS Transactions on Signal Processing, 4, 596-603.

[38]   Khosrowabadi, R., Quek, H.C., Wahab, A. and Ang, K.K. (2010) EEG-Based Emotion Recognition Using Self-Organizing Map for Boundary Detection. 2010 20th International Conference on Pattern Recognition (ICPR), Istanbul, 23-26 August 2010, 4242-4245.

[39]   Khalili, Z. and Moradi, M.H. (2009) Emotion Recognition System Using Brain and Peripheral Signals: Using Correlation Dimension to Improve the Results of EEG. IJCNN 2009, IEEE International Joint Conference on Neural Networks, Atlanta, 14-19 June 2009, 1571-1575.

[40]   Liu, Y., Sourina, O. and Nguyen, M.K. (2010) Real-Time EEG-Based Human Emotion Recognition and Visualization. 2010 International Conference on Cyberworlds (CW), Singapore, 20-22 October 2010, 262-269.

[41]   Koski, L. and Paus, T. (2000) Functional Connectivity of the Anterior Cingulate Cortex within the Human Frontal Lobe: A Brain-Mapping Meta-Analysis. Executive Control and the Frontal Lobe: Current Issues, Springer, Berlin, 55-65.
http://dx.doi.org/10.1007/978-3-642-59794-7_7

[42]   Kringelbach, M.L. and Rolls, E.T. (2004) The Functional Neuroanatomy of the Human Orbitofrontal Cortex: Evidence from Neuroimaging and Neuropsychology. Progress in Neurobiology, 72, 341-372.
http://dx.doi.org/10.1016/j.pneurobio.2004.03.006

[43]   Ekman, P. and Friesen, W.V. (1986) A New Pan-Cultural Facial Expression of Emotion. Motivation and Emotion, 10, 159-168.
http://dx.doi.org/10.1007/BF00992253

[44]   Barrett, L.F. (1998) Discrete Emotions or Dimensions? The Role of Valence Focus and Arousal Focus. Cognition & Emotion, 12, 579-599.
http://dx.doi.org/10.1080/026999398379574

[45]   Russell, J.A. and Mehrabian, A. (1977) Evidence for a Three-Factor Theory of Emotions. Journal of Research in Personality, 11, 273-294.

 
 
Top