Emotional recognition while watching emotional videos: Based on electroencephalography signal analysis and machine learning models

Abstract

Depending on the impact of emotions on a person's performance and emotional disorders that can be the main cause of many mental illnesses, as well as the desire of technology to design machines that are able to change their performance according to a person's emotional states, the study of electroencephalography (EEG) signals to analyze the different dimensions of human emotions has become increasingly significant. Based on machine learning models, this study was designed to identify the five emotions of relaxation, happiness, motivation, sadness and fear using EEG signal analysis. EEG data were collected from 23 male master's students at Tabriz University, aged 24-31, as they watched five videos designed to elicit different emotional responses. After preprocessing to remove noise and artifacts, we extracted statistical and frequency-domain features from the raw signal. The features were labeled and selected using statistical tests. In the final step, five different emotions were classified using decision tree, linear discriminant analysis (LDA), Naive Bayes, support vector machine (SVM), K-nearest neighbor (KNN), ensemble, logistic regression and neural network. It has been verified that ensemble and decision tree models had the highest accuracy with 95.38% and 91.77%.

Keywords

classification model / electroencephalography / emotion / emotional recognition / machine learning

References

[1] Harvey S, Shahwan A. Typical absence seizures in children: review with focus on EEG predictors of treatment response and outcome. Seizure. 2023; 110: 1-10.

[2] Faiman I, Smith S, Hodsoll J, Young AH, Shotbolt P. Resting-state EEG for the diagnosis of idiopathic epilepsy and psychogenic nonepileptic seizures: a systematic review. Epilepsy Behav. 2021; 121:108047.

[3] Jafari M, Shoeibi A, Khodatars M, et al. Emotion recognition in EEG signals using deep learning methods: a review. Comput Biol Med. 2023; 165:107450.

[4] Masruroh AH, Imah EM, Rahmawati E. Classification of emotional state based on EEG signal using AMGLVQ. Procedia Comput Sci. 2019; 157: 552-559.

[5] Zhang Z, Sejdić E. Radiological images and machine learning: trends, perspectives, and prospects. Comput Biol Med. 2019; 108: 354-370.

[6] Eyben F, Scherer KR, Schuller BW, et al. The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing. IEEE Trans Affect Comput. 2016; 7(2): 190-202.

[7] Chakladar DD, Chakraborty S. EEG-based emotion classification using “correlation based subset selection”. Biol Inspired Cogn Archit. 2018; 24: 98-106.

[8] Lahane P, Sangaiah AK. An approach to EEG based emotion recognition and classification using kernel density estimation. Procedia Comput Sci. 2015; 48: 574-581. doi.org/10.1016/j.procs.2015.04.138

[9] Ozel P, Akan A, Yilmaz B. Synchrosqueezing transform-based feature extraction from EEG signals for emotional state prediction. Biomed Signal Process Control. 2019; 52: 152-161.

[10] Ozdemir MA, Degirmenci M, Izci E, Akan A. EEG-based emotion recognition with deep convolutional neural networks. Biomedizinische Technik. Biomed Eng. 2021; 66(1): 43-57.

[11] Alarcao SM, Fonseca MJ. Emotions recognition using EEG signals: a survey. IEEE Trans Affect Comput. 2019; 10(3): 374-393.

[12] Kanna RK, Shoran P, Yadav M, et al. Improving EEG-based brain-computer interface emotion detection with EKO ALSTM model. Sci Rep. 2025; 15(1):20727.

[13] Pirbhulal S, Zhang H, Wu W, Mukhopadhyay SC, Zhang YT. Heart-beats based biometric random binary sequences generation to secure wireless body sensor networks. IEEE Trans Biomed Eng. 2018; 65(12): 2751-2759.

[14] Pirbhulal S, Zhang H, Mukhopadhyay SC, et al. An efficient biometric-based algorithm using heart rate variability for securing body sensor networks. Sensors. 2015; 15: 15067-15089.

[15] Wu W, Pirbhulal S, Sangaiah AK, et al. Optimization of signal quality over comfortability of textile electrodes for ECG monitoring in fog computing based medical applications. Future Gener Comput Syst. 2015; 86: 515-526.

[16] Pirbhulal S, Zhang H, E Alahi ME, et al. A novel secure IoT-based smart home automation system using a wireless sensor network. Sensors. 2016; 17(1):69.

[17] Hassan SA, Sandeep P, Marwa Q, et al. Power control algorithms for media transmission in remote healthcare systems. IEEE Access. 2018; 6: 42384-42393.

[18] Mert A, Akan A. Emotion recognition from EEG signals by using multivariate empirical mode decomposition. Pattern Anal Appl. 2018; 21(1): 81-89.

[19] Ma W, Zheng Y, Li T, Li Z, Li Y, Wang L. A comprehensive review of deep learning in EEG-based emotion recognition: classifications, trends, and practical implications. PeerJ Comput Sci. 2024; 10:e2065.

[20] Tonoyan Y, Looney D, Mandic DP, Van Hulle MM. Discriminating multiple emotional states from EEG using a data-adaptive, multiscale information-theoretic approach. Int J Neural Syst. 2016; 26(1):1650005.

[21] Alarcao A, Fonseca MJ. Emotions recognition using EEG signals: a survey. IEEE Trans Affect Comput. 2019; 10(3): 374-393.

[22] Cheng Z, Bu X, Wang Q, et al. EEG-based emotion recognition using multi-scale dynamic CNN and gated transformer. Sci Rep. 2024; 14:31319.

[23] Zhao Z, Zhang Y, Wang H. Emotion recognition using EEG differential entropy features and deep belief networks. IEEE J Biomed Health Inform. 2021; 25(4): 1243-1254.

[24] Davidson RJ, Fox NA. Asymmetrical brain activity discriminates between positive and negative affective stimuli in human infants. Science (New York, N.Y.). 1982; 218(4578): 1235-1237.

[25] Papousek I, Reiser EM, Weber B, Freudenthaler HH, Schulter G. Frontal brain asymmetry and affective flexibility in an emotional contagion paradigm. Psychophysiology. 2012; 49(4): 489-498.

[26] Yoon HJ, Chung SY. EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithm. Comput Biol Med. 2013; 43(12): 2230-2237.

[27] Wang X, Ren Y, Luo Z, He W, Hong J, Huang Y. Deep learning-based EEG emotion recognition: current trends and future perspectives. Front Psychol. 2023; 14:1126994.

[28] Jafari M, Shoeibi A, Khodatars M, et al. Emotion recognition in EEG signals using deep learning methods. Comput Biol Med. 2023; 165:107450.

[29] Liu C, Zhou X, Xiao J, et al. Variational spatial and Gaussian temporal graph models for EEG-based emotion recognition. Proc 33rd Int Joint Conf Artif Intell (IJCAI). 2024;3078-3086.

[30] Song Y, Yin Y, Xu P. A customized ECA-CRNN model for emotion recognition based on EEG signals. Electronics. 2023; 12:2900.

[31] Redwan UG, Zaman T, Mizan HB. Spatio-temporal CNN-BiLSTM dynamic approach to emotion recognition based on EEG signal. Comput Biol Med. 2025; 192(Pt A):110277.

[32] García-Ponsoda S, Maté A, Trujillo J. Refining ADHD diagnosis with EEG: the impact of preprocessing and temporal segmentation on classification accuracy. Comput Biol Med. 2024; 183:109305.

[33] Moon SE, Chen CJ, Hsieh CJ, Wang JL, Lee JS. Emotional EEG classification using connectivity features and convolutional neural networks. Neural Netw. 2020; 132: 96-107.

[34] Blum S, Jacobsen NSJ, Bleichner MG, Debener S. A Riemannian modification of artifact subspace reconstruction for EEG artifact handling. Front Hum Neurosci. 2019; 13:141.

[35] Degirmenci M, Yuce YK, Perc M, Isler Y. Statistically significant features improve binary and multiple motor imagery task predictions from EEGs. Front Hum Neurosci. 2023; 17:1223307.

[36] Singer G, Ratnovsky A, Naftali S. Classification of severity of trachea stenosis from EEG signals using ordinal decision-tree based algorithms and ensemble-based ordinal and non-ordinal algorithms. Expert Syst Appl. 2021; 173:114707.

[37] Chen D. Improved empirical mode decomposition bagging RCSP combined with Fisher discriminant method for EEG feature extraction and classification. Heliyon. 2024; 10(7):e28235.

[38] Siuly , Wang H, Zhang Y. Detection of motor imagery EEG signals employing Naïve Bayes based learning process. Measurement. 2016; 86: 148-158.

[39] Shanmugam S, Dharmar S. Implementation of a non-linear SVM classification for seizure EEG signal analysis on FPGA. Eng Appl Artif Intell. 2024; 131:107826.

[40] Bablani A, Edla DR, Dodia S. Classification of EEG data using k-nearest neighbor approach for concealed information test. Procedia Comput Sci. 2018; 143: 242-249.

[41] Nour M, Senturk U, Polat K. A novel hybrid model in the diagnosis and classification of Alzheimer's disease using EEG signals: deep ensemble learning (DEL) approach. Biomed Signal Process Control. 2024; 89:105751.

[42] Guerrero MC, Parada JS, Espitia HE. EEG signal analysis using classification techniques: logistic regression, artificial neural networks, support vector machines, and convolutional neural networks. Heliyon. 2021; 7(6):e07258.

[43] Li R, Yang X, Lou J, Zhang J. A temporal-spectral graph convolutional neural network model for EEG emotion recognition within and across subjects. Brain Inform. 2024; 11: 30.

[44] Hamzah HA, Abdalla KK. EEG-based emotion recognition systems; comprehensive study. Heliyon. 2024; 10(10):e31485.

[45] Mouazen B, Benali A, Chebchoub NT, Abdelwahed EH, De Marco G. Enhancing EEG-based emotion detection with hybrid models: insights from DEAP dataset applications. Sensors. 2025; 25(6):1827.

[46] Cheng Z, Bu X, Wang Q, Yang T, Tu J. EEG-based emotion recognition using multi-scale dynamic CNN and gated transformer. Sci Rep. 2024; 14(1):31319.

[47] Li M, Yu P, Shen Y. A spatial and temporal transformer-based EEG emotion recognition in VR environment. Front Hum Neurosci. 2025; 19:1517273.

[48] Liu R, Chao Y, Ma X, et al. ERTNet: an interpretable transformer-based framework for EEG emotion recognition. Front Neurosci. 2024; 18:1320645.

[49] Du Y, Ding H, Wu M, Chen F, Cai Z. MES-CTNet: A novel capsule transformer network base on a multi-domain feature map for electroencephalogram-based emotion recognition. Brain Sci. 2024; 14(4):344.

[50] Zhang X, Cheng X, Liu H. TPRO-NET: an EEG-based emotion recognition method reflecting subtle changes in emotion. Sci Rep. 2024; 14(1):13491.

[51] Zhu X, Liu C, Zhao L, Wang S. EEG emotion recognition network based on attention and spatiotemporal convolution. Sensors. 2024; 24:3464.

[52] Koelstra S, Muhl C, Soleymani M, et al. DEAP: a database for emotion analysis using physiological signals. IEEE Trans Affect Comput. 2012; 3(1): 18-31.

[53] Jenke R, Peer A, Buss M. Feature extraction and selection for emotion recognition from EEG. IEEE Trans Affect Comput. 2014; 5(3): 327-339.

[54] Wang Y, Nie D, Lu B. Emotional state classification from EEG data using machine learning approach. Neurocomputing. 2014; 129: 94-106.

[55] Luther L, Horschig JM, van Peer JM, Roelofs K, Jensen O, Hagenaars MA. Oscillatory brain responses to emotional stimuli are effects related to events rather than states. Front Hum Neurosci. 2022; 16:868549.

RIGHTS & PERMISSIONS

2025 The Author(s). Ibrain published by Affiliated Hospital of Zunyi Medical University (AHZMU) and Wiley-VCH GmbH.