Neurocognitive Processing of Facial Emotion Recognition in Individuals With Depression and Suicidal Ideation: An Eye-Tracking and EEG Study
Qianlan Yin , Huijing Xu , Ying Zhu , Meng Liang , Qian Jiang , Bin Zhao , Taosheng Liu
Alpha Psychiatry ›› 2026, Vol. 27 ›› Issue (1) : 44992
Suicide ideation (SI) is a critical concern, and understanding its neurocognitive underpinnings is essential for improved risk assessment. This study investigates altered neurocognitive processing during face recognition in individuals with depression and SI, utilizing a multimodal approach combining eye-tracking, electroencephalography (EEG), and deconvolution modeling.
Eye-tracking and EEG data were recorded during face recognition tasks in individuals with depression, with and without SI. We analyzed visual attention patterns (fixation durations, saccadic velocities) and event-related potentials to emotional stimuli. Deconvolution analysis separated microsaccade-related activities (like regression-based event-related potential (rERP) and regression-based fixation-related potential (rFRP)).
Individuals with SI exhibited attentional biases toward emotional faces, characterized by shorter first fixation durations and faster saccadic velocities. Reduced rERP amplitudes in response to surprise and decreased rFRP amplitudes during sad conditions were also observed, suggesting altered neural responses. Integrating eye-tracking and EEG data (the area under the curve (AUC) = 0.771) improved the accuracy of detecting SI compared to eye-tracking alone (AUC = 0.643).
These findings provide novel evidence for altered neurocognitive processing of emotional faces in individuals with depression and SI. The multimodal approach highlights the potential of combining eye-tracking and EEG measures as biomarkers for identifying individuals at risk. Future research should focus on larger, more diverse samples and longitudinal designs to validate these findings and translate them into clinical applications.
suicide ideation / multimodal approach / eye-tracking / electroencephalography
| [1] |
Sobanski T, Peikert G, Kastner UW, Wagner G. Suicidal behavior-advances in clinical and neurobiological research and improvement of prevention strategies. World Journal of Psychiatry. 2022; 12: 1115–1126. https://doi.org/10.5498/wjp.v12.i9.1115. |
| [2] |
Ballard ED, Gilbert JR, Wusinich C, Zarate CA, Jr. New Methods for Assessing Rapid Changes in Suicide Risk. Frontiers in Psychiatry. 2021; 12: 598434. https://doi.org/10.3389/fpsyt.2021.598434. |
| [3] |
Woods SW, Lympus C, McGlashan TH, Walsh BC, Cannon TD. The Mini-SIPS: development of a brief clinical structured interview guide to diagnosing DSM-5 Attenuated Psychosis Syndrome and training outcomes. BMC Psychiatry. 2022; 22: 784. https://doi.org/10.1186/s12888-022-04406-z. |
| [4] |
Taschereau-Dumouchel V, Michel M, Lau H, Hofmann SG, LeDoux JE. Putting the “mental” back in “mental disorders”: a perspective from research on fear and anxiety. Molecular Psychiatry. 2022; 27: 1322–1330. https://doi.org/10.1038/s41380-021-01395-5. |
| [5] |
Amico F, Frye RE, Shannon S, Rondeau S. Resting State EEG Correlates of Suicide Ideation and Suicide Attempt. Journal of Personalized Medicine. 2023; 13: 884. https://doi.org/10.3390/jpm13060884. |
| [6] |
Price RB, Duman R. Neuroplasticity in cognitive and psychological mechanisms of depression: an integrative model. Molecular Psychiatry. 2020; 25: 530–543. https://doi.org/10.1038/s41380-019-0615-x. |
| [7] |
Quevedo K, Ng R, Scott H, Martin J, Smyda G, Keener M, et al. The neurobiology of self-face recognition in depressed adolescents with low or high suicidality. Journal of Abnormal Psychology. 2016; 125: 1185–1200. https://doi.org/10.1037/abn0000200. |
| [8] |
Bourke C, Douglas K, Porter R. Processing of facial emotion expression in major depression: a review. The Australian and New Zealand Journal of Psychiatry. 2010; 44: 681–696. https://doi.org/10.3109/00048674.2010.496359. |
| [9] |
Schaefer KL, Baumann J, Rich BA, Luckenbaugh DA, Zarate CA, Jr. Perception of facial emotion in adults with bipolar or unipolar depression and controls. Journal of Psychiatric Research. 2010; 44: 1229–1235. https://doi.org/10.1016/j.jpsychires.2010.04.024. |
| [10] |
Lin L, Wang C, Mo J, Liu Y, Liu T, Jiang Y, et al. Differences in Behavioral Inhibitory Control in Response to Angry and Happy Emotions Among College Students With and Without Suicidal Ideation: An ERP Study. Frontiers in Psychology. 2020; 11: 2191. https://doi.org/10.3389/fpsyg.2020.02191. |
| [11] |
Jaeger J, Borod JC, Peselow E. Facial expression of positive and negative emotions in patients with unipolar depression. Journal of Affective Disorders. 1986; 11: 43–50. https://doi.org/10.1016/0165-0327(86)90058-3. |
| [12] |
Jiang H, Hua L, Dai Z, Tian S, Yao Z, Lu Q, et al. Spectral fingerprints of facial affect processing bias in major depression disorder. Social Cognitive and Affective Neuroscience. 2019; 14: 1233–1242. https://doi.org/10.1093/scan/nsz096. |
| [13] |
Leyman L, De Raedt R, Schacht R, Koster EHW. Attentional biases for angry faces in unipolar depression. Psychological Medicine. 2007; 37: 393–402. https://doi.org/10.1017/S003329170600910X. |
| [14] |
Li H, Li Z, Lyu G, Wang M, Liu B, Zhang Y, et al. Suicide-relevant information processing in unipolar and bipolar depression: An eye-tracking study. Journal of Psychopathology and Clinical Science. 2023; 132: 361–371. https://doi.org/10.1037/abn0000807. |
| [15] |
Drevets WC. Neuroimaging and neuropathological studies of depression: implications for the cognitive-emotional features of mood disorders. Current Opinion in Neurobiology. 2001; 11: 240–249. https://doi.org/10.1016/s0959-4388(00)00203-8. |
| [16] |
Manelis A, Huppert TJ, Rodgers E, Swartz HA, Phillips ML. The role of the right prefrontal cortex in recognition of facial emotional expressions in depressed individuals: fNIRS study. Journal of Affective Disorders. 2019; 258: 151–158. https://doi.org/10.1016/j.jad.2019.08.006. |
| [17] |
Richard-Devantoy S, Olié E, Guillaume S, Bechara A, Courtet P, Jollant F. Distinct alterations in value-based decision-making and cognitive control in suicide attempters: toward a dual neurocognitive model. Journal of Affective Disorders. 2013; 151: 1120–1124. https://doi.org/10.1016/j.jad.2013.06.052. |
| [18] |
Jollant F, Lawrence NS, Giampietro V, Brammer MJ, Fullana MA, Drapier D, et al. Orbitofrontal cortex response to angry faces in men with histories of suicide attempts. The American Journal of Psychiatry. 2008; 165: 740–748. https://doi.org/10.1176/appi.ajp.2008.07081239. |
| [19] |
Wang Y, Guobule N, Li M, Li J. The correlation of facial emotion recognition in patients with drug-naïve depression and suicide ideation. Journal of Affective Disorders. 2021; 295: 250–254. https://doi.org/10.1016/j.jad.2021.08.051. |
| [20] |
Nikolaev AR, Pannasch S, Ito J, Belopolsky AV. Eye movement-related brain activity during perceptual and cognitive processing. Frontiers in Systems Neuroscience. 2014; 8: 62. https://doi.org/10.3389/fnsys.2014.00062. |
| [21] |
Schirmer A, Adolphs R. Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence. Trends in Cognitive Sciences. 2017; 21: 216–228. https://doi.org/10.1016/j.tics.2017.01.001. |
| [22] |
Yin Q, Xu H, Chen Z, Jiang Q, Liu T. Detection of suicide risk using event-related potentials: a comprehensive systematic review and meta-analysis. Psychoradiology. 2025; 5: kkaf018. https://doi.org/10.1093/psyrad/kkaf018. |
| [23] |
Tong Y, Zhao G, Zhao J, Xie N, Han D, Yang B, et al. Biases of Happy Faces in Face Classification Processing of Depression in Chinese Patients. Neural Plasticity. 2020; 2020: 7235734. https://doi.org/10.1155/2020/7235734. |
| [24] |
Rutter LA, Passell E, Scheuer L, Germine L. Depression severity is associated with impaired facial emotion processing in a large international sample. Journal of Affective Disorders. 2020; 275: 175–179. https://doi.org/10.1016/j.jad.2020.07.006. |
| [25] |
Alexander RG, Macknik SL, Martinez-Conde S. Microsaccades in Applied Environments: Real-World Applications of Fixational Eye Movement Measurements. Journal of Eye Movement Research . 2020; 12: 10.16910/jemr.12.6.15. https://doi.org/10.16910/jemr.12.6.15. |
| [26] |
Li M, Chen Y, Lu Z, Ding F, Hu B. ADED: Method and Device for Automatically Detecting Early Depression Using Multi-Modal Physiological Signals Evoked and Perceived via Various Emotional Scenes in Virtual Reality. IEEE Transactions on Instrumentation and Measurement. 2025. (online ahead of print) |
| [27] |
Sun Y, Duan M, An L, Liu S, Ming D. Abnormal attentional bias in individuals with suicidal ideation during an emotional Stroop task: an event-related potential study. Frontiers in Psychiatry. 2023; 14: 1118602. https://doi.org/10.3389/fpsyt.2023.1118602. |
| [28] |
Delle-Vigne D, Wang W, Kornreich C, Verbanck P, Campanella S. Emotional facial expression processing in depression: data from behavioral and event-related potential studies. Neurophysiologie Clinique = Clinical Neurophysiology. 2014; 44: 169–187. https://doi.org/10.1016/j.neucli.2014.03.003. |
| [29] |
Zhou X, Lin Z, Liu J, Xiang M, Deng X, Zou Z. The relationship between event-related potential components and suicide risk in major depressive disorder. Journal of Psychiatric Research. 2024; 175: 89–95. https://doi.org/10.1016/j.jpsychires.2024.05.014. |
| [30] |
Spiering L, Dimigen O. (Micro)saccade-related potentials during face recognition: A study combining EEG, eye-tracking, and deconvolution modeling. Attention, Perception & Psychophysics. 2025; 87: 133–154. https://doi.org/10.3758/s13414-024-02846-1. |
| [31] |
Chockboondee M, Jatupornpoonsub T, Lertsukprasert K, Wongsawat Y. Effects of daily listening to 6 Hz binaural beats over one month: an event-related potentials study. Scientific Reports. 2024; 14: 18059. https://doi.org/10.1038/s41598-024-68628-9. |
| [32] |
Porteous M, Tavakoli P, Campbell K, Dale A, Boafo A, Robillard R. Emotional Modulation of Response Inhibition in Adolescents During Acute Suicidal Crisis: Event-Related Potentials in an Emotional Go/NoGo Task. Clinical EEG and Neuroscience. 2021; 54: 451–460. https://doi.org/10.1177/15500594211063311. |
| [33] |
Xue J, Quan C, Li C, Yue J, Zhang C. A crucial temporal accuracy test of combining EEG and Tobii eye tracker. Medicine. 2017; 96: e6444. https://doi.org/10.1097/MD.0000000000006444. |
| [34] |
Tsypes A, Owens M, Gibb BE. Suicidal ideation and attentional biases in children: An eye-tracking study. Journal of Affective Disorders. 2017; 222: 133–137. https://doi.org/10.1016/j.jad.2017.07.012. |
| [35] |
von Glischinski M, von Brachel R, Hirschfeld G. How depressed is “depressed”? A systematic review and diagnostic meta-analysis of optimal cut points for the Beck Depression Inventory revised (BDI-II). Quality of Life Research: an International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation. 2019; 28: 1111–1118. https://doi.org/10.1007/s11136-018-2050-x. |
| [36] |
Upton, J. Beck Depression Inventory (BDI). Encyclopedia of Behavioral Medicine. Springer: New York, NY, USA. 2013. |
| [37] |
Beck AT, Brown GK, Steer RA. Psychometric characteristics of the Scale for Suicide Ideation with psychiatric outpatients. Behaviour Research and Therapy. 1997; 35: 1039–1046. https://doi.org/10.1016/s0005-7967(97)00073-9. |
| [38] |
Huang D, He J, Zhang R, Zhong S, Lai S, Jia Y. Sex differences in serum trace elements and minerals levels in unmedicated patients with major depressive episode: The role of suicidal ideation. Journal of Affective Disorders. 2024; 348: 26–34. https://doi.org/10.1016/j.jad.2023.12.024. |
| [39] |
Shelef L, Rabbany JM, Gutierrez PM, Kedem R, Ben Yehuda A, Mann JJ, et al. The Role of Past Suicidal Behavior on Current Suicidality: A Retrospective Study in the Israeli Military. International Journal of Environmental Research and Public Health. 2021; 18: 649. https://doi.org/10.3390/ijerph18020649. |
| [40] |
Li Y, Chen Y, Liu Y, Jiang Y, Zhao H, Wang W, et al. Longitudinal association between stigma and suicidal ideation among patients with major depressive disorder. Journal of Affective Disorders. 2025; 381: 427–435. https://doi.org/10.1016/j.jad.2025.04.036. |
| [41] |
Bai L, Ma H, Huang YX, Luo YJ. The Development of Native Chinese Affective Picture System-A pretest in 46 College Students. Chinese Mental Health Journal. 2005; 19: 719–722. https://api.semanticscholar.org/CorpusID:148057996. |
| [42] |
Dimigen O, Sommer W, Hohlfeld A, Jacobs AM, Kliegl R. Coregistration of eye movements and EEG in natural reading: analyses and review. Journal of Experimental Psychology: General. 2011; 140: 552–572. https://doi.org/10.1037/a0023885. |
| [43] |
Wang Y, Gu R, Luo YJ, Zhou C. The interaction between state and dispositional emotions in decision making: An ERP study. Biological Psychology. 2017; 123: 126–135. https://doi.org/10.1016/j.biopsycho.2016.11.009. |
| [44] |
Plöchl M, Ossandón JP, König P. Combining EEG and eye tracking: identification, characterization, and correction of eye movement artifacts in electroencephalographic data. Frontiers in Human Neuroscience. 2012; 6: 278. https://doi.org/10.3389/fnhum.2012.00278. |
| [45] |
Engbert R, Mergenthaler K. Microsaccades are triggered by low retinal image slip. Proceedings of the National Academy of Sciences of the United States of America. 2006; 103: 7192–7197. https://doi.org/10.1073/pnas.0509557103. |
| [46] |
Buonocore A, Chen CY, Tian X, Idrees S, Münch TA, Hafed ZM. Alteration of the microsaccadic velocity-amplitude main sequence relationship after visual transients: implications for models of saccade control. Journal of Neurophysiology. 2017; 117: 1894–1910. https://doi.org/10.1152/jn.00811.2016. |
| [47] |
Villena A, Tardón LJ, Barbancho I, Barbancho AM, Brattico E, Haumann NT. Preprocessing for lessening the influence of eye artifacts in EEG analysis. Applied Sciences. 2019; 9: 1757. https://doi.org/10.3390/app9091757. |
| [48] |
Smith NJ, Kutas M. Regression-based estimation of ERP waveforms: I. The rERP framework. Psychophysiology. 2015; 52: 157–168. https://doi.org/10.1111/psyp.12317. |
| [49] |
Smith NJ, Kutas M. Regression-based estimation of ERP waveforms: II. Nonlinear effects, overlap correction, and practical considerations. Psychophysiology. 2015; 52: 169–181. https://doi.org/10.1111/psyp.12320. |
| [50] |
Doruk Camsari D, Lewis CP, Sonmez AI, Ozger C, Fatih P, Yuruk D, et al. Event-Related Potential Markers of Suicidality in Adolescents. The International Journal of Neuropsychopharmacology. 2023; 26: 566–575. https://doi.org/10.1093/ijnp/pyad039. |
| [51] |
Kudinova AY, Owens M, Burkhouse KL, Barretto KM, Bonanno GA, Gibb BE. Differences in emotion modulation using cognitive reappraisal in individuals with and without suicidal ideation: An ERP study. Cognition & Emotion. 2016; 30: 999–1007. https://doi.org/10.1080/02699931.2015.1036841. |
| [52] |
Meyberg S, Sommer W, Dimigen O. How microsaccades relate to lateralized ERP components of spatial attention: A co-registration study. Neuropsychologia. 2017; 99: 64–80. https://doi.org/10.1016/j.neuropsychologia.2017.02.023. |
| [53] |
Reisenzein R, Horstmann G, Schützwohl A. The Cognitive-Evolutionary Model of Surprise: A Review of the Evidence. Topics in Cognitive Science. 2019; 11: 50–74. https://doi.org/10.1111/tops.12292. |
| [54] |
Li H, Wei S, Sun F, Wan J, Guo T. Identifying suicide attempter in major depressive disorder through machine learning: the importance of pain avoidance, event-related potential features of affective processing. Cerebral Cortex (New York, N.Y.: 1991). 2024; 34: bhae156. https://doi.org/10.1093/cercor/bhae156. |
| [55] |
Wadlinger HA, Isaacowitz DM. Fixing our focus: training attention to regulate emotion. Personality and Social Psychology Review: an Official Journal of the Society for Personality and Social Psychology, Inc. 2011; 15: 75–102. https://doi.org/10.1177/1088868310365565. |
| [56] |
Zaid SM, Hutagalung FD, Bin Abd Hamid HS, Taresh SM. Sadness regulation strategies and measurement: A scoping review. PloS One. 2021; 16: e0256088. https://doi.org/10.1371/journal.pone.0256088. |
| [57] |
Figueroa CA, DeJong H, Mocking RJT, Fox E, Rive MM, Schene AH, et al. Attentional control, rumination and recurrence of depression. Journal of Affective Disorders. 2019; 256: 364–372. https://doi.org/10.1016/j.jad.2019.05.072. |
| [58] |
Ehring T. Thinking too much: rumination and psychopathology. World Psychiatry: Official Journal of the World Psychiatric Association (WPA). 2021; 20: 441–442. https://doi.org/10.1002/wps.20910. |
| [59] |
Sui J, Zhi D, Calhoun VD. Data-driven multimodal fusion: approaches and applications in psychiatric research. Psychoradiology. 2023; 3: kkad026. https://doi.org/10.1093/psyrad/kkad026. |
| [60] |
Koshizawa R, Oki K, Takayose M. EEG Activity during Pursuit and Saccade Visual Strategies to Predict the Arrival Position of a Target. Journal of Integrative Neuroscience. 2024; 23: 108. https://doi.org/10.31083/j.jin2306108. |
| [61] |
Wang X, Pei Y, Luo Z, Zhao S, Xie L, Yan Y, et al. Fusion of Multi-domain EEG Signatures Improves Emotion Recognition. Journal of Integrative Neuroscience. 2024; 23: 18. https://doi.org/10.31083/j.jin2301018. |
Project of prevention and protection for mental health([2024]432-73)
Collaborative Research Project of Institutes(2023-TQ-LC-013)
/
| 〈 |
|
〉 |