·AI-enabled intelligent cockpit proactive affective interaction: middle-level feature fusion dual-branch deep learning network for driver emotion recognition

Ying-Zhang Wu , Wen-Bo Li , Yu-Jing Liu , Guan-Zhong Zeng , Cheng-Mou Li , Hua-Min Jin , Shen Li , Gang Guo

Advances in Manufacturing ›› 2025, Vol. 13 ›› Issue (3) : 525 -538.

PDF
Advances in Manufacturing ›› 2025, Vol. 13 ›› Issue (3) : 525 -538. DOI: 10.1007/s40436-024-00519-8
Article
research-article

·AI-enabled intelligent cockpit proactive affective interaction: middle-level feature fusion dual-branch deep learning network for driver emotion recognition

Author information +
History +
PDF

Abstract

Advances in artificial intelligence (AI) technology are propelling the rapid development of automotive intelligent cockpits. The active perception of driver emotions significantly impacts road traffic safety. Consequently, the development of driver emotion recognition technology is crucial for ensuring driving safety in the advanced driver assistance system (ADAS) of the automotive intelligent cockpit. The ongoing advancements in AI technology offer a compelling avenue for implementing proactive affective interaction technology. This study introduced the multimodal driver emotion recognition network (MDERNet), a dual-branch deep learning network that temporally fused driver facial expression features and driving behavior features for non-contact driver emotion recognition. The proposed model was validated on publicly available datasets such as CK+, RAVDESS, DEAP, and PPB-Emo, recognizing discrete and dimensional emotions. The results indicated that the proposed model demonstrated advanced recognition performance, and ablation experiments confirmed the significance of various model components. The proposed method serves as a fundamental reference for multimodal feature fusion in driver emotion recognition and contributes to the advancement of ADAS within automotive intelligent cockpits.

Keywords

Driver emotion / Artificial intelligence (AI) / Facial expression / Driving behavior / Intelligent cockpit

Cite this article

Download citation ▾
Ying-Zhang Wu,Wen-Bo Li,Yu-Jing Liu,Guan-Zhong Zeng,Cheng-Mou Li,Hua-Min Jin,Shen Li,Gang Guo. ·AI-enabled intelligent cockpit proactive affective interaction: middle-level feature fusion dual-branch deep learning network for driver emotion recognition. Advances in Manufacturing, 2025, 13(3): 525-538 DOI:10.1007/s40436-024-00519-8

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

National Natural Science Foundation of China(52302497)

RIGHTS & PERMISSIONS

Shanghai University and Periodicals Agency of Shanghai University and Springer-Verlag GmbH Germany, part of Springer Nature

AI Summary AI Mindmap
PDF

0

Accesses

0

Citation

Detail

Sections
Recommended

AI思维导图

/