Recent Advances in Autonomous Driving Safety
Shuguang WANG , Hongzong LI , Guanyi ZHAO
Transactions on Artificial Intelligence ›› 2026, Vol. 2 ›› Issue (1) : 161 -177.
This paper reviews recent advancements in autonomous driving safety, focusing on the evolution of autonomous driving systems from modular pipelines to end-to-end (E2E) frameworks and emerging vision-language-action (VLA) models. For modular systems, this paper analyzes how to mitigate error propagation between decoupled modules using multi-sensor redundancy and formal verification. For end- to-end systems, this paper delves into learning-based motion planning. It emphasizes safety innovations to address the lack of transparency in deep learning, such as interpretable cost maps and world-model-based simulations. For VLA models, this paper investigates integrating vision language models (VLMs) to enhance high-level semantic reasoning and understanding of long-tail driving scenarios. It discusses safety guardrail technologies, such as chain of thought (CoT) reasoning, to ensure that logic aligns with driving regulations. Finally, this paper summarizes current challenges and outlines future research directions, providing a systematic reference for building safe and reliable autonomous driving systems.
autonomous driving / safety validation / end-to-end / vision-language-action (VLA)
| [1] |
Yurtsever, E.; Lambert, J.; Carballo, A.; |
| [2] |
Shalev—Shwartz, S.; Shammah, S.; Shashua, A. On a Formal Model of Safe and Scalable Self—Driving Cars. arXiv 2017, arXiv:1708.06374. |
| [3] |
Chen, N.; Zhang, S.; Zhou, X.; |
| [4] |
Chen, N.; Qiu, T.; Zhou, X.; |
| [5] |
Raju, V.M.; Gupta, V.; Lomate, S. Performance of Open Autonomous Vehicle Platforms: Autoware and Apollo. In Proceedings of the 2019 IEEE 5th International Conference for Convergence in Technology (I2CT), Bombay, India, 29—31 March 2019; pp. 1-5. |
| [6] |
Chen, L.; Wu, P.; Chitta, K.; |
| [7] |
Wang, S.; Zhou, Q.; Wu, K.; |
| [8] |
Bojarski, M.; Del Testa, D.; Dworakowski, D.; |
| [9] |
Hu, Y.; Yang, J.; Chen, L.; |
| [10] |
Atakishiyev, S.; Salameh, M.; Yao, H.; |
| [11] |
Wang, S.; Zhou, Q.; Wu, K.; |
| [12] |
De Haan, P.; Jayaraman, D.; Levine, S. Causal Confusion in Imitation Learning. In Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada, 8—14 December 2019. |
| [13] |
Codevilla, F.; Santana, E.; López, A.M.; |
| [14] |
Luo, Y.; Zheng, J.; Chen, N.; |
| [15] |
Mao, J.; Qian, Y.; Ye, J.; |
| [16] |
Tian, X.; Gu, J.; Li, B.; |
| [17] |
Sima, C.; Renz, K.; Chitta, K.; |
| [18] |
Liu, H.; Xue, W.; Chen, Y.; |
| [19] |
Jiang, B.; Chen, S.; Liao, B.; |
| [20] |
Hu, A.; Russell, L.; Yeo, H.; |
| [21] |
Wang, X.; Zhu, Z.; Huang, G.; |
| [22] |
Kato, S.; Tokunaga, S.; Maruyama, Y.; |
| [23] |
Lang, A.H.; Vora, S.; Caesar, H.; |
| [24] |
Liu, Z.; Tang, H.; Amini, A.; |
| [25] |
Huang, Z.; Liu, H.; Lv, C. GameFormer: Game—Theoretic Modeling and Learning of Transformer—Based Interactive Prediction and Planning for Autonomous Driving. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 1—6 October 2023; pp. 3903-3913. |
| [26] |
Xin, R.; Cheng, J.; Liu, H.; |
| [27] |
Jiang, B.; Chen, S.; Xu, Q.; |
| [28] |
Yang, J.; Gao, S.; Qiu, Y.; |
| [29] |
Sun, W.; Lin, X.; Shi, Y.; |
| [30] |
Chen, L.; Li, Y.; Huang, C.; |
| [31] |
Xu, Z.; Zhang, Y.; Xie, E.; |
| [32] |
Ma, Y.; Wei, T.; Zhong, N.; |
| [33] |
Hwang, J.J.; Xu, R.; Lin, H.; |
| [34] |
Peri, N.; Dave, A.; Ramanan, D.; |
| [35] |
Dong, Y.; Kang, C.; Zhang, J.; |
| [36] |
Gu, Y.; Wang, Q.; Qin, X. Real—Time Streaming Perception System for Autonomous Driving. In Proceedings of the 2021 China Automation Congress (CAC), Beijing, China, 22—24 October 2021; pp. 5239-5244. |
| [37] |
Sakaridis, C.; Dai, D.; Van Gool, L. ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10—17 October 2021; pp. 10765-10775. |
| [38] |
Cao, Y.; Wang, N.; Xiao, C.; |
| [39] |
Tu, J.; Ren, M.; Manivasagam, S.; |
| [40] |
Trautman, P.; Krause, A. Unfreezing the Robot: Navigation in Dense, Interacting Crowds. In Proceedings of them 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18—22 October 2010; pp. 797-803. |
| [41] |
Cheng, J.; Chen, Y.; Chen, Q. Pluto: Pushing the Limit of Imitation Learning—Based Planning for Autonomous Driving. arXiv 2024, arXiv:2404.14327. |
| [42] |
Suo, S.; Regalado, S.; Casas, S.; |
| [43] |
Xie, S.; Kong, L.; Dong, Y.; |
| [44] |
NVIDIA; Wang, Y.; Luo, W.; |
| [45] |
Sun, P.; Kretzschmar, H.; Dotiwalla, X.; |
| [46] |
Caesar, H.; Bankiti, V.; Lang, A.H.; |
| [47] |
Zhong, Z.; Rempe, D.; Chen, Y.; |
| [48] |
Sun, C.; Zhang, R.; Lu, Y.; |
| [49] |
Teng, S.; Hu, X.; Deng, P.; |
| [50] |
Jiang, S.; Huang, Z.; Qian, K.; |
| [51] |
Yang, Z.; Jia, X.; Li, H.; |
| [52] |
Bai, X.; Hu, Z.; Zhu, X.; |
| [53] |
Ge, C.; Chen, J.; Xie, E.; |
| [54] |
Gal, Y.; Ghahramani, Z. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. In Proceedings of The 33rd International Conference on Machine Learning, New York, NY, USA, 20—22 June 2016; pp. 1050-1059. |
| [55] |
Lakshminarayanan, B.; Pritzel, A.; Blundell, C. Simple and Scalable Predictive Uncertainty Estimation Using Deep Ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems, Red Hook, NY, USA, 4—9 December 2017; pp. 6405-6416. |
| [56] |
Miller, D.; Nicholson, L.; Dayoub, F.; |
| [57] |
Sensoy, M.; Kaplan, L.; Kandemir, M. Evidential Deep Learning to Quantify Classification Uncertainty. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montréal, QC, Canada, 3—8 December 2018; pp. 3183-3193. |
| [58] |
Amini, A.; Schwarting, W.; Soleimany, A.; |
| [59] |
Guo, C.; Pleiss, G.; Sun, Y.; |
| [60] |
Xie, S.; Kong, L.; Zhang, W.; |
| [61] |
Philion, J.; Fidler, S. Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D. In Proceedings of the 16th European Conference, Glasgow, UK, 23—28 August 2020; pp. 194-210. |
| [62] |
Ivanovic, B.; Pavone, M. The Trajectron: Probabilistic Multi—Agent Trajectory Modeling with Dynamic Spatiotemporal Graphs. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea, 27 October—2 November 2019; pp. 2375-2384. |
| [63] |
Reading, C.; Harakeh, A.; Chae, J.; |
| [64] |
Hecker, S.; Dai, D.; Van Gool, L. End—to—End Learning of Driving Models with Surround—View Cameras and Route Planners. In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 8—14 September 2018; pp. 435-453. |
| [65] |
Ishihara, K.; Kanervisto, A.; Miura, J.; |
| [66] |
Hu, S.; Chen, L.; Wu, P.; |
| [67] |
Ren, X.; Yang, T.; Li, L.E.; |
| [68] |
Zablocki, É.; Ben—Younes, H.; Pérez, P.; |
| [69] |
Cultrera, L.; Seidenari, L.; Becattini, F.; |
| [70] |
Kim, J.; Rohrbach, A.; Darrell, T.; |
| [71] |
Sadat, A.; Casas, S.; Ren, M.; |
| [72] |
Chen, D.; Zhou, B.; Koltun, V.; |
| [73] |
Zeng, W.; Luo, W.; Suo, S.; |
| [74] |
Altman, E. Constrained Markov Decision Processes ; Routledge: Oxfordshire, UK, 2021. |
| [75] |
Achiam, J.; Held, D.; Tamar, A.; |
| [76] |
Tessler, C.; Mankowitz, D.J.; Mannor, S. Reward Constrained Policy Optimization. arXiv 2018, arXiv:1805.11074. |
| [77] |
Isele, D.; Nakhaei, A.; Fujimura, K. Safe Reinforcement Learning on Autonomous Vehicles. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1—5 October 2018; pp. 1-6. |
| [78] |
Alshiekh, M.; Bloem, R.; Ehlers, R.; |
| [79] |
Cheng, R.; Orosz, G.; Murray, R.M.; |
| [80] |
Goodfellow, I.J.; Shlens, J.; Szegedy, C. Explaining and Harnessing Adversarial Examples. arXiv 2014, arXiv:1412.6572. |
| [81] |
Eykholt, K.; Evtimov, I.; Fernandes, E.; |
| [82] |
Madry, A.; Makelov, A.; Schmidt, L.; |
| [83] |
Tobin, J.; Fong, R.; Ray, A.; |
| [84] |
Zhou, Z.; Cai, T.; Zhao, S.Z.; |
| [85] |
Wang, D.; Shelhamer, E.; Liu, S.; |
| [86] |
Hendrycks, D.; Gimpel, K. A Baseline for Detecting Misclassified and Out—of—Distribution Examples in Neural Networks. arXiv 2016, arXiv:1610.02136. |
| [87] |
Li, Y.; Du, Y.; Zhou, K.; |
| [88] |
Lewis, P.; Perez, E.; Piktus, A.; |
| [89] |
Liu, F.; Lin, K.; Li, L.; |
| [90] |
Wei, J.; Wang, X.; Schuurmans, D.; |
| [91] |
Mao, J.; Ye, J.; Qian, Y.; |
| [92] |
Peng, Q.; Chen, X.; Yang, C.; |
| [93] |
Turpin, M.; Michael, J.; Perez, E.; |
| [94] |
Ouyang, L.; Wu, J.; Jiang, X.; |
| [95] |
Lu, Y.; Tu, J.; Ma, Y.; |
| [96] |
Li, Y.; Javanmardi, E.; Thompson, S.; |
| [97] |
Fu, H.; Zhang, D.; Zhao, Z.; |
/
| 〈 |
|
〉 |