Stand Still and Die: Integrating Multi-Stakeholder Communication to Bring Fairness Back to the Autonomous Vehicle Trolley Problem

Abstract

While rare, it is widely accepted that autonomous vehicles (AVs) will find themselves in dilemma scenarios involving vulnerable road users (VRUs). The ethics of these dilemma situations have been debated extensively in the context of trolley-problem-like scenarios. What has not been noted is the inherent unfairness implicit in many of these discussions, in which VRUs are seen as passive bystanders with no say in what befalls them. Rather than simply remaining still in a collision scenario, VRUs can (and often do) take action that needs to be accounted for. If we are to increase fairness on public roads, it is important that AVs communicate with VRUs. This paper presents a highly theoretical discussion on the possibility of using communication tools (such as the V2X system) and techniques (derived from the science of human-machine interaction) to support protective, risk-reducing responses from VRUs during inevitable AV collisions. The paper begins with a brief ethical exploration of fairness in the context of current debates surrounding AV collisions. We proceed to discuss possible technical solutions to AV-VRU communication, as well as the types of audio, visual, and tactile communication strategies necessary in critical scenarios.

Keywords

Autonomous vehicles / Trolley problems / Human value / Fairness / AV communication / Human-machine interaction

References

[1] Floridi L, Cowls J, Beltrametti M, Chatila R, Chazerand P, Dignum MV, et al. AI4People—An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations. Minds Mach. J. Artif. Intell. Philos. Cogn. Sci. 2018, 28, 689-707. DOI: 10.1007/s11023—018—9482—5

[2] Bertoncello M, Wee D. Ten Ways Autonomous Driving Could Redefine the Automotive World. McKinsey & Company. 2015. Available online: https://www.mckinsey.com/industries/automotive—and—assembly/our—insights/ten—ways—autonomous—driving—could—redefine—the—automotive—world (accessed on 22 August 2023).

[3] Etienne H. The Dark Side of the “Moral Machine” and the Fallacy of Computational Ethical Decision—making for Autonomous Vehicles. Law Innov. Technol. 2021, 13, 85-107. DOI: 10.1080/17579961.2021.1898310

[4] Faverio M. Older Americans More Wary Than Younger Adults About Prospect of Driverless Cars on the Road. Pew Research Centre. 24 October 2022. Available online: https://www.pewresearch.org/short—reads/2022/10/24/older—americans—more—wary—than—younger—adults—about—prospect—of—driverless—cars—on—the—road/ (accessed on 17 August 2023).

[5] Rainie L, Funk C, Anderson M, Tyson A. AI and Human Enhancement: Americans’ Openness Is Tempered by a Range of Concerns. Pew Research Center. 2022. Available online: https://www.pewresearch.org/internet/2022/03/17/americans—cautious—about—the—deployment—of—driverless—cars/ (accessed on 17 August 2023).

[6] Smith A, Anderson M. Automation in Everyday Life ; Pew Research Center: Washington, DC, USA, 2017.

[7] Rowthorn M. How should autonomous vehicles make moral decisions? Machine ethics, artificial driving intelligence, and crash algorithms. Contemp. Read. Law Soc. Justice 2019, 11, 9-14. DOI: 10.22381/CRLSJ11120191

[8] Gross A. Consumer Skepticism Toward Autonomous Driving Features Justified. AAA Newsroom. 12 May 2022. Available online: https://newsroom.aaa.com/2022/05/consumer—skepticism—toward—active—driving—features—justified/ (accessed on 14 August 2023).

[9] Gill T. Ethical Dilemmas are Really Important to Potential Adopters of Autonomous Vehicles. Ethics Inf. Technol. 2021, 23, 657-673. DOI: 10.1007/s10676—021—09605—y

[10] Liljamo T, Liimatainen H, Pöllänen M. Attitudes and concerns on automated vehicles. Transp. Res. Part F Traffic Psychol. Behav. 2018, 59, 24-44. DOI: 10.1016/j.trf.2018.08.010

[11] Andrade JA. The ethics of the ethics of autonomous vehicles: Levinas and naked streets. South. Afr. J. Philos. 2021, 40, 124-136. DOI: 10.1080/02580136.2021.1933725

[12] Wang Y, Hu X, Yang L, Huang Z. Ethics dilemmas and autonomous vehicles: Ethics preference modelling and implementation of personal ethics setting for autonomous vehicles in dilemmas. IEEE Intell. Transp. Syst. Mag. 2023, 15, 177-189. DOI: 10.1109/MITS.2022.3197689

[13] Luchian E. Tesla Crashes Into Oncoming Car, Saves the Life of a Pedestrian. Autoevolution. 15 October 2024. Available online: https://www.autoevolution.com/news/tesla—veers—to—avoid—pedestrian—who—fell—right—in—front—of—it—crashes—into—oncoming—car—241294.html (accessed on 4 February 2025).

[14] Davnall R. The car’s choice: Illusions of agency in the self—driving car trolley problem. In Artificial Intelligence ; Brill Mentis: Leiden, The Netherlands, 2020; pp. 189-202. DOI: 10.30965/9783957437488_013

[15] Hansson SO, Belin M—Å, Lundgren B. Self—driving vehicles—An ethical overview. Philos. Technol. 2021, 34, 1383-1408. DOI: 10.1007/s13347—021—00464—5

[16] Evans K, de Moura N, Chauvier S, Chatila R, Dogan E. Ethical Decision Making in Autonomous Vehicles: The AV Ethics Project. Sci. Eng. Ethics 2020, 26, 3285-3312. DOI: 10.1007/s11948—020—00272—8

[17] Cunneen M, Mullins M, Murphy F, Shannon D, Furxhi I, Ryan C. Autonomous vehicles and avoiding the trolley (dilemma): Vehicle perception, classification, and the challenges of framing decision ethics. Cybern. Syst. 2020, 51, 59-80. DOI: 10.1080/01969722.2019.1660541

[18] Resnik DB, Andrews SL. A precautionary approach to autonomous vehicles. AI Ethics 2024, 4, 403-418. DOI: 10.1007/s43681—023—00277—6

[19] Hedges & Company. How Many Cars Are There in the World in 2023? 2023. Available online: https://hedgescompany.com/blog/2021/06/how—many—cars—are—there—in—the—world/ (accessed on 10 November 2023).

[20] Odyssee—Mure. Change in Distance Travelled by Car. 2021. Available online: https://www.odyssee—mure.eu/publications/efficiency—by—sector/transport/distance—travelled—by—car.html (accessed on 10 November 2023).

[21] WHO. Global Status Report on Road Safety 2018 ; World Health Organization: Geneva, Switzerland, 2018. Available online: https://www.who.int/publications—detail—redirect/9789241565684 (accessed on 17 August 2023).

[22] Fleetwood J. Public health, ethics, and autonomous vehicles. Am. J. Public Health 2017, 107, 532-537. DOI: 10.2105/AJPH.2016.303628

[23] Nyholm S, Smids J. The Ethics of Accident—Algorithms for Self—Driving Cars: An Applied Trolley Problem? Ethical Theory Moral Pract. 2016, 19, 1275-1289. DOI: 10.1007/s10677—016—9745—2

[24] JafariNaimi N. Our Bodies in the Trolley’s Path, or Why Self—driving Cars Must *Not* Be Programmed to Kill. Sci. Technol. Hum. Values 2018, 43, 302-323. DOI: 10.1177/0162243917718942

[25] Martinho A, Herber N, Kroesen M, Chorus C. Ethical issues in focus by the autonomous vehicles industry. Transp. Rev. 2021, 41, 556-577. DOI: 10.1080/01441647.2020.1862355

[26] Robinson J, Smyth J, Woodman R, Donzella V. Ethical Considerations and Moral Implications of Autonomous Vehicles and Unavoidable Collisions. Theor. Issues Ergon. Sci. 2022, 23, 435-452. DOI: 10.1080/1463922X.2021.1978013

[27] Foot P. The Problem of Abortion and the Doctrine of Double Effect. Oxf. Rev. 1967, 5, 5-15. Available online: https://philpapers.org/archive/FOOTPO—2.pdf (accessed on 10 November 2023).

[28] Bergmann LT, Schlicht L, Meixner C, König P, Pipa G, Boshammer S, et al. Autonomous vehicles require socio—political acceptance—An empirical and philosophical perspective on the problem of moral decision making. Front. Behav. Neurosci. 2018, 12, 31. DOI: 10.3389/fnbeh.2018.00031

[29] Shah MU, Rehman U, Iqbal F, Hussain M, Wahid F. An alternate account on the ethical implications of autonomous vehicles. In Proceedings of the 2021 17th International Conference on Intelligent Environments (IE), Dubai, United Arab Emirates, 21—24 June 2021; pp. 1-5.

[30] Altay BC, Boztas AE, Okumuş A, Gul M, Çelik E. How will autonomous vehicles decide in case of an accident? An interval type—2 fuzzy best—worst method for weighting the criteria from moral values point of view. Sustainability 2023, 15, 8916. DOI: 10.3390/su15118916

[31] Awad E, Dsouza S, Kim R, Schulz J, Henrich J, Shariff A, et al. The Moral Machine Experiment. Nature 2018, 563, 59-64. DOI: 10.1038/s41586—018—0637—6

[32] Millan—Blanquel L, Veres SM, Purshouse RC. Ethical considerations for a decision making system for autonomous vehicles during an inevitable collision. In Proceedings of the 2020 28th Mediterranean Conference on Control and Automation (MED), Saint—Raphaël, France, 15—18 September 2020; pp. 514-519.

[33] Wang H, Huang Y, Khajepour A, Cao D, Lv C. Ethical decision—making platform in autonomous vehicles with lexicographic optimization based model predictive controller. IEEE Trans. Veh. Technol. 2020, 69, 8164-8175. DOI: 10.1109/TVT.2020.2996954

[34] Geisslinger M, Poszler F, Lienkamp M. An ethical trajectory planning algorithm for autonomous vehicles. Nat. Mach. Intell. 2023, 5, 137-144. DOI: 10.1038/s42256—022—00607—z

[35] Technical University of Munich. Autonomous Driving: New Algorithm Distributes Risk Fairly. 2022. Available online: https://www.tum.de/en/news—and—events/all—news/press—releases/details/autonomes—fahren—neuer—algorithmus—verteilt—risiken—fair (accessed on 10 November 2023).

[36] Sylvester J, Raff E. Trimming the thorns of AI fairness research. IEEE Data Eng. Bull. 2020, 43, 74-84. Available online: http://sites.computer.org/debull/A20dec/A20DEC—CD.pdf#page=76 (accessed on 20 September 2023).

[37] Hübner D, White L. Crash Algorithms for Autonomous Cars: How the Trolley Problem Can Move Us Beyond Harm Minimisation. Ethical Theory Moral. Pract. 2018, 21, 685-698. DOI: 10.1007/s10677—018—9910—x

[38] Liu H—Y. Irresponsibilities, inequalities and injustice for autonomous vehicles. Ethics Inf. Technol. 2017, 19, 193-207. DOI: 10.1007/s10676—017—9436—2

[39] Beauchamp TL, Childress JF. Principles of Biomedical Ethics , 7th ed.; Oxford University Press: New York, NY, USA, 2013.

[40] de Melo CM, Marsella S, Gratch J. Increasing fairness by delegating decisions to autonomous agents. In Proceedings of the 16th Conference on Autonomous Agents and Multiagent Systems, Sao Paulo, Brazil, 8—12 May 2017; pp. 419-425.

[41] Sidorenko G, Thunberg J, Vinel A. Ethical V2X: Cooperative driving as the only ethical path to multi—vehicle safety. In Proceedings of the 2023 IEEE 98th Vehicular Technology Conference (VTC2023—Fall), Hong Kong, China, 10—13 October 2023; pp. 1-6. DOI: 10.1109/VTC2023—Fall60731.2023.10333432

[42] Flores Comeca L, Masarykova N, Halinkovic M, Galinski M, Laskov P, Vinel A. Social Robots for Road Safety: Pedestrian Crossing Assistance Use—Case. In Proceedings of the 2025 International Symposium ELMAR, Zadar, Croatia, 2025; pp. 53-56. DOI: 10.1109/ELMAR66948.2025.11193979

[43] Comeca ALF, Masarykova N, Halinkovic M, Galinski M, Laskov P, Vinel A. Robots for Safer Pedestrian Crossing on Two—Lane Roads. In Proceedings of the 2025 IEEE International Automated Vehicle Validation Conference (IAVVC), Baden—Baden, Germany, 2025; pp. 1-6. DOI: 10.1109/IAVVC61942.2025.11219514

[44] Morold M, Bachmann M, David K. Toward context awareness for cooperative vulnerable road user collision avoidance: Incorporating related contextual information. IEEE Veh. Technol. Mag. 2022, 17, 75-83. DOI: 10.1109/MVT.2022.3173075

[45] Molina OA, Ronelöv E, Boustedt K, Blidkvist J, Vinel A. Protection of vulnerable road users using hybrid vehicular networks. In Proceedings of the 2022 IEEE International Conference on Vehicular Electronics and Safety (ICVES), Bogota, Colombia, 14—16 November 2022; pp. 1-6. DOI: 10.1109/ICVES56941.2022.9986886

[46] Shah G, Zaman M, Saifuddin M, Toghi B, Fallah Y. Scalable Cellular V2X Solutions: Large—Scale Deployment Challenges of Connected Vehicle Safety Networks. Automot. Innov. 2024, 7, 373-382. DOI: 10.1007/s42154—023—00277—6

[47] Delooz Q, Willecke A, Garlichs K, Hagau A—C, Wolf L, Vinel A, et al. Analysis and evaluation of information redundancy mitigation for V2X collective perception. IEEE Access 2022, 10, 47076-47093. DOI: 10.1109/ACCESS.2022.3170029

[48] El Jouhri A, El Sharkawy A, Paksoy H, Youssif O, He X, Kim S, et al. The influence of a color themed HMI on trust and take—over performance in automated vehicles. Front. Psychol. 2023, 14, 1128285. DOI: 10.3389/fpsyg.2023.1128285

[49] Hill RA, Barton RA. Red enhances human performance in contests. Nature 2005, 435, 293— 293. DOI: 10.1038/435293a

[50] Friedrich M, Vollrath M. Urgency—based color coding to support visual search in displays for supervisory control of multiple unmanned aircraft systems. Displays 2022, 74, 102185. DOI: 10.1016/j.displa.2022.102185

[51] Silic M. Understanding colour impact on warning messages: Evidence from US and India. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, New York, NY, USA, 7—12 May 2016; pp. 2954-2960. DOI: 10.1145/2851581.2892276

[52] Bazilinskyy P, Dodou D, De Winter J. External human—machine interfaces: Which of 729 colors is best for signaling ‘please (do not) cross’? In Proceedings of the 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Toronto, ON, Canada, 11—14 October 2020; pp. 3721-3728. DOI: 10.1109/SMC42975.2020.9282998

[53] Dey D, Habibovic A, Pfleging B, Martens M, Terken J. Color and animation preferences for a light band eHMI in interactions between automated vehicles and pedestrians. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25—30 April 2020; pp. 1-13. DOI: 10.1145/3313831.3376325

[54] Braun CC, Silver NC. Interaction of signal word and colour on warning labels: Differences in perceived hazard and behavioural compliance. Ergonomics 1995, 38, 2207-2220. DOI: 10.1080/00140139508925263

[55] Wolfe JM. Guided search 6.0: An updated model of visual search. Psychon. Bull. Rev. 2021, 28, 1060-1092. DOI: 10.3758/s13423—020—01859—9

[56] Shen Z, Zhang L, Li R, Hou J, Liu C, Hu W. The effects of color combinations, luminance contrast, and area ratio on icon visual search performance. Displays 2021, 67, 101999. DOI: 10.1016/j.displa.2021.101999

[57] Young SL. Increasing the noticeability of warnings: Effects of pictorial, color, signal icon and border. Proc. Hum. Factors Soc. Annu. Meet. 1991, 35, 580-584. DOI: 10.1518/107118191786754662

[58] Suk H, Irtel H. Emotional response to color across media. Color Res. Appl. 2010, 35, 64-77. DOI: 10.1002/col.20554

[59] Ackermann C, Beggiato M, Schubert S, Krems JF. An experimental study to investigate design and assessment criteria: What is important for communication between pedestrians and automated vehicles? Appl. Ergon. 2019, 75, 272-282. DOI: 10.1016/j.apergo.2018.11.002

[60] Eisma YB, Reiff A, Kooijman L, Dodou D, De Winter JCF. External human—machine interfaces: Effects of message perspective. Transp. Res. Part F Traffic Psychol. Behav. 2021, 78, 30-41. DOI: 10.1016/j.trf.2021.01.010

[61] Tabone W, de Winter J, Ackermann C, Bärgman J, Baumann M, Deb S, et al. Vulnerable road users and the coming wave of automated vehicles: Expert perspectives. Transp. Res. Interdiscip. Perspect. 2021, 9, 100293. DOI: 10.1016/j.trip.2020.100293

[62] Mehrotra S, Wang M, Wong N, Parker JI, Roberts SC, Kim W, et al. Human—machine interfaces and vehicle automation: A review of the literature. Accid. Anal. Prev. 2022, 109, 18-28. Available online: https://aaafoundation.org/wp—content/uploads/2026/01/HMI—and—Automation—Design—Recommendations.pdf (accessed on 5 April 2026).

[63] Löcken A, Wintersberger P, Frison A—K, Riener A. Investigating user requirements for communication between automated vehicles and vulnerable road users. In Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France, 9—12 June 2019; pp. 879-884. DOI: 10.1109/IVS.2019.8814027

[64] De Winter J, Dodou D. External human—machine interfaces: Gimmick or necessity? Transp. Res. Interdiscip. Perspect. 2022, 15, 100643. DOI: 10.1016/j.trip.2022.100643

[65] Verma H, Pythoud G, Eden G, Lalanne D, Evéquoz F. Pedestrians and visual signs of intent: Towards expressive autonomous passenger shuttles. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2019, 3, 1-31. DOI: 10.1145/3351265

[66] Tran TTM, Parker C, Wang Y, Tomitsch M. Designing wearable augmented reality concepts to support scalability in autonomous vehicle—pedestrian interaction. Front. Comput. Sci. 2022, 4, 866516. DOI: 10.3389/fcomp.2022.866516

[67] Tabone W, Happee R, García J, Lee YM, Lupetti ML, Merat N, et al. Augmented reality interfaces for pedestrian—vehicle interactions: An online study. Transp. Res. Part F Traffic Psychol. Behav. 2023, 94, 170-189. DOI: 10.1016/j.trf.2023.02.005

[68] Tong Y, Jia B, Bao S. An augmented warning system for pedestrians: User interface design and algorithm development. Appl. Sci. 2021, 11, 7197. DOI: 10.3390/app11167197

[69] Deb S, Strawderman LJ, Carruth DW. Investigating pedestrian suggestions for external features on fully autonomous vehicles: A virtual reality experiment. Transp. Res. Part F Traffic Psychol. Behav. 2018, 59, 135-149. DOI: 10.1016/j.trf.2018.08.016

[70] Mahadevan K, Somanath S, Sharlin E. Communicating awareness and intent in autonomous vehicle—pedestrian interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21—26 April 2018; pp. 1-12. DOI: 10.1145/3173574.3174003

[71] Ulfvengren P. Design of natural warning sounds. In Proceedings of the 13th International Conference on Auditory Display, Montreal, QC, Canada, 26—29 June 2007.

[72] Fagerlönn J, Alm H. Auditory signs to support traffic awareness. IET Intell. Transp. Syst. 2010, 4, 262. DOI: 10.1049/iet—its.2009.0144

[73] Seebold P, Nam CS, He Y. Looming sounds as auditory warnings: Uses for enhancing visual contrast sensitivity? Proc. Hum. Factors Ergon. Soc. Annu. Meet. 2023, 67, 908-913. DOI: 10.1177/21695067231192411

[74] Waltrip MJ, Baldwin CL. Scalable auditory alarms. In Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018) ; Bagnara S, Tartaglia R, Albolino S, Alexander T, Fujita Y, Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 54-58. DOI: 10.1007/978—3—319—96059—3_6

[75] Murata A, Kuroda T. Effects of auditory and tactile warning on drivers’ response to hazard under noisy environment. In Engineering Psychology and Cognitive Ergonomics; Harris D, Ed.; Springer International Publishing: Cham, Switzerland, 2015; pp. 45-53. DOI: 10.1007/978—3—319—20373—7_5

[76] Politis I, Brewster S, Pollick F. Speech tactons improve speech warnings for drivers. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Seattle, WA, USA, 17—19 September 2014; pp. 1-8. DOI: 10.1145/2667317.2667318

[77] Matviienko A, Ananthanarayan S, Borojeni SS, Feld Y, Heuten W, Boll S. Augmenting bicycles and helmets with multimodal warnings for children. In Proceedings of the 20th International Conference on Human—Computer Interaction with Mobile Devices and Services, Barcelona, Spain, 3—6 September 2018; pp. 1-13. DOI: 10.1145/3229434.3229479

[78] Cockpit Warning Systems. 5 April 1997. Available online: https://www.aopa.org/news—and—media/all—news/1997/april/pilot/cockpit—warning—systems (accessed on 5 February 2025).

[79] Yun H, Yang JH. Multimodal warning design for take—over request in conditionally automated driving. Eur. Transp. Res. Rev. 2020, 12, 34. DOI: 10.1186/s12544—020—00427—5

[80] Geitner C, Biondi F, Skrypchuk L, Jennings P, Birrell S. The comparison of auditory, tactile, and multimodal warnings for the effective communication of unexpected events during an automated driving scenario. Transp. Res. Part F Traffic Psychol. Behav. 2019, 65, 23-33. DOI: 10.1016/j.trf.2019.06.011

[81] Kabil A, Rabieh K, Kaleem F, Azer MA. Vehicle to pedestrian systems: Survey, challenges and recent trends. IEEE Access 2022, 10, 123981-123994. DOI: 10.1109/ACCESS.2022.3224772

[82] Milford SR, Laxton V, Vinel A. Integrating multi—stakeholder communication into autonomous vehicle trolley problem. In Proceedings of the 2024 20th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), Paris, France, 21—23 October 2024; pp. 68-73. DOI: 10.1109/WiMob61911.2024.10770323