Exploring the role of ChatGPT in decision making for gender-affirming surgery

Abstract

Aim: Large language models (LLMs) like ChatGPT have transformed access to health information. For transgender individuals considering gender-affirming surgery (GAS), accurate and reliable information is essential for informed decision making. This study aimed to quantitatively assess the use of ChatGPT among individuals considering GAS and its impact on their decision-making process.

Methods: A cross-sectional survey was conducted in January 2024 on Prolific. Participants included English-speaking U.S. users over 18 whose current gender differed from their assigned gender at birth. The survey collected demographic information, evaluated interest in GAS, and examined interactions with ChatGPT. Descriptive statistics were used for analysis.

Results: The study included 207 participants (average age 30.2 years), primarily identifying as non-binary (40.6%), transgender men (29.5%), and transgender women (13%). Most expressed interest in GAS (89%). Primary information sources for GAS were online forums (24.6%), medical websites (21.3%), and social media (17.4%). While many had used ChatGPT (73%), few utilized it for GAS information (6.7%). Among those who did, the majority (70%) rated its usefulness as moderate to slight, with some reporting a positive influence on their decision making (40%). Trust in ChatGPT’s information was moderate to highly rated by 80% of participants.

Conclusions: In our cohort, ChatGPT is less commonly used for GAS information than online forums and medical websites. This suggests that patients prefer platforms that offer visual content, human interaction, and relatability. These findings highlight the importance of guiding patients toward reliable health information sources, such as healthcare providers, reputable medical websites, and academic literature, to support informed decision making.

Keywords

ChatGPT / gender-affirming surgery / decision making / transgender health / health information sources

References

[1] Van Veen D,Blankemeier L.Adapted large language models can outperform medical experts in clinical text summarization.Nat Med2024;30:1134-42 PMCID:PMC11479659

[2] Gilson A,Huang T.How does ChatGPT perform on the United States Medical Licensing Examination (USMLE)? The implications of large language models for medical education and knowledge assessment.JMIR Med Educ2023;9:e45312 PMCID:PMC9947764

[3] Denecke K, May R, Rivera Romero O; LLMHealthGroup. Potential of large language models in health care: delphi study. J Med Int Res. 2024;26:e52399. PMCID:PMC11130776

[4] Clusmann J,Muti HS.The future landscape of large language models in medicine.Commun Med2023;3:141 PMCID:PMC10564921

[5] Karabacak M.Embracing large language models for medical applications: opportunities and challenges.Cureus2023;15:e39305 PMCID:PMC10292051

[6] Liu J,Liu S.Utility of ChatGPT in clinical practice.J Med Int Res2023;25:e48568 PMCID:PMC10365580

[7] Amin K,Forman HP.Large language models as a source of health information: are they patient-centered? A longitudinal analysis.Healthc2024;12:100731

[8] Wright JD,Suzuki Y,Hershman DL.National estimates of gender-affirming surgery in the US.JAMA Netw Open2023;6:e2330348 PMCID:PMC10448302

[9] Hirpara MM,Aloyan T,Lewis P.Does the internet provide quality information on metoidioplasty? Using the modified ensuring quality information for patients tool to evaluate artificial intelligence-generated and online information on metoidioplasty.Ann Plast Surg2024;92:S361-5

[10] Berry CE,Churukian AA.Quality assessment of online resources for gender-affirming surgery.Plast Reconstr Surg Glob Open2023;11:e5306 PMCID:PMC10561794

[11] Vargas CR,Lee M,Medalie DA.The accessibility, readability, and quality of online resources for gender affirming surgery.J Surg Res2017;217:198-206

[12] Kalam KT,Islam MR.ChatGPT and mental health: friends or foes?.Health Sci Rep2024;7:e1912 PMCID:PMC10867692

[13] Gerritse K,Bremmer MA,Molewijk BC.Decision-making approaches in transgender healthcare: conceptual analysis and ethical implications.Med Health Care Philos2021;24:687-99 PMCID:PMC8557156

[14] Lambert A,Conard LAE.Supporting gender-related medical decision making for transgender and gender-diverse individuals: a scoping review.Transgend Health2023;8:113-23 PMCID:PMC10066778

[15] Song H,Luo Z.Evaluating the performance of different large language models on health consultation and patient education in urolithiasis.J Med Syst2023;47:125

[16] Entwistle VA,Wyke S.How information about other people’s personal experiences can help with healthcare decision-making: a qualitative study.Patient Educ Couns2011;85:e291-8

[17] Bussey LG.The role of internet resources in health decision-making: a qualitative study.Digit Health2019;5:2055207619888073 PMCID:PMC6843735

[18] Wilhelm TI,Kaczmarczyk R.Large language models for therapy recommendations across 3 clinical specialties: comparative study.J Med Internet Res2023;25:e49324 PMCID:PMC10644179

[19] Anibal J,Gunkel J,Wood B.Simulated misuse of large language models and clinical credit systems. medRxiv 2024.

[20] Pushpanathan K,Er Yew SM.Popular large language model chatbots’ accuracy, comprehensiveness, and self-awareness in answering ocular symptom queries.iScience2023;26:108163 PMCID:PMC10616302

[21] Davis R,Ayo-Ajibola O.Evaluating the effectiveness of artificial intelligence-powered large language models application in disseminating appropriate and readable health information in urology.J Urol2023;210:688-94

[22] Stroop A,Zawy Alsofy S.Large language models: are artificial intelligence-based chatbots a reliable source of patient information for spinal surgery?.Eur Spine J2024;33:4135-43

[23] Bhatt N,Gentile JP.Gender-affirming care for transgender patients. 2022;19:23-32. PMCID:PMC9341318

[24] Kraschel KL,Turban JL.Legislation restricting gender-affirming care for transgender youth: politics eclipse healthcare.Cell Rep Med2022;3:100719 PMCID:PMC9418844

[25] Pastor Bravo MDM, Linander I. Access to healthcare among transgender and non-binary youth in Sweden and Spain: a qualitative analysis and comparison.PLoS One2024;19:e0303339 PMCID:PMC11093328