The use of generative artificial intelligence in surgical education: a narrative review

Abstract

The introduction of generative artificial intelligence (AI) has revolutionized healthcare and education. These AI systems, trained on vast datasets using advanced machine learning (ML) techniques and large language models (LLMs), can generate text, images, and videos, offering new avenues for enhancing surgical education. Their ability to produce interactive learning resources, procedural guidance, and feedback post-virtual simulations makes them valuable in educating surgical trainees. However, technical challenges such as data quality issues, inaccuracies, and uncertainties around model interpretability remain barriers to widespread adoption. This review explores the integration of generative AI into surgical training, assessing its potential to enhance learning and teaching methodologies. While generative AI has demonstrated promise for improving surgical education, its integration must be approached cautiously, ensuring AI input is balanced with traditional supervision and mentorship from experienced surgeons. Given that generative AI models are not yet suitable as standalone tools, a blended learning approach that integrates AI capabilities with conventional educational strategies should be adopted. The review also addresses limitations and challenges, emphasizing the need for more robust research on different AI models and their applications across various surgical subspecialties. The lack of standardized frameworks and tools to assess the quality of AI outputs in surgical education necessitates rigorous oversight to ensure accuracy and reliability in training settings. By evaluating the current state of generative AI in surgical education, this narrative review highlights the potential for future innovation and research, encouraging ongoing exploration of AI in enhancing surgical education and training.

Keywords

Artificial Intelligence / AI / education / training

References

[1] Reddy S.Generative AI in healthcare: an implementation science informed translational path on application, integration and governance.Implement Sci2024;19:27 PMCID:PMC10941464

[2] Lv Z.Generative artificial intelligence in the metaverse era.Cognitive Robotics2023;3:208-17

[3] Memarian B.ChatGPT in education: methods, potentials, and limitations.Comput Hum Behav Artif Hum2023;1:100022

[4] Barreto F,Shirodkar M,Gonsalves S. Generative artificial intelligence: opportunities and challenges of large language models. In: Balas VE, Semwal VB, Khandare A, editors. Intelligent Computing and Networking. Singapore: Springer Nature; 2023. pp. 545-53. Available from: https://scholar.google.com/scholar?q=Generative+artificial+intelligence:+opportunities+and+challenges+of+large+language+models&hl=zh-CN&as_sdt=0&as_vis=1&oi=scholart. [Last accessed on 14 Nov 2024].

[5] De Angelis L,Arzilli G.ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health.Front Public Health2023;11:1166120 PMCID:PMC10166793

[6] Shen Y,Elias J.ChatGPT and other large language models are double-edged swords.Radiology2023;307:e230163

[7] Raiaan MAK,Fatema K.A review on large language models: architectures, applications, taxonomies, open issues and challenges.IEEE Access2024;12:26839-74

[8] Meyer JG,Martin PCN.ChatGPT and large language models in academia: opportunities and challenges.BioData Min2023;16:20 PMCID:PMC10339472

[9] Hong Y,Yoo J.How generative adversarial networks and their variants work: an overview.ACM Comput Surv2020;52:1-43

[10] Seth I,Cevik J.Utilizing GPT-4 and generative artificial intelligence platforms for surgical education: an experimental study on skin ulcers.Eur J Plast Surg2024;47:2162

[11] Xie Y,Hunter-Smith DJ,Seifman MA.Investigating the impact of innovative AI chatbot on post-pandemic medical education and clinical assistance: a comprehensive analysis.ANZ J Surg2024;94:68-77

[12] Skjold-Ødegaard B.Competency-based surgical training and entrusted professional activities - perfect match or a procrustean bed?.Ann Surg2021;273:e173-5

[13] Kotsis SV.Application of the “see one, do one, teach one” concept in surgical training.Plast Reconstr Surg2013;131:1194-201 PMCID:PMC4785880

[14] Boghdady M, Alijani A. Feedback in surgical education.Surgeon2017;15:98-103

[15] Scott MT,NeMoyer RE.Optimizing surgical education through the implementation of a feedback curriculum.Am J Surg2022;224:893-9

[16] Park SH.Use of generative artificial intelligence, including large language models such as ChatGPT, in scientific publications: policies of KJR and prominent authorities.Korean J Radiol2023;24:715-8 PMCID:PMC10400373

[17] Fazlollahi AM,Alsayegh A.Effect of artificial intelligence tutoring vs expert instruction on learning simulated surgical skills among medical students: a randomized clinical trial.JAMA Netw Open2022;5:e2149008 PMCID:PMC8864513

[18] Singh NK.Medical image generation using generative adversarial networks: a review. In: Patgiri R, Biswas A, Roy P, editors. Health informatics: a computational perspective in healthcare. Singapore: Springer; 2021. pp. 77-96.

[19] Atkinson CJ,Xie Y.Artificial intelligence language model performance for rapid intraoperative queries in plastic surgery: ChatGPT and the deep inferior epigastric perforator flap.J Clin Med2024;13:900 PMCID:PMC10856538

[20] Seth I,Joseph K.Use of artificial intelligence in breast surgery: a narrative review.Gland Surg2024;13:395-411 PMCID:PMC11002485

[21] Kirubarajan A,Khan S,Sobel M.Artificial intelligence and surgical education: a systematic scoping review of interventions.J Surg Educ2022;79:500-15

[22] Guerrero DT,Rajesh A,Butler CE.Advancing surgical education: the use of artificial intelligence in surgical training.Am Surg2023;89:49-54

[23] Locke S,Al-adely S,Wilson A.Natural language processing in medicine: a review.Trends Anaesth Crit Care2021;38:4-9

[24] Brennan L,Bennett W.The role of ChatGPT in enhancing ENT surgical training - a trainees’ perspective.J Laryngol Otol2024;138:480-6

[25] Mohapatra DP,Tripathy S.Leveraging large language models (LLM) for the plastic surgery resident training: do they have a role?.Indian J Plast Surg2023;56:413-20 PMCID:PMC10663077

[26] Lebhar MS,Goza S.Dr. ChatGPT: utilizing artificial intelligence in surgical education.Cleft Palate Craniofac J2024;61:2067-73

[27] Meskó B.Prompt engineering as an important emerging skill for medical professionals: tutorial.J Med Internet Res2023;25:e50638 PMCID:PMC10585440

[28] Sevgi UT,Doğruel Y,Tubbs RS.The role of an open artificial intelligence platform in modern neurosurgical education: a preliminary study.Neurosurgical Review2023;46:86

[29] Nah F, Zheng R, Cai J, Siau K, Chen L. Generative AI and ChatGPT: applications, challenges, and AI-human collaboration.J Inf Technol Case Appl Res2023;25:277-304

[30] Shah A,Wildenauer L,Vasconcellos A.Performance of ChatGPT on hand surgery board-style examination questions.J Orthop Exp Innov2024;5:

[31] Araji T.Evaluating the role of ChatGPT as a study aid in medical education in surgery.J Surg Educ2024;81:753-7

[32] Eschenbach WJ. Transparency and the black box problem: why we do not trust AI.Philos Technol2021;34:1607-22

[33] Lee Y, Tessier L, Brar K, et al; ASMBS Artificial Intelligence and Digital Surgery Taskforce. Performance of artificial intelligence in bariatric surgery: comparative analysis of ChatGPT-4, Bing, and Bard in the American society for metabolic and bariatric surgery textbook of bariatric surgery questions. Surg Obes Relat Dis 2024;20:609-13.

[34] Oh N,Lee WY.ChatGPT goes to the operating room: evaluating GPT-4 performance and its potential in surgical education and training in the era of large language models.Ann Surg Treat Res2023;104:269-73 PMCID:PMC10172028

[35] Wu C,Han M,Yang N.Application of ChatGPT-based blended medical teaching in clinical education of hepatobiliary surgery.Med Teach2024;Online ahead of print:

[36] Mirchi N,Yilmaz R,Winkler-Schwartz A.The virtual operative assistant: an explainable artificial intelligence tool for simulation-based training in surgery and medicine.PLoS One2020;15:e0229596 PMCID:PMC7046231

[37] Fazlollahi AM,Winkler-Schwartz A.AI in surgical curriculum design and unintended outcomes for technical competencies in simulation training.JAMA Netw Open2023;6:e2334658 PMCID:PMC10509729

[38] Ma R,Laca JA.Artificial intelligence-based video feedback to improve novice performance on robotic suturing skills: a pilot study.J Endourol2024;38:884-91

[39] Yang YY.Expert-led and artificial intelligence (AI) system-assisted tutoring course increase confidence of Chinese medical interns on suturing and ligature skills: prospective pilot study.J Educ Eval Health Prof2019;16:7 PMCID:PMC6517322

[40] Jarry Trujillo C,Escalona Vivas G.Surgeons vs ChatGPT: assessment and feedback performance based on real surgical scenarios.J Surg Educ2024;81:960-6

[41] Seth I,Xie Y.Comparing the efficacy of large language models ChatGPT, BARD, and Bing AI in providing information on rhinoplasty: an observational study.Aesthet Surg J Open Forum2023;5:ojad084 PMCID:PMC10547367

[42] Guthrie E,Del Carmen G.The Operating and Anesthetic Reference Assistant (OARA): a fine-tuned large language model for resident teaching.Am J Surg2024;234:28-34

[43] Artificial Analysis. Comparison of models: quality, performance & price analysis. Available from: https://artificialanalysis.ai/models. [Last accessed on 14 Nov 2024].

[44] Team AP. Artificial intelligence measurement and evaluation at the national institute of standards and technology. Available from: https://www.nist.gov/system/files/documents/2021/06/16/AIME_at_NIST-DRAFT-20210614.pdf. [Last accessed on 14 Nov 2024].