Evaluating ChatGPT’s efficacy in addressing common patient questions in plastic surgery consultations

Abstract

Aim: This study aims to investigate the ability of ChatGPT to answer common patient questions related to the five most common aesthetic procedures.

Methods: We asked three questions, two of which were the same across procedures, for each of the five most common plastic surgery procedures as determined by the 2022 American Society of Plastic Surgery (ASPS) Procedural Statistics Release. These were posed to ChatGPT on the same day, using the same account. Then, they were compared to the corresponding information on the ASPS website.

Results: We found that ChatGPT provides accurate, organized, and grammatically correct responses to common patient questions. It was comparable to the ASPS website in terms of comprehensiveness of the complications listed across procedures. However, its responses regarding recovery time were less detailed than the corresponding ASPS articles. It included accurate information on recovery time that was unavailable on the ASPS site. For procedure-specific questions, ChatGPT was more detailed 2/5 times, less detailed 1/5 times, and provided a completely different answer than the ASPS website 2/5 times.

Conclusion: This study provides support for ChatGPT’s utilization as a tool to improve the efficiency of consultations for aesthetic procedures. However, it is important to recognize ChatGPT’s limitations in answering questions in a patient/procedure-specific way. Therefore, it is not a substitute for an experienced surgeon consultation. Further research is needed to assess the reliability of ChatGPT before it can be fully recommended as an ultimate patient learning tool.

Keywords

Artificial intelligence / plastic surgery / consultation / aesthetic

References

[1] Sallam M.ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns.Healthcare2023;11:887 PMCID:PMC10048148

[2] Biswas SS.Potential use of Chat GPT in global warming.Ann Biomed Eng2023;51:1126-7

[3] Fraser H,Bacher I,Madsen T.Comparison of diagnostic and triage accuracy of Ada health and WebMD symptom checkers, ChatGPT, and physicians for patients in an emergency department: clinical data analysis study.JMIR Mhealth Uhealth2023;11:e49995 PMCID:PMC10582809

[4] Al Kuwaiti A,Al-Reedy A.A review of the role of artificial intelligence in healthcare.J Pers Med2023;13:951 PMCID:PMC10301994

[5] Dave T,Singh S.ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations.Front Artif Intell2023;6:1169595 PMCID:PMC10192861

[6] Garg RK,Agarwal AA,Paliwal V.Exploring the role of ChatGPT in patient care (diagnosis and treatment) and medical research: a systematic review.Health Promot Perspect2023;13:183-91 PMCID:PMC10558973

[7] Ferreira AL,Grant-Kels JM,Lipoff JB.Evaluation of ChatGPT dermatology responses to common patient queries.JMIR Dermatol2023;6:e49280 PMCID:PMC10692871

[8] Liu J,Cai X,Yin C.A descriptive study based on the comparison of ChatGPT and evidence-based neurosurgeons.iScience2023;26:107590 PMCID:PMC10495632

[9] Durairaj KK,Bertossi D.Artificial intelligence versus expert plastic surgeon: comparative study shows ChatGPT “Wins” rhinoplasty consultations: should we be worried?.Facial Plast Surg Aesthet Med2024;26:270-5

[10] Lautrup AD,Schneider-Kamp A,Lindholt JS.Heart-to-heart with ChatGPT: the impact of patients consulting AI for cardiovascular health advice.Open Heart2023;10:e002455 PMCID:PMC10649823

[11] Rizwan A.The use of AI in diagnosing diseases and providing management plans: a consultation on cardiovascular disorders with ChatGPT.Cureus2023;15:e43106 PMCID:PMC10483170

[12] Li W,Chen F,Yu H.Exploring the potential of ChatGPT-4 in responding to common questions about abdominoplasty: an AI-based case study of a plastic surgery consultation.Aesthetic Plast Surg2024;48:1571-83

[13] Seth I,Xie Y.Evaluating Chatbot efficacy for answering frequently asked questions in plastic surgery: a ChatGPT case study focused on breast augmentation.Aesthet Surg J2023;43:1126-35

[14] Xie Y,Hunter-Smith DJ,Ross R.Aesthetic surgery advice and counseling from artificial intelligence: a rhinoplasty consultation with ChatGPT.Aesthetic Plast Surg2023;47:1985-93 PMCID:PMC10581928

[15] ASPS procedural statistics release. Plast Reconstr Surg 2024;153:1-24.

[16] Ali R,Connolly ID.Performance of ChatGPT and GPT-4 on neurosurgery written board examinations.Neurosurgery2023;93:1353-65