Competency-Based Assessment of Robotic Surgery Skills - Phase 2 (CARS 2.0): A Global Survey Study with Blinded Video Review of Surgical Proficiency On Behalf of TROGSS - The Robotic Global Surgical Society

Abstract

Aim: The Competency-Based Assessment of Robotic Surgery Skills (CARS) scale was developed as a novel approach to assess robotic surgery (RS) skills through 10 relevant RS competencies. CARS 2.0 aimed to expand on the findings of CARS by conducting a global survey study in which participants graded a blinded, edited surgical video with the CARS scale for 7 competencies measurable via video.

Methods: CARS 2.0 is being conducted globally, including participants across medical specialties and training stages, from medical students to attending/consultant surgeons. Participants evaluated a blinded, edited surgical video using the CARS scale via an anonymous Google form, focusing on 7 video-measurable competencies.

Results: A total of 320 responses were collected over 3 months, including 125 (39.06%) attending/consultant surgeons, 98 (30.6%) surgical specialty postgraduate trainees, 96 (30%) medical students, and 1 pre-medical student. ANOVA (analysis of variance) analysis showed that the operator scores increased with the evaluators’ level of experience, reaching statistical significance across all 7 competency categories. Spearman’s correlation indicated moderate associations between participants’ surgical experience and proficiency (ρ = 0.314, P < 0.001), as well as between their comfort with the CARS scale and proficiency (ρ = 0.337, P < 0.001). Regression analysis demonstrated that robotic stapler use and camera handling were predictors of higher CARS scores based on participants’ experience.

Conclusion: CARS represents a first step toward establishing competency-based assessment of RS performance independent of specific surgical procedures. Its integration into surgical training programs can facilitate trainees’ attainment of RS competency. Longitudinal studies could further validate its effectiveness at improving surgical training with its implementation into training curricula.

Keywords

Robotic surgery / competency-based assessment / surgical education / CARS scale / global survey study

References

[1] Liu Y,Xu J.Robotic surgery in gastrointestinal surgery: history, current status, and challenges.Intell Surg2024;7:101-4

[2] Pugin F,Morel P.History of robotic surgery: from AESOP^® and ZEUS^® to da Vinci^®.J Visc Surg2011;148:e3-8

[3] Drake JM,Goldenberg A.Computer- and robot-assisted resection of thalamic astrocytomas in children.Neurosurgery1991;29:27-33

[4] Kwoh YS,Jonckheere EA.A robot with improved absolute positioning accuracy for CT guided stereotactic brain surgery.IEEE Trans Biomed Eng1988;35:153-60

[5] Morrell ALG,Morrell AG.The history of robotic surgery and its evolution: when illusion becomes reality.Rev Col Bras Cir2021;48:e20202798 PMCID:PMC10683436

[6] Cornejo J,Vargas M.SY-MIS project: biomedical design of endo-robotic and laparoscopic training system for surgery on the earth and space.Emerg Sci J2024;8:372-93

[7] Picozzi P,Labate C.Advances in robotic surgery: a review of new surgical platforms.Electronics2024;13:4675

[8] Müller DT,Brunner S.Ergonomics in robot-assisted surgery in comparison to open or conventional laparoendoscopic surgery: a narrative review.IJAWHS2023;6:61-6

[9] Kankanamge D,Ong Z.Artificial intelligence based assessment of minimally invasive surgical skills using standardised objective metrics - a narrative review.Am J Surg2025;241:116074

[10] Chang OH,Modest AM.Developing an objective structured assessment of technical skills for laparoscopic suturing and intracorporeal knot tying.J Surg Educ2016;73:258-63

[11] Niitsu H,Yoshimitsu M.Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room.Surg Today2013;43:271-5 PMCID:PMC3574562

[12] Goh AC,Sander JC,Dunkin BJ.Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills.J Urol2012;187:247-52

[13] Liu M,Mazanetz J,Kreaden US.Assessment of Robotic Console Skills (ARCS): construct validity of a novel global rating scale for technical skills in robotically assisted surgery.Surg Endosc2018;32:526-35

[14] Siddiqui NY,Geller EJ.Validity and reliability of the robotic objective structured assessment of technical skills.Obstet Gynecol2014;123:1193-9 PMCID:PMC4352540

[15] Kutana S,Addison P,Talamini MA.Objective assessment of robotic surgical skills: review of literature and future directions.Surg Endosc2022;36:3698-707

[16] Elzein SM,Tomey D.Development and initial experience of a novel Competency-Based Assessment of Robotic Surgery Skills (CARS) scale for general surgery residents.Global Surg Educ2024;3:265

[17] Sánchez R,Rosciano J.Robotic surgery training: construct validity of Global Evaluative Assessment of Robotic Skills (GEARS).J Robot Surg2016;10:227-31

[18] Aghazadeh MA,Hung AJ.External validation of Global Evaluative Assessment of Robotic Skills (GEARS).Surg Endosc2015;29:3261-6

[19] Gofton WT,Wood TJ,Hamstra SJ.The Ottawa Surgical Competency Operating Room Evaluation (O-SCORE): a tool to assess surgical competence.Acad Med2012;87:1401-7

[20] Gerull W,Awad M.Operative performance outcomes of a simulator-based robotic surgical skills curriculum.Surg Endosc2020;34:4543-8

[21] Calvo H, Kim MP, Chihara R, Chan EY. A systematic review of general surgery robotic training curriculums.Heliyon2023;9:e19260 PMCID:PMC10481177

[22] Kallon A.Perspective chapter: the digital divide in a global emergency - how technology is shaping academic performance in diverse communities. In: Dias DDS, Candeias M, Meltzoff K, Editors. Academic performance - students, teachers and institutions on the stage. London: IntechOpen; 2024.