Scoping review: autonomous endoscopic navigation

Abstract

This is a scoping review of artificial intelligence (AI) in flexible endoscopy (FE), encompassing both computer vision (CV) and autonomous actions (AA). While significant progress has been made in AI and FE, particularly in polyp detection and malignancy prediction, resulting in several available market products, these achievements only scratch the surface potential of AI in flexible endoscopy. Many doctors still do not fully grasp that contemporary robotic FE systems, which operate the endoscope through telemanipulation, represent the most basic autonomy level, specifically categorized as level 1. Although these console systems allow remote control, they lack the more sophisticated forms of autonomy. This manuscript aims to review the current examples of AI applications in FE and hopefully act as a stimulus for more advanced AA in FE.

Keywords

Flexible endoscopy / autonomous actions / artificial intelligence / computer vision / robotic / robotic-assisted / console / remote control / telemanipulation

References

[1] Alkire BC,Shrime MG.Global access to surgical care: a modelling study.Lancet Glob Health2015;3:e316-23

[2] Chahal D.A primer on artificial intelligence and its application to endoscopy.Gastrointest Endosc2020;92:813-20.e4

[3] Ferlay J,Soerjomataram I.Cancer statistics for the year 2020: an overview.Int J Cancer2021;149:778-89

[4] World Health Organization. The true death toll of COVID-19: Estimating global excess mortality. Available from: https://www.who.int/data/stories/the-true-death-toll-of-covid-19-estimating-global-excess-mortality. [Last accessed on 7 Dec 2023]

[5] Jiang W,Wang C,Yang Y.Navigation strategy for robotic soft endoscope intervention.Int J Med Robot2020;16:e2056

[6] Gumbs AA,Tsai TJ,Chouillard E.Keeping surgeons in the loop: are handheld robotics the best path towards more autonomous actions? (A comparison of complete vs. handheld robotic hepatectomy for colorectal liver metastases).Art Int Surg2021;1:38-51

[7] Lu Y,Li B.Autonomous intelligent navigation for flexible endoscopy using monocular depth guidance and 3-D shape planning.arXiv2023;In press

[8] Li Z.Robotic endoscopy.Visc Med2018;34:45-51

[9] Manfredi L.Endorobots for colonoscopy: design challenges and available technologies.Front Robot AI2021;8:705454

[10] Kahn A,Stewart M.Artificial intelligence-enhanced volumetric laser endomicroscopy improves dysplasia detection in Barrett’s esophagus in a randomized cross-over study.Sci Rep2022;12:16314

[11] Wu L,Liu M.Evaluation of the effects of an artificial intelligence system on endoscopy quality and preliminary testing of its performance in detecting early gastric cancer: a randomized controlled trial.Endoscopy2021;53:1199-207

[12] Xu C,Wu L.Evaluating the effect of an artificial intelligence system on the anesthesia quality control during gastrointestinal endoscopy with sedation: a randomized controlled trial.BMC Anesthesiol2022;22:313

[13] Dong Z,Mu G.A deep learning-based system for real-time image reporting during esophagogastroduodenoscopy: a multicenter study.Endoscopy2022;54:771-7

[14] Niikura R,Shichijo S.Artificial intelligence versus expert endoscopists for diagnosis of gastric cancer in patients who have undergone upper gastrointestinal endoscopy.Endoscopy2022;54:780-4

[15] Zhang X,Yu T.Real-time gastric polyp detection using convolutional neural networks.PloS One2019;14:e0214133

[16] Wu L,Sharma P.Effect of a deep learning-based system on the miss rate of gastric neoplasms during upper gastrointestinal endoscopy: a single-centre, tandem, randomised controlled trial.Lancet Gastroenterol Hepatol2021;6:700-8

[17] Mascharak S,Holsinger FC.Detecting oropharyngeal carcinoma using multispectral, narrow-band imaging and machine learning.Laryngoscope2018;128:2514-20

[18] Shakir T,Bhan C.AI in colonoscopy - detection and characterisation of malignant polyps.Art Int Surg2023;3:186-94

[19] Marcondes FO,Schoen RE,Morris M.Adenoma detection rate falls at the end of the day in a large multi-site sample.Dig Dis Sci2018;63:856-9

[20] Liu WN,Bian XQ.Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy.Saudi J Gastroenterol2020;26:13-9

[21] Glissen Brown JR,Wang P.Deep learning computer-aided polyp detection reduces adenoma miss rate: a united states multi-center randomized tandem colonoscopy study (CADeT-CS Trial).Clin Gastroenterol Hepatol2022;20:1499-507.e4

[22] Xu L,Zhou J.Artificial intelligence-assisted colonoscopy: a prospective, multicenter, randomized controlled trial of polyp detection.Cancer Med2021;10:7184-93

[23] Ichimasa K,Mori Y.Artificial intelligence may help in predicting the need for additional surgery after endoscopic resection of T1 colorectal cancer.Endoscopy2018;50:230-40

[24] Deding U,Havshoei AL.Colon capsule endoscopy versus CT colonography after incomplete colonoscopy. Application of artificial intelligence algorithms to identify complete colonic investigations.United Eur Gastroent2020;8:782-9

[25] Yim S,Gracias DH.Biopsy using a magnetic capsule endoscope carrying, releasing, and retrieving untethered microgrippers.IEEE Trans Bio-Med Eng2013;61:513-21

[26] Pittiglio G,da Veiga T.Patient-specific magnetic catheters for atraumatic autonomous endoscopy.Soft Robot2022;9:1120-33

[27] Cepolina F.An introductory review of robotically assisted surgical systems.Int J Med Robot2022;18:e2409

[28] Gumbs AA,Bourdel N.The advances in computer vision that are enabling more autonomous actions in surgery: a systematic review of the literature.Sensors2022;22:4918

[29] O’Sullivan S,Holzinger A.Explainable artificial intelligence (XAI): closing the gap between image analysis and navigation in complex invasive diagnostic procedures.World J Urol2022;40:1125-34

[30] Zhang Q,Formosa GA,Rentschler ME.Enabling autonomous colonoscopy intervention using a robotic endoscope platform.IEEE Trans Bio-Med Eng2020;68:1957-68

[31] Gumbs AA,Vidal C,Gayet B.Modified robotic lightweight endoscope (ViKY) validation in vivo in a porcine model.Surg Innov2007;14:261-4

[32] Martin JW,Norton JC.Enabling the future of colonoscopy with intelligent and autonomous magnetic manipulation.Nat Mach Intell2020;2:595-606

[33] Barducci L,Martin J,Valdastri P.Active stabilization of interventional tasks utilizing a magnetically manipulated endoscope.Front Robot AI2022;9:854081

[34] Asari VK,Kassim IM.A fully autonomous microrobotic endoscopy system.J Intell Robot Syst2000;28:325-41

[35] Ciuti G,Marlicz W.Frontiers of robotic colonoscopy: a comprehensive review of robotic colonoscopes and technologies.J Clin Med2020;9:1648

[36] Bismuth J,Stankovic M,Lumsden AB.A first-in-man study of the role of flexible robotics in overcoming navigation challenges in the iliofemoral arteries.J Vasc Surg2013;57:14S-9S

[37] Saeidi H,Kam M.Autonomous robotic laparoscopic surgery for intestinal anastomosis.Sci Robot2022;7:eabj2908

[38] Yang GZ,Cleary K.Medical robotics - Regulatory, ethical, and legal considerations for increasing levels of autonomy.Sci Robot2017;2:eaam8638

[39] Gumbs AA,Spolverato G.Artificial intelligence surgery: how do we get to autonomous actions in surgery?.Sensors2021;21:5526

[40] Leonard S,Kim Y,Kim PCW.Smart tissue anastomosis robot (STAR): a vision-guided robotics system for laparoscopic suturing.IEEE Trans Biomed Eng2014;61:1305-17

[41] Gumbs AA.Why Artificial Intelligence Surgery (AIS) is better than current Robotic-Assisted Surgery (RAS).Art Int Surg2022;2:207-12

[42] Rillig A,Schmidt B.Experience matters: long-term results of pulmonary vein isolation using a robotic navigation system for the treatment of paroxysmal atrial fibrillation.Clin Res Cardiol2016;105:106-16

[43] Elder B,Ghosh S.A 3D-printed self-learning three-linked-sphere robot for autonomous confined-space navigation.Adv Intell Syst2021;3:2100039

[44] Zhang X,Ng WY.An autonomous robotic flexible endoscope system with a DNA-inspired continuum mechanism. In: 2021 IEEE International Conference on Robotics and Automation (ICRA); 2021 May 30 - Jun 05; Xi’an, China. IEEE; 2021. pp. 12055-60.

[45] Saeidi H,Opfermann JD.Autonomous laparoscopic robotic suturing with a novel actuated suturing tool and 3D endoscope. In: 2019 International Conference on Robotics and Automation (ICRA); 2019 May 20-24; Montreal, Canada. IEEE; 2019. pp. 1541-7.

[46] Page MJ,Bossuyt PM.The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.BMJ2021;372: