The role of artificial intelligence and 3D printing in minimally invasive liver surgery

Abstract

During the past decade, technological advancements have transformed liver surgery. New tools are available to assist the surgeon during complex operations, such as a hepatectomy for liver cancer. Augmented reality (AR) is an innovative technology that utilizes computed tomography (CT) or magnetic resonance imaging (MRI) scans to create three-dimensional (3D) images of the area or the organ of interest. This is especially useful for minimally invasive liver resection (MILR), where the field of view and maneuverability during the operation is limited. A 3D image of vascular structures, hilar segments, and the tumor location is projected into the operating field, thus contributing to a more precise resection. Combining AR with the groundbreaking capabilities of artificial intelligence (AI) could further improve the surgical outcomes of MILR. Specialized AI programs are designed to analyze the surgical field, provide information and facilitate the operation plan, simplify intraoperative decision making and reduce human error. 3D printing of hepatocellular cancer liver models is another useful technology that allows for procedure simulation, proper preoperative planning, and effective intraoperative navigation. Even though the benefits could be outstanding, the large cost of those technologies is a major limiting factor. Future research should focus on making AI and 3D imaging tools more widely affordable to the healthcare industry as data show that they could improve diagnostic efficiency, increase surgical precision, minimize human error and optimize patient care.

Keywords

Minimally invasive liver surgery / artificial intelligence / 3D printing / augmented reality

References

[1] Noba L,Chandler C,Hariharan D.Enhanced recovery after surgery (ERAS) reduces hospital costs and improve clinical outcomes in liver surgery: a systematic review and meta-analysis.J Gastrointest Surg2020;24:918-32 PMCID:PMC7165160

[2] Marvin MR.Laparoscopic liver surgery.Adv Surg2009;43:159-73

[3] Filmann N,Schadde E.Mortality after liver surgery in Germany.Br J Surg2019;106:1523-9

[4] Melloul E,Scott M.Guidelines for perioperative care for liver surgery: enhanced recovery after surgery (ERAS) society recommendations.World J Surg2016;40:2425-40

[5] Lim JSH.3D laparoscopy and fluorescence imaging can improve surgical precision for hepatectomy.Hepatobiliary Surg Nutr2024;13:544-7 PMCID:PMC11190511

[6] Finotti M,Testa G.The current and future role of robotic surgery in liver surgery and transplantation.Minerva Surg2022;77:380-90

[7] Buchs NC,Pugin F.Augmented environments for the targeting of hepatic lesions during image-guided robotic liver surgery.J Surg Res2013;184:825-31

[8] Tripke V.An update on liver surgery - a new terminology and modern techniques.Innov Surg Sci2023;8:197-201 PMCID:PMC10949114

[9] Kang X,Wilson E.Stereoscopic augmented reality for laparoscopic surgery.Surg Endosc2014;28:2227-35

[10] Banchini F,Rizzi N,Conti L.Laparoscopic dorsal subsegmentectomy 8: exploit the 3d technology to plan liver resection, and predict intraparenchymal pedicles. A case report. (With video explanation).Int J Surg Case Rep2021;88:106516 PMCID:PMC8536529

[11] Cheng J,Liu J,Yao W.Value of 3D printing technology combined with indocyanine green fluorescent navigation in complex laparoscopic hepatectomy.PLoS One2022;17:e0272815 PMCID:PMC9371281

[12] Prevost GA,Paolucci I.Efficiency, accuracy and clinical applicability of a new image-guided surgery system in 3D laparoscopic liver surgery.J Gastrointest Surg2020;24:2251-8

[13] Gavriilidis P,Pelanis E.Navigated liver surgery: state of the art and future perspectives.Hepatobiliary Pancreat Dis Int2022;21:226-33

[14] Berardi G,Meniconi RL.The applications of 3D imaging and indocyanine green dye fluorescence in laparoscopic liver surgery.Diagnostics2021;11:2169 PMCID:PMC8700092

[15] Kasai M,Aihara T,Yamanaka N.Laparoscopic projection mapping of the liver portal segment, based on augmented reality combined with artificial intelligence, for laparoscopic anatomical liver resection.Cureus2023;15:e48450 PMCID:PMC10702819

[16] Koo B,Allam M.Automatic, global registration in laparoscopic liver surgery.Int J Comput Assist Radiol Surg2022;17:167-76 PMCID:PMC8739294

[17] Labrunie M,Mourthadhoi F.Automatic preoperative 3d model registration in laparoscopic liver resection.Int J Comput Assist Radiol Surg2022;17:1429-36

[18] Volonté F,Bucher P,Ratib O.Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion.J Hepatobiliary Pancreat Sci2011;18:506-9

[19] Oshiro Y.Three-dimensional liver surgery simulation: computer-assisted surgical planning with three-dimensional simulation software and three-dimensional printing.Tissue Eng Part A2017;23:474-80

[20] Saito Y,Morine Y,Sugimoto M.Essential updates 2020/2021: current topics of simulation and navigation in hepatectomy.Ann Gastroenterol Surg2022;6:190-6 PMCID:PMC8889864

[21] Pelanis E,Eigl B.Evaluation of a novel navigation platform for laparoscopic liver surgery with organ deformation compensation using injected fiducials.Med Image Anal2021;69:101946

[22] Zhang P,Zhu W.Real-time navigation for laparoscopic hepatectomy using image fusion of preoperative 3D surgical plan and intraoperative indocyanine green fluorescence imaging.Surg Endosc2020;34:3449-59

[23] Luo H,Zhang S.Augmented reality navigation for liver resection with a stereoscopic laparoscope.Comput Methods Programs Biomed2020;187:105099

[24] Shen L,Xing L.Patient-specific reconstruction of volumetric computed tomography images from a single projection view via deep learning.Nat Biomed Eng2019;3:880-8 PMCID:PMC6858583

[25] Ying X,Ma K,Weng Z.X2CT-GAN: reconstructing CT from biplanar X-Rays with generative adversarial networks. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2019 Jun 15-20; Long Beach, USA. IEEE; 2019. pp. 10611-20.

[26] Shao HC,Bai T.Real-time liver tumor localization via a single x-ray projection using deep graph neural network-assisted biomechanical modeling.Phys Med Biol2022;67:115009 PMCID:PMC9233941

[27] Shao HC,Folkert MR,Zhang Y.Automatic liver tumor localization using deep learning-based liver boundary motion estimation and biomechanical modeling (DL-Bio).Med Phys2021;48:7790-805 PMCID:PMC8678353

[28] Wang B,Ai J.Accurate tumor segmentation via octave convolution neural network.Front Med2021;8:653913 PMCID:PMC8169966

[29] Lu Y,Han F.3D printing of self-healing personalized liver models for surgical training and preoperative planning.Nat Commun2023;14:8447 PMCID:PMC10730511

[30] Oh N,Rhu J.Automated 3D liver segmentation from hepatobiliary phase MRI for enhanced preoperative planning.Sci Rep2023;13:17605 PMCID:PMC10582008

[31] Lopez-Lopez V,de Vicente E.Next-generation three-dimensional modelling software for personalized surgery decision-making in perihilar cholangiocarcinoma: multicentre study.Br J Surg2021;108:e394-5

[32] Lv A,Qian HG,Hao CY.Precise navigation of the surgical plane with intraoperative real-time virtual sonography and 3D simulation in liver resection.J Gastrointest Surg2018;22:1814-8

[33] Wu T,He B.Diagnostic accuracy of 3D imaging combined with intra-operative ultrasound in the prediction of post-hepatectomy liver failure.J Gastrointest Oncol2022;13:1224-36 PMCID:PMC9274062

[34] Cui DP,Guo YX,Qiao YX.Accurate resection of hilar cholangiocarcinoma using eOrganmap 3D reconstruction and full quantization technique.World J Gastrointest Surg2023;15:1693-702 PMCID:PMC10494582

[35] Yang HY,Han DH,Choi GH.Robotic major liver resections: surgical outcomes compared with open major liver resections.Ann Hepatobiliary Pancreat Surg2021;25:8-17 PMCID:PMC7952658

[36] Society Of Digital Medicine Chinese; Cancer Committee Of Chinese Medical Doctor Association Liver; Precision Medicine Committee Of Chinese Medical Doctor Association Clinical; Intelligent Surgery Committee Of Chinese Research Hospital Association Digital. [Clinical practice guidelines for precision diagnosis and treatment of complex liver tumor guided by three-dimensional visualization technology (version 2019)].Nan Fang Yi Ke Da Xue Xue Bao2020;40:297-307. (in Chinese) PMCID:PMC7167330

[37] Fang CH,Chi CW.[Application of indocyanine green-fluorescent imaging technique in planning resection line and real-time surgical navigation in small hepatocellular carcinoma].Zhonghua Wai Ke Za Zhi2016;54:444-50. (in Chinese)

[38] Fang CH,Lau YY.[Construction and application of the core technology system of digital intelligent diagnostic and treatment for hepato-biliary-pancreatic diseases].Zhonghua Wai Ke Za Zhi2019;57:253-7. (in Chinese)

[39] Arizumi T,Minami T.Effectiveness of sorafenib in patients with transcatheter arterial chemoembolization (TACE) refractory and intermediate-stage hepatocellular carcinoma.Liver Cancer2015;4:253-62 PMCID:PMC4698649

[40] Giannone F,Cherkaoui Z,Pessaux P.Augmented reality and image-guided robotic liver surgery.Cancers2021;13:6268 PMCID:PMC8699460

[41] Vasey B,Khan DZ.Intraoperative applications of artificial intelligence in robotic surgery: a scoping review of current development stages and levels of autonomy.Ann Surg2023;278:896-903 PMCID:PMC10631501

[42] Knudsen JE,Ma R.Clinical applications of artificial intelligence in robotic surgery.J Robot Surg2024;18:102 PMCID:PMC10907451

[43] Pesi B,Guerra F.Surgical and oncological outcomes after ultrasound-guided robotic liver resections for malignant tumor. Analysis of a prospective database.Int J Med Robot2019;15:e2002

[44] Spiegelberg J,Diener MK.Robotic-assisted surgery for primary hepatobiliary tumors-possibilities and limitations.Cancers2022;14:265 PMCID:PMC8773643

[45] Daskalaki D,Brown M.Financial impact of the robotic approach in liver surgery: a comparative study of clinical outcomes and costs between the robotic and open technique in a single institution.J Laparoendosc Adv Surg Tech A2017;27:375-82 PMCID:PMC5397272

[46] Fong Y,Collins J.Applying the Delphi process for development of a hepatopancreaticobiliary robotic surgery training curriculum.Surg Endosc2020;34:4233-44

[47] Boal MWE,Tesfai F.Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review.Br J Surg2024;111:znad331 PMCID:PMC10771126

[48] Lim C,Salloum C.Outcomes after 3D laparoscopic and robotic liver resection for hepatocellular carcinoma: a multicenter comparative study.Surg Endosc2021;35:3258-66

[49] Hawksworth J,Holzner ML.Robotic hepatectomy is a safe and cost-effective alternative to conventional open hepatectomy: a single-center preliminary experience.J Gastrointest Surg2021;25:825-8

[50] Kamel MK,Keane CA.National trends and perioperative outcomes of robotic-assisted hepatectomy in the USA: a propensity-score matched analysis from the national cancer database.World J Surg2022;46:189-96

[51] Njei B,Seto N.Artificial intelligence in medical imaging for cholangiocarcinoma diagnosis: a systematic review with scientometric analysis.J Gastroenterol Hepatol2023;38:874-82