Application and use of artificial intelligence in colorectal cancer surgery: where are we?

Abstract

AI is revolutionizing the landscape of colorectal cancer (CRC) surgery, permeating diverse facets ranging from intraoperative guidance to predictive modeling of postoperative outcomes. This scoping review aims to comprehensively delineate the breadth of artificial intelligence (AI) applications in CRC surgery. A search of PubMed, Embase, and Ebsco databases up to December 2023 was conducted, with registration in the international prospective register of systematic reviews (PROSPERO) (CRD42024502107). Sixty-two studies meeting stringent inclusion criteria were scrutinized, encompassing AI utilization in CRC surgery or the development of AI-driven tools for colorectal surgical practice. Five principal domains of AI application emerged: (i) Intraoperative guidance, leveraging real-time navigation, indocyanine green (ICG) angiography, and hyperspectral imaging (HSI) to enhance surgical precision; (ii) Image segmentation, facilitating phase recognition, tools recognition, and anatomical identification to optimize surgical visualization; (iii) Training and performance assessment, enabling objective evaluation and enhancement of surgical skills through AI-driven simulations and feedback mechanisms; (iv) Prediction of surgical complications, encompassing prognostication of anastomotic leakage (AL) or stricture, stoma requirements, and prediction of low anterior resection syndrome (LARS) and short-term postoperative complications; (v) Utilization of electronic health records (EHRs), harnessing AI algorithms to streamline data analysis and inform decision-making processes. This review underscores the paradigm-shifting impact of AI in CRC surgery, transcending conventional boundaries and catalyzing advancements across diverse surgical domains. Although many applications are still experimental, as AI continues to evolve, it promises to transform surgical practice, optimize outcomes, and revolutionize patient care. Embracing AI technologies is imperative for colorectal surgeons to remain at the vanguard of surgical innovation and deliver superior outcomes for CRC patients.

Keywords

Artificial intelligence / machine learning / colorectal cancer / colorectal surgery

References

[1] Zhao M,Kim H.Machine learning with K-means dimensional reduction for predicting survival outcomes in patients with breast cancer.Cancer Inform2018;17:1176935118810215 PMCID:PMC6238199

[2] Elemento O,Lundin J.Artificial intelligence in cancer research, diagnosis and therapy.Nat Rev Cancer2021;21:747-52

[3] Jordan MI.Machine learning: trends, perspectives, and prospects.Science2015;349:255-60

[4] Xu Y,Cao X.Artificial intelligence: a powerful paradigm for scientific research.Innovation2021;2:100179 PMCID:PMC8633405

[5] Egger J,Pepe A.Medical deep learning - a systematic meta-review.Comput Methods Programs Biomed2022;221:106874

[6] Handelman GS,Chandra RV,Lee MJ.eDoctor: machine learning and the future of medicine.J Intern Med2018;284:603-19

[7] Maier-Hein L,Sarikaya D.Surgical data science - from concepts toward clinical translation.Med Image Anal2022;76:102306 PMCID:PMC9135051

[8] Sung H,Siegel RL.Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.CA Cancer J Clin2021;71:209-49

[9] Maier-Hein L,Speidel S.Surgical data science for next-generation interventions.Nat Biomed Eng2017;1:691-6

[10] Mansour NM.Artificial intelligence in colonoscopy.Curr Gastroenterol Rep2023;25:122-9

[11] Inchingolo R,Cannella R.Radiomics in colorectal cancer patients.World J Gastroenterol2023;29:2888-904 PMCID:PMC10237092

[12] Liberati A,Tetzlaff J.The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration.J Clin Epidemiol2009;62:e1-34

[13] Tricco AC,Zarin W.PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation.Ann Intern Med2018;169:467-73

[14] Pollock D,Khalil H.Recommendations for the extraction, analysis, and presentation of results in scoping reviews.JBI Evid Synth2023;21:520-32

[15] Kitaguchi D,Kosugi N.Artificial intelligence for the recognition of key anatomical structures in laparoscopic colorectal surgery.Br J Surg2023;110:1355-8

[16] Kojima S,Igaki T.Deep-learning-based semantic segmentation of autonomic nerves from laparoscopic images of colorectal surgery: an experimental pilot study.Int J Surg2023;109:813-20 PMCID:PMC10389575

[17] Ryu S,Kitagawa T.Real-time artificial intelligence navigation-assisted anatomical recognition in laparoscopic colorectal surgery.J Gastrointest Surg2023;27:3080-2 PMCID:PMC10837241

[18] Park SH,Baek KR,Lee IY.Artificial intelligence based real-time microcirculation analysis system for laparoscopic colorectal surgery.World J Gastroenterol2020;26:6945-62 PMCID:PMC7701947

[19] Okamoto N,Bencteux V.Computer-assisted differentiation between colon-mesocolon and retroperitoneum using hyperspectral imaging (HSI) technology.Diagnostics2022;12:2225 PMCID:PMC9497769

[20] Beaulieu RJ,Singh J,Banerjee A.Automated diagnosis of colon cancer using hyperspectral sensing.Int J Med Robot2018;14:e1897

[21] Manni F,der Sommen FV.Hyperspectral imaging for colon cancer classification in surgical specimens: towards optical biopsy during image-guided surgery.Annu Int Conf IEEE Eng Med Biol Soc2020;2020:1169-73

[22] Jansen-Winkeln B,Chalopin C.Feedforward artificial neural network-based colorectal cancer detection using hyperspectral imaging: a step towards automatic optical biopsy.Cancers2021;13:967 PMCID:PMC7956537

[23] Collins T,Benedicenti S.Automatic optical biopsy for colorectal cancer using hyperspectral imaging and artificial neural networks.Surg Endosc2022;36:8549-59

[24] Baltussen EJM,Brouwer de Koning SG.Hyperspectral imaging for tissue classification, a way toward smart laparoscopic colorectal surgery.J Biomed Opt2019;24:1-9 PMCID:PMC6985687

[25] Tkachenko M,Jansen-Winkeln B,Gockel I.Impact of pre- and post-processing steps for supervised classification of colorectal cancer in hyperspectral images.Cancers2023;15:2157 PMCID:PMC10093280

[26] Jalal NA,Möller K.Evaluating convolutional neural network and hidden markov model for recognising surgical phases in sigmoid resection.Curr Dir Biomed Eng2018;4:415-8

[27] Kitaguchi D,Matsuzaki H.Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approach.Surg Endosc2020;34:4924-31

[28] Kitaguchi D,Matsuzaki H.Deep learning-based automatic surgical step recognition in intraoperative videos for transanal total mesorectal excision.Surg Endosc2022;36:1143-51 PMCID:PMC8758657

[29] Kitaguchi D,Matsuzaki H.Computer-assisted real-time automatic prostate segmentation during TaTME: a single-center feasibility study.Surg Endosc2021;35:2493-9

[30] Kolbinger FR,Carstens M.Artificial intelligence for context-aware surgical guidance in complex robot-assisted oncological procedures: an exploratory feasibility study.Eur J Surg Oncol2023;106996

[31] Kitaguchi D,Matsuzaki H.Automated laparoscopic colorectal surgery workflow recognition using artificial intelligence: experimental research.Int J Surg2020;79:88-94

[32] Kitaguchi D,Hayashi K.Development and validation of a model for laparoscopic colorectal surgical instrument recognition using convolutional neural network-based instance segmentation and videos of laparoscopic procedures.JAMA Netw Open2022;5:e2226265 PMCID:PMC9391983

[33] Maier-Hein L,Ross T.Heidelberg colorectal data set for surgical data science in the sensor operating room.Sci Data2021;8:101 PMCID:PMC8042116

[34] Ryu K,Nakajima K.Deep learning-based vessel automatic recognition for laparoscopic right hemicolectomy.Surg Endosc2024;38:171-8

[35] Igaki T,Kojima S.Artificial intelligence-based total mesorectal excision plane navigation in laparoscopic colorectal surgery.Dis Colon Rectum2022;65:e329-33

[36] Kitaguchi D,Matsuzaki H.Real-time vascular anatomical image navigation for laparoscopic surgery: experimental study.Surg Endosc2022;36:6105-12

[37] Ryu S,Imaizumi Y.Laparoscopic colorectal surgery with anatomical recognition with artificial intelligence assistance for nerves and dissection layers.Ann Surg Oncol2024;31:1690-1

[38] Kumazu Y,Kitamura N.Automated segmentation by deep learning of loose connective tissue fibers to define safe dissection planes in robot-assisted gastrectomy.Sci Rep2021;11:21198 PMCID:PMC8551298

[39] Kitaguchi D,Matsuzaki H,Takeshita N.Automatic purse-string suture skill assessment in transanal total mesorectal excision using deep learning-based video analysis.BJS Open2023;7:zrac176 PMCID:PMC9991500

[40] Igaki T,Matsuzaki H.Automatic surgical skill assessment system based on concordance of standardized surgical field development using artificial intelligence.JAMA Surg2023;158:e231131 PMCID:PMC10248810

[41] Kitaguchi D,Matsuzaki H,Hasegawa H.Development and validation of a 3-dimensional convolutional neural network for automatic surgical skill assessment based on spatiotemporal video analysis.JAMA Netw Open2021;4:e2120786 PMCID:PMC8363914

[42] Kolbinger FR,Jenke AC.Anatomy segmentation in laparoscopic surgery: comparison of machine learning and human expertise - an experimental study.Int J Surg2023;109:2962-74 PMCID:PMC10583931

[43] Sasaki S,Takenaka S.Machine learning-based automatic evaluation of tissue handling skills in laparoscopic colorectal surgery: a retrospective experimental study.Ann Surg2023;278:e250-5

[44] Chiarello MM,Cariati M,Bianchi V.Anastomotic leakage in colorectal cancer surgery.Surg Oncol2022;40:101708

[45] Rencuzogullari A,Valente M,Remzi FH.Predictors of anastomotic leak in elderly patients after colectomy: nomogram-based assessment from the american college of surgeons national surgical quality program procedure-targeted cohort.Dis Colon Rectum2017;60:527-36

[46] Wen R,Zhang Q.Machine learning-based random forest predicts anastomotic leakage after anterior resection for rectal cancer.J Gastrointest Oncol2021;12:921-32 PMCID:PMC8261311

[47] Shen Y,Lu A,Chen HN.Prediction of symptomatic anastomotic leak after rectal cancer surgery: a machine learning approach.J Surg Oncol2024;129:264-72

[48] Arezzo A, Migliore M, Chiaro P, et al; REAL Score Collaborators. The REAL (REctal Anastomotic Leak) score for prediction of anastomotic leak after rectal cancer surgery. Tech Coloproctol 2019;23:649-63.

[49] Mazaki J,Ohno Y.A novel predictive model for anastomotic leakage in colorectal cancer using auto-artificial intelligence.Anticancer Res2021;41:5821-5

[50] Adams K.Creation of an effective colorectal anastomotic leak early detection tool using an artificial neural network.Int J Colorectal Dis2014;29:437-43

[51] Shao SL,Qin JC.Comprehensive abdominal composition evaluation of rectal cancer patients with anastomotic leakage compared with body mass index-matched controls.World J Gastrointest Surg2022;14:1250-9 PMCID:PMC9727572

[52] Baker SE,Ambroze WL Jr.Anastomotic leak is increased with Clostridium difficile infection after colectomy: machine learning-augmented propensity score modified analysis of 46 735 patients.Am Surg2022;88:74-82

[53] Sammour T,Karunatillake AI.Validation of an online risk calculator for the prediction of anastomotic leak after colon cancer surgery and preliminary exploration of artificial intelligence-based analytics.Tech Coloproctol2017;21:869-77

[54] Lee SY,Kim YJ.Anastomotic stricture after ultralow anterior resection or intersphincteric resection for very low-lying rectal cancer.Surg Endosc2018;32:660-6

[55] Sartori A, De Luca M, Fiscon V, Frego M, Portale G; CANSAS study working group. Retrospective multicenter study of post-operative stenosis after stapled colorectal anastomosis. Updates Surg 2019;71:539-42..

[56] Su Y,Chen W,Qin J.Automated machine learning-based model for predicting benign anastomotic strictures in patients with rectal cancer who have received anterior resection.Eur J Surg Oncol2023;49:107113

[57] Shao S,Lu Q,Mu L.Artificial intelligence assists surgeons’ decision-making of temporary ileostomy in patients with rectal cancer who have received anterior resection.Eur J Surg Oncol2023;49:433-9

[58] Liu Y,Du W.Applying interpretable machine learning algorithms to predict risk factors for permanent stoma in patients after TME.Front Surg2023;10:1125875 PMCID:PMC10079943

[59] Kuo CY,Lin YK.Artificial intelligence based system for predicting permanent stoma after sphincter saving operations.Sci Rep2023;13:16039 PMCID:PMC10519982

[60] Keane C, Fearnhead NS, Bordeianou LG, et al; LARS International Collaborative Group. International consensus definition of low anterior resection syndrome. Dis Colon Rectum 2020;63:274-84. PMCID:PMC7034376

[61] Qin Q, Huang B, Wu A, et al; Chinese Radiation Intestinal Injury Research Group. Development and validation of a post-radiotherapy prediction model for bowel dysfunction after rectal cancer resection. Gastroenterology 2023;165:1430-42.e14.

[62] Huang MJ,Yu KX.Development of prediction model of low anterior resection syndrome for colorectal cancer patients after surgery based on machine-learning technique.Cancer Med2023;12:1501-19 PMCID:PMC9883536

[63] Wang Z,Liu L,Mu L.Machine learning model for prediction of low anterior resection syndrome following laparoscopic anterior resection of rectal cancer: a multicenter study.World J Gastroenterol2023;29:2979-91 PMCID:PMC10237089

[64] Wang K,Zhang F,Gao L.Combined application of inflammation-related biomarkers to predict postoperative complications of rectal cancer patients: a retrospective study by machine learning analysis.Langenbecks Arch Surg2023;408:400

[65] Lin V,Allakhverdiiev E.Training prediction models for individual risk assessment of postoperative complications after surgery for colorectal cancer.Tech Coloproctol2022;26:665-75

[66] Wei R,Liu E.Development of a machine learning algorithm to predict complications of total laparoscopic anterior resection and natural orifice specimen extraction surgery in rectal cancer.Eur J Surg Oncol2023;49:1258-68

[67] Merath K,Mehta R.Use of machine learning for prediction of patient risk of postoperative complications after liver, pancreatic, and colorectal surgery.J Gastrointest Surg2020;24:1843-51

[68] Francis NK,Salib E.The use of artificial neural networks to predict delayed discharge and readmission in enhanced recovery following laparoscopic colorectal cancer surgery.Tech Coloproctol2015;19:419-28

[69] Manilich E,Kiran RP,Seyidova-Khoshknabi D.Key factors associated with postoperative complications in patients undergoing colorectal surgery.Dis Colon Rectum2013;56:64-71

[70] Liu Y,Tian Z.Identification of high-risk patients for postoperative myocardial injury after CME using machine learning: a 10-year multicenter retrospective study.Int J Gen Med2023;16:1251-64 PMCID:PMC10089277

[71] Chen KA,Stem JM,Gomez SM.Improved prediction of surgical-site infection after colorectal surgery using machine learning.Dis Colon Rectum2023;66:458-66 PMCID:PMC10069984

[72] Ohno Y,Udo R.Preliminary evaluation of a novel artificial intelligence-based prediction model for surgical site infection in colon cancer.Cancer Diagn Progn2022;2:691-6 PMCID:PMC9628146

[73] Masum S,Stefan S,Khan J.Data analytics and artificial intelligence in predicting length of stay, readmission, and mortality: a population-based study of surgical management of colorectal cancer.Discov Oncol2022;13:11 PMCID:PMC8885960

[74] Ashraf Ganjouei A,Conroy PC.A novel machine learning approach to predict textbook outcome in colectomy.Dis Colon Rectum2024;67:322-32

[75] Guidolin K,Zorigtbaatar A,Quereshy F.A machine learning model to predict the need for conversion of operative approach in patients undergoing colectomy for neoplasm.Cancer Rep2024;7:e1917 PMCID:PMC10809191

[76] Ruan X,Storlie CB,Larson DW.Real-time risk prediction of colorectal surgery-related post-surgical complications using GRU-D model.J Biomed Inform2022;135:104202

[77] Weller GB,Larson DW,Huebner M.Leveraging electronic health records for predictive modeling of post-surgical complications.Stat Methods Med Res2018;27:3271-85

[78] Chen D,Sohn S.Postoperative bleeding risk prediction for patients undergoing colorectal surgery.Surgery2018;164:1209-16 PMCID:PMC6263850

[79] Soguero-Ruiz C,Rojo-Alvarez JL.Support vector feature selection for early detection of anastomosis leakage from bag-of-words in electronic health records.IEEE J Biomed Health Inform2016;20:1404-15

[80] Jo YY,Park HW.Prediction of prolonged length of hospital stay after cancer surgery using machine learning on electronic health records: retrospective cross-sectional study.JMIR Med Inform2021;9:e23147 PMCID:PMC7939945

[81] Strömblad CT,Meisami A.Effect of a predictive model on planned surgical duration accuracy, patient wait time, and use of presurgical resources: a randomized clinical trial.JAMA Surg2021;156:315-21 PMCID:PMC7841577

[82] He K,Ren S. Deep residual learning for image recognition. ArXiv. [Preprint.] Dec 10, 2015 [accessed on 2024 Oct 30]. Available from: https://doi.org/10.48550/arXiv.1512.03385.