Artificial intelligence for decision support in surgical oncology - a systematic review

Abstract

Aim: We systematically review current clinical applications of artificial intelligence (AI) that use machine learning (ML) methods for decision support in surgical oncology with an emphasis on clinical translation.

Methods: MEDLINE, Web of Science, and CENTRAL were searched on 19 January 2021 for a combination of AI and ML-related terms, decision support, and surgical procedures for abdominal malignancies. Data extraction included study characteristics, description of algorithms and their respective purpose, and description of key steps for scientific validation and clinical translation.

Results: Out of 8302 articles, 107 studies were included for full-text analysis. Most of the studies were conducted in a retrospective setting (n = 105, 98%), with 45 studies (42%) using data from multiple centers. The most common tumor entities were colorectal cancer (n = 35, 33%), liver cancer (n = 21, 20%), and gastric cancer (n = 17, 16%). The most common prediction task was survival (n = 36, 34%), with artificial neural networks being the most common class of ML algorithms (n = 52, 49%). Key reporting and validation steps included, among others, a complete listing of patient features (n = 95, 89%), training of multiple algorithms (n = 73, 68%), external validation (n = 13, 12%), prospective validation (n = 2, 2%), robustness in terms of cross-validation or resampling (n = 89, 83%), treatment recommendations by ML algorithms (n = 9, 8%), and development of an interface (n = 12, 11%).

Conclusion: ML for decision support in surgical oncology is receiving increasing attention with promising results, but robust and prospective clinical validation is mostly lacking. Furthermore, the integration of ML into AI applications is necessary to foster clinical translation.

Keywords

Artificial intelligence / machine learning / decision support / surgical data science / surgery / abdominal cancer

References

[1] Bray F,Soerjomataram I,Torre LA.Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.CA Cancer J Clin2018;68:394-424

[2] Sullivan R,Anderson BO.Global cancer surgery: delivering safe, affordable, and timely cancer surgery.Lancet Oncol2015;16:1193-224

[3] Knight SR,Pius R.Global variation in postoperative mortality and complications after cancer surgery: a multicentre, prospective cohort study in 82 countries.The Lancet2021;397:387-97 PMCID:PMC7846817

[4] Jones RP.Resection of liver metastases in colorectal cancer in the era of expanding systemic therapy.Annu Rev Med2017;68:183-96

[5] Keller DS,Perez RO,Chand M.The multidisciplinary management of rectal cancer.Nat Rev Gastroenterol Hepatol2020;17:414-29

[6] Prades J,van Hoof E.Is it worth reorganising cancer services on the basis of multidisciplinary teams (MDTs)?.Health Policy2015;119:464-74

[7] Hansen MFC,Hansen CP.The results of pancreatic operations after the implementation of multidisciplinary team conference (MDT): a quality improvement study.Int J Surg2020;77:105-10

[8] Hashimoto DA,Rus D.Artificial intelligence in surgery: promises and perils.Ann Surg2018;268:70-6 PMCID:PMC5995666

[9] Maier-Hein L,Speidel S.Surgical data science for next-generation interventions.Nat Biomed Eng2017;1:691-6

[10] Mitchell TM. Machine learning. 1st ed. USA: McGraw-Hill, Inc.; 1997.

[11] Kernbach JM.Machine learning-based clinical prediction modeling - a practical guide for clinicians.arXiv2020;11:37

[12] Willems JL,Arnaud P.The diagnostic performance of computer programs for the interpretation of electrocardiograms.N Engl J Med1991;325:1767-73

[13] Singh R,Nitiwarangkul C.Deep learning in chest radiography: detection of findings and presence of change.PLoS One2018;13:e0204155 PMCID:PMC6171827

[14] Ahmad OF,Mazomenos E.Artificial intelligence and computer-aided diagnosis in colonoscopy: current evidence and future directions.Lancet Gastroenterol Hepatol2019;4:71-80

[15] Pereira SP,Ney A.Early detection of pancreatic cancer.2020;5:698-710 PMCID:PMC7380506

[16] Christodoulou E,Collins GS,Verbakel JY.A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models.J Clin Epidemiol2019;110:12-22

[17] Jin P,Kang W.Artificial intelligence in gastric cancer: a systematic review.J Cancer Res Clin Oncol2020;146:2339-50

[18] Pantelis AG,Lapatsanis DP.A scoping review of artificial intelligence and machine learning in bariatric and metabolic surgery: current status and future perspectives.Obes Surg2021;31:4555-63

[19] Maier-Hein L,Sarikaya D.Surgical data science - from concepts toward clinical translation.Med Image Anal2022;76:102306 PMCID:PMC9135051

[20] Henn J,Schmid M,Matthaei H.Machine learning to guide clinical decision-making in abdominal surgery-a systematic literature review.Langenbecks Arch Surg2022;407:51-61 PMCID:PMC8847247

[21] Garrow CR,Li L.Machine learning for surgical phase recognition: a systematic review.Ann Surg2021;273:684-93

[22] Page MJ,Bossuyt PM.The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.BMJ2021;372:n71 PMCID:PMC8005924

[23] Higgins JPT,Chandler J. Cochrane Handbook for Systematic Reviews of Interventions version 6.2; 2021. Available from: https://training.cochrane.org/handbook [Last accessed on 22 Sep 2022]

[24] Kalkum E,Seide S.Systematic reviews in surgery-recommendations from the study center of the german society of surgery.Langenbecks Arch Surg2021;406:1723-31 PMCID:PMC8481197

[25] Maffulli N,Stone IW.Artificial intelligence and machine learning in orthopedic surgery: a systematic review protocol.J Orthop Surg Res2020;15:478 PMCID:PMC7570027

[26] Beam AL.Big data and machine learning in health care.JAMA2018;319:1317-8

[27] Poole D,Goebel R.Computational intelligence: a logical approach. USA: Oxford University Press, Inc.; 1997.

[28] Moons KG,Bouwmeester W.Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist.PLoS Med2014;11:e1001744 PMCID:PMC4196729

[29] Stojadinovic A,Smith D.Clinical decision support and individualized prediction of survival in colon cancer: bayesian belief network model.Ann Surg Oncol2013;20:161-74

[30] Ting W,Chang C.Developing a novel machine learning-based classification scheme for predicting SPCs in colorectal cancer survivors.Applied Sciences2020;10:1355

[31] Velez-Serrano JF,Hernandez-Barrera V.Prediction of in-hospital mortality after pancreatic resection in pancreatic cancer patients: a boosting approach via a population-based study using health administrative data.PLoS One2017;12:e0178757 PMCID:PMC5462391

[32] Bhandari M,Reddiboina M.Predicting intra-operative and postoperative consequential events using machine-learning techniques in patients undergoing robot-assisted partial nephrectomy: a Vattikuti Collective Quality Initiative database study.BJU Int2020;126:350-8

[33] Mourad M,Dezube A.Machine learning and feature selection applied to SEER data to reliably assess thyroid cancer prognosis.Sci Rep2020;10:5176 PMCID:PMC7083829

[34] Smith BJ.An interactive Bayesian model for prediction of lymph node ratio and survival in pancreatic cancer patients.J Am Med Inform Assoc2014;21:e203-11 PMCID:PMC4173165

[35] Bolourani S,Diao L.Using machine learning to predict early readmission following esophagectomy.J Thorac Cardiovasc Surg2021;161:1926-1939.e8

[36] Schoenberg MB,Koch D.A novel machine learning algorithm to predict disease free survival after resection of hepatocellular carcinoma.Ann Transl Med2020;8:434 PMCID:PMC7210189

[37] Nilsaz-Dezfouli H,Arasan J,Pourhoseingholi MA.Improving gastric cancer outcome prediction using single time-point artificial neural network models.Cancer Inform2017;16:1176935116686062 PMCID:PMC5392036

[38] Xu Y,Tong J,Yang JJ.Machine learning algorithms for predicting the recurrence of stage IV colorectal cancer after tumor resection.Sci Rep2020;10:2519 PMCID:PMC7220939

[39] Rahman SA,Lloyd MA.OCCAMS ConsortiumMachine learning to predict early recurrence after oesophageal cancer surgery.Br J Surg2020;107:1042-52 PMCID:PMC7299663

[40] Kudo SE,Villard B.Artificial intelligence system to determine risk of T1 colorectal cancer metastasis to lymph node.Gastroenterology2021;160:1075-1084.e2

[41] Li J,Lu Y,Si S.Development and validation of a Super learner-based model for predicting survival in Chinese Han patients with resected colorectal cancer.Jpn J Clin Oncol2020;50:1133-40

[42] van Soest J,van Stiphout R.Prospective validation of pathologic complete response models in rectal cancer: transferability and reproducibility.Med Phys2017;44:4961-7

[43] Adams K.Creation of an effective colorectal anastomotic leak early detection tool using an artificial neural network.Int J Colorectal Dis2014;29:437-43

[44] Ichimasa K,Mori Y.Artificial intelligence may help in predicting the need for additional surgery after endoscopic resection of T1 colorectal cancer.Endoscopy2018;50:230-40

[45] Liu C,Feng QX,Zhang YD.Performance of a machine learning-based decision model to help clinicians decide the extent of lymphadenectomy (D1 vs. D2) in gastric cancer before surgical resection.Abdom Radiol (NY)2019;44:3019-29

[46] Kang JS,Song W.Risk prediction for malignant intraductal papillary mucinous neoplasm of the pancreas: logistic regression versus machine learning.Sci Rep2020;10:20140 PMCID:PMC7676251

[47] Han IW,Ryu Y.Risk prediction platform for pancreatic fistula after pancreatoduodenectomy using artificial intelligence.World J Gastroenterol2020;26:4453-64 PMCID:PMC7438201

[48] Zhou C,Ji MH,Yang JJ.Predicting peritoneal metastasis of gastric cancer patients based on machine learning.Cancer Control2020;27:1073274820968900 PMCID:PMC7791448

[49] Lei L,Xue Q,Zhou CM.A comparative study of machine learning algorithms for predicting acute kidney injury after liver cancer resection.PeerJ2020;8:e8583 PMCID:PMC7047869

[50] Jajroudi M,Kamkar L,Sanei M.Prediction of survival in thyroid cancer using data mining technique.Technol Cancer Res Treat2014;13:353-9

[51] Merath K,Mehta R.Use of machine learning for prediction of patient risk of postoperative complications after liver, pancreatic, and colorectal surgery.J Gastrointest Surg2020;24:1843-51

[52] Tanaka T,Lilly LB,Sherman M.Identifying candidates with favorable prognosis following liver transplantation for hepatocellular carcinoma: Data mining analysis.J Surg Oncol2015;112:72-9

[53] Hermon R.Big data in healthcare: What is it used for? Proceedings of the 3rd Australian EHealth Informatics and Security Conference; 2014.

[54] Song Y,Tan W,Zhou H.Multiple machine learnings revealed similar predictive accuracy for prognosis of pnets from the surveillance, epidemiology, and end result database.J Cancer2018;9:3971-8 PMCID:PMC6218767

[55] Vasey B,Campbell B.DECIDE-AI expert groupReporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI.Nat Med2022;28:924-33

[56] Sala Elarre P,Yu KH.Use of machine-learning algorithms in intensified preoperative therapy of pancreatic cancer to predict individual risk of relapse.Cancers (Basel)2019;11:606 PMCID:PMC6562932

[57] van Stiphout RG,Buijsen J.Development and external validation of a predictive model for pathological complete response of rectal cancer patients including sequential PET-CT imaging.Radiother Oncol2011;98:126-33

[58] Rajkomar A,Kohane I.Machine learning in medicine.N Engl J Med2019;380:1347-58

[59] Gyawali B.Does global oncology need artificial intelligence?.Lancet Oncol2018;19:599-600

[60] Tian Y,Wang Z.Concordance between watson for oncology and a multidisciplinary clinical decision-making team for gastric cancer and the prognostic implications: retrospective study.J Med Internet Res2020;22:e14122 PMCID:PMC7059081

[61] Somashekhar SP,Puglielli S.Watson for oncology and breast cancer treatment recommendations: agreement with an expert multidisciplinary tumor board.Ann Oncol2018;29:418-23

[62] Nagendran M,Lovejoy CA.Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies.BMJ2020;368:m689 PMCID:PMC7190037

[63] Kawamoto K,Balas EA.Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success.BMJ2005;330:765 PMCID:PMC555881

[64] Wu Y,Liu J.Machine learning algorithms for the prediction of central lymph node metastasis in patients with papillary thyroid cancer.Front Endocrinol (Lausanne)2020;11:577537 PMCID:PMC7609926

[65] Moxey A,Newby D,Williamson M.Computerized clinical decision support for prescribing: provision does not guarantee uptake.J Am Med Inform Assoc2010;17:25-33

[66] Bouaud J,Zelek L.Health information technology: use it well, or don’t!.AMIA Annu Symp Proc2014;2014:315-24 PMCID:PMC4419891

[67] Schnelldorfer T,Liu LP,Birkett DH.Can we accurately identify peritoneal metastases based on their appearance?.Ann Surg Oncol2019;26:1795-804