Current status and challenges of 3D navigation in partial nephrectomy

Abstract

Partial nephrectomy, a standard treatment for small renal cancers, has evolved through minimally invasive procedures such as laparoscopic and robot-assisted partial nephrectomy. The use of three-dimensional (3D) kidney models derived from preoperative computed tomography (CT) images has been investigated to improve surgical outcomes. This review explores various navigation techniques, such as 3D printing, virtual reality (VR), and augmented reality (AR), to address organ movement and deformation challenges during surgery. Despite the promising positive impact of these methods, as revealed by a systematic review in 2022, achieving the desired navigation accuracy remains elusive. The use of Virtual Reality and Augmented Reality, capable of overlaying the 3D model onto the surgical image in real-time, has shown potential. Still, we need advanced techniques, for instance, non-rigid 3D models employing nonlinear parametric deformation, to adapt to organ deformation. Additionally, the application of deep learning from artificial intelligence for high accuracy 3D navigation is an emerging area of interest. Although considerable progress has been achieved, a comprehensive, widely adoptable solution has yet to be discovered. The paper underscores the necessity for ongoing research and development in 3D navigation methods, anticipating their substantial contribution to future surgical procedures.

Keywords

Partial nephrectomy / 3D kidney models / preoperative computed tomography / virtual reality / augmented reality

References

[1] Marchioni M,Bandini M.Comparison of partial versus radical nephrectomy effect on other-cause mortality, cancer-specific mortality, and 30-day mortality in patients older than 75 years.Eur Urol Focus2019;5:467-73

[2] Zini L,Capitanio U.Radical versus partial nephrectomy: effect on overall and noncancer mortality.Cancer2009;115:1465-71

[3] Ljungberg B,Abu-Ghanem Y.European association of urology guidelines on renal cell carcinoma: the 2022 update.Eur Urol2022;82:399-410

[4] Fong KY,Lim BJH.Off-clamp vs on-clamp robot-assisted partial nephrectomy: a systematic review and meta-analysis.BJU Int2024;133:375-86

[5] Bertolo R,Simone G.Outcomes of robot-assisted partial nephrectomy for clinical T2 renal tumors: a multicenter analysis (ROSULA Collaborative Group).Eur Urol2018;74:226-32

[6] Delto JC,Helbig MW.Robot-assisted partial nephrectomy for large renal masses: a multi-institutional series.BJU Int2018;121:908-15

[7] Vartolomei MD,Fajkovic H.Robot-assisted partial nephrectomy mid-term oncologic outcomes: a systematic review.J Clin Med2022;11:6165 PMCID:PMC9605111

[8] Springer C,Fajkovic H.Laparoscopic vs open partial nephrectomy for T1 renal tumours: evaluation of long-term oncological and functional outcomes in 340 patients.BJU Int2013;111:281-8

[9] Mullerad M,Adusumilli PS,Sabo E.Comparison of nephron-sparing surgery in central versus peripheral renal tumors.Urology2005;65:467-72

[10] Qin B,Lu Y.Intraoperative ultrasonography in laparoscopic partial nephrectomy for intrarenal tumors.PLoS One2018;13:e0195911 PMCID:PMC5919508

[11] Checcucci E,Micali S.Three-dimensional model reconstruction: the need for standardization to drive tailored surgery.Eur Urol2022;81:129-31

[12] Fan G,Li M.Three-dimensional physical model-assisted planning and navigation for laparoscopic partial nephrectomy in patients with endophytic renal tumors. Sci Rep 2018;8:582. PMCID:PMC5766569

[13] Amparore D,Checcucci E.3D imaging technologies in minimally invasive kidney and prostate cancer surgery: which is the urologists’ perception?.Minerva Urol Nephrol2022;74:178-85

[14] Piramide F,Cacciamani G.European Association of Urology Young Academic Urologists and the European Section of Uro-TechnologyThree-dimensional model-assisted minimally invasive partial nephrectomy: a systematic review with meta-analysis of comparative studies.Eur Urol Oncol2022;5:640-50

[15] Bertolo R,Mir MC.Kidney Cancer EAU Edu Platform UROONCOThree-dimensional models-assisted minimally-invasive partial nephrectomy: looking forward to more evidence.Minerva Urol Nephrol2023;75:665-6

[16] Porpiglia F, Bertolo R, Checcucci E, et al; ESUT Research Group. Development and validation of 3D printed virtual models for robot-assisted radical prostatectomy and partial nephrectomy: urologists’ and patients’ perception. World J Urol 2018;36:201-7.

[17] Maddox MM,Liu J,Thomas R.3D-printed soft-tissue physical models of renal malignancies for individualized surgical simulation: a feasibility study.J Robot Surg2018;12:27-33

[18] Fan G,Zhu S.Three-dimensional printing for laparoscopic partial nephrectomy in patients with renal tumors.J Int Med Res2019;47:4324-32 PMCID:PMC6753553

[19] Yamazaki M,Fujita A.3D printed kidney model could be an important educational tool for residents.Asian J Endosc Surg2023;16:197-202

[20] Fujisaki A,Yamazaki M.Utilization of a three-dimensional printed kidney model for favorable TRIFECTA achievement in early experience of robot-assisted partial nephrectomy.Transl Androl Urol2020;9:2697-704 PMCID:PMC7807304

[21] Moglia A,Morelli L,Mosca F.A systematic review of virtual reality simulators for robot-assisted surgery.Eur Urol2016;69:1065-80

[22] Michiels C,Prudhomme T.3D-Image guided robotic-assisted partial nephrectomy: a multi-institutional propensity score-matched analysis (UroCCR study 51).World J Urol2023;41:303-13

[23] Kihara K,Komai Y.Integrated image monitoring system using head-mounted display for gasless single-port clampless partial nephrectomy.Wideochir Inne Tech Maloinwazyjne2014;9:634-7 PMCID:PMC4280407

[24] Wu X,Wu G.Comparison of three dimensional reconstruction and conventional computer tomography angiography in patients undergoing zero-ischemia laparoscopic partial nephrectomy.BMC Med Imaging2020;20:47 PMCID:PMC7201555

[25] Ukimura O.Imaging-assisted endoscopic surgery: Cleveland Clinic experience.J Endourol2008;22:803-10

[26] Li L,Yang C,Hu Z.Three-dimensional (3D) reconstruction and navigation in robotic-assisted partial nephrectomy (RAPN) for renal masses in the solitary kidney: a comparative study.Int J Med Robot2022;18:e2337

[27] Porpiglia F,Amparore D.Three-dimensional augmented reality robot-assisted partial nephrectomy in case of complex tumours (PADUA ≥10): a new intraoperative tool overcoming the ultrasound guidance.Eur Urol2020;78:229-38

[28] Teber D,Simpfendörfer T.Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results.Eur Urol2009;56:332-8

[29] Komai Y,Gotohda N,Kawakami S.A novel 3-dimensional image analysis system for case specific kidney anatomy and surgical simulation to facilitate clampless partial nephrectomy.Urology2014;83:500-6

[30] Amparore D,Verri P.New generation of 3D virtual models with perfusional zones: perioperative assistance for the best pedicle management during robotic partial nephrectomy.Curr Oncol2023;30:4021-32 PMCID:PMC10136700

[31] Simpfendörfer T,Hatiboglu G.Intraoperative computed tomography imaging for navigated laparoscopic renal surgery: first clinical experience.J Endourol2016;30:1105-11

[32] Schiavina R,Chessa F.Augmented reality to guide selective clamping and tumor dissection during robot-assisted partial nephrectomy: a preliminary experience.Clin Genitourin Cancer2021;19:e149-55

[33] Amparore D,Checcucci E.Three-dimensional virtual models of the kidney with colored perfusion regions: a new algorithm-based tool for optimizing the clamping strategy during robot-assisted partial nephrectomy.Eur Urol2023;84:418-25

[34] Tzelnick S,Sahovaler A.Skull-base surgery-a narrative review on current approaches and future developments in surgical navigation.J Clin Med2023;12:2706 PMCID:PMC10095207

[35] Shenaq DS.Virtual planning and navigational technology in reconstructive surgery.J Surg Oncol2018;118:845-52

[36] Grauvogel TD,Semper-Hogg W,Laszig R.Navigation accuracy after automatic- and hybrid-surface registration in sinus and skull base surgery.PLoS One2017;12:e0180975 PMCID:PMC5507282

[37] Zhang W,Chen X.Morphologic change of in vivo porcine liver under 13 mmHg pneumoperitoneum pressure.Surg Laparosc Endosc Percutan Tech2021;31:679-84

[38] Okada T,Sumii A.Stereotactic navigation for rectal surgery: comparison of 3-dimensional C-arm-based registration to paired-point registration.Dis Colon Rectum2020;63:693-700

[39] Chen Y,Wu D,Liu C.Surgical planning and manual image fusion based on 3D model facilitate laparoscopic partial nephrectomy for intrarenal tumors.World J Urol2014;32:1493-9

[40] Amparore D,Checcucci E.Three-dimensional virtual models’ assistance during minimally invasive partial nephrectomy minimizes the impairment of kidney function.Eur Urol Oncol2022;5:104-8

[41] Kong SH,Soares R.Robust augmented reality registration method for localization of solid organs’ tumors using CT-derived virtual biomechanical model and fluorescent fiducials.Surg Endosc2017;31:2863-71

[42] Joeres F,Hansen C.Laparoscopic augmented reality registration for oncological resection site repair.Int J Comput Assist Radiol Surg2021;16:1577-86 PMCID:PMC8354909

[43] Wild E,Schmid D.Robust augmented reality guidance with fluorescent markers in laparoscopic surgery.Int J Comput Assist Radiol Surg2016;11:899-907

[44] Kobayashi S,Mutaguchi J.Surgical navigation improves renal parenchyma volume preservation in robot-assisted partial nephrectomy: a propensity score matched comparative analysis.J Urol2020;204:149-56

[45] Puerto-Souza GA,Mariottini GL.Toward long-term and accurate augmented-reality for monocular endoscopic videos.IEEE Trans Biomed Eng2014;61:2609-20

[46] Roberts S,Checcucci E.“Augmented reality” applications in urology: a systematic review.Minerva Urol Nephrol2022;74:528-37

[47] Jia T,Chen X.Long term and robust 6DoF motion tracking for highly dynamic stereo endoscopy videos.Comput Med Imaging Graph2021;94:101995

[48] Padovan E,Tanzi L.A deep learning framework for real-time 3D model registration in robot-assisted laparoscopic surgery.Int J Med Robot2022;18:e2387 PMCID:PMC9286374

[49] Su LM,Agarwal R,Taylor RH.Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration.Urology2009;73:896-900

[50] Zampokas G,Peleka G,Malasiotis S.Real-time 3D reconstruction in minimally invasive surgery with quasi-dense matching. In:2018 IEEE International Conference on Imaging Systems and Techniques (IST); 2018 Oct 16-18; Krakow, Poland. IEEE; 2018. pp. 1-6.

[51] Zampokas G,Tsiolis K,Mariolis I.Real-time stereo reconstruction of intraoperative scene and registration to preoperative 3D models for augmenting surgeons’ view during RAMIS.Med Phys2022;49:6517-26

[52] Yip MC,Salcudean SE,Nguan CY.Tissue tracking and registration for image-guided surgery.IEEE Trans Med Imaging2012;31:2169-82

[53] Zhang X,Fan Y,Wang T.Autostereoscopic 3D augmented reality navigation for laparoscopic surgery: a preliminary assessment.IEEE Trans Biomed Eng2023;70:1413-21

[54] Kokko MA,Seigne JD.A particle filter approach to dynamic kidney pose estimation in robotic surgical exposure.Int J Comput Assist Radiol Surg2022;17:1079-89

[55] Camara M,Darzi A.Soft tissue deformation for surgical simulation: a position-based dynamics approach.Int J Comput Assist Radiol Surg2016;11:919-28 PMCID:PMC4893362