Augmented reality: the smart way to guide robotic urologic surgery

Abstract

The development of a tailored, patient-specific medical and surgical approach is becoming the object of intense research. In robotic urologic surgery, where a clear understanding of case-specific surgical anatomy is considered a key point to optimizing the perioperative outcomes, such philosophy has gained increasing importance. Recently, significant advances in three-dimensional (3D) virtual modeling technologies have fueled the interest in their application in the field of robotic minimally invasive surgery for kidney and prostate tumors. The aim of the review is to provide a synthesis of current applications of 3D virtual models for robot-assisted radical prostatectomy and partial nephrectomy. Medline, PubMed, the Cochrane Database, and Embase were screened for literature regarding the use of 3D augmented reality (AR) during robot-assisted radical prostatectomy and partial nephrectomy. The use of 3D AR models for intraoperative surgical navigation has been tested in prostate and kidney surgery. Its application during robot-assisted radical prostatectomy has been reported by different groups as influencing the positive surgical margins rate and guiding selective bundle biopsy. In robot-assisted partial nephrectomy, AR guidance improves surgical strategy, leading to higher selective clamping, less healthy parenchyma loss, and better postoperative kidney function. In conclusion, the available literature suggests a potentially crucial role of 3D AR technology in improving perioperative results of robot-assisted urological procedures. In the future, artificial intelligence may represent the key to further improving this promising technology.

Keywords

Augmented reality / three-dimensional models / robotics / radical prostatectomy / partial nephrectomy

References

[1] Zargar H,Laydner H.Anatomy of contemporary partial nephrectomy: a dissection of the available evidence.Eur Urol2015;68:993-5

[2] Autorino R,Dasgupta P.Precision surgery and genitourinary cancers.Eur J Surg Oncol2017;43:893-908

[3] Ficarra V,Rossanese M.Computed tomography features predicting aggressiveness of malignant parenchymal renal tumors suitable for partial nephrectomy.Minerva Urol Nephrol2021;73:17-31

[4] Porpiglia F,Checcucci E,Autorino R.Development and validation of 3D printed virtual models for robot-assisted radical prostatectomy and partial nephrectomy: urologists’ and patients’ perception.World J Urol2018;36:201-7.

[5] Veneziano D,Cacciamani G.Uro-technologySoMe Working Group of the Young Academic Urologists Working Party of the European Association of UrologyEuropean Section of Uro-technologyClimbing over the barriers of current imaging technology in urology.Eur Urol2020;77:142-3

[6] Ukimura O,Nakamoto M.Three-dimensional surgical navigation model with TilePro display during robot-assisted radical prostatectomy.J Endourol2014;28:625-30

[7] Antonelli A,Palumbo C.Holographic reconstructions for preoperative planning before partial nephrectomy: a head-to-head comparison with standard CT scan.Urol Int2019;102:212-7

[8] Tang SL,Teo MY,Ling KV.Augmented reality systems for medical applications.IEEE Eng Med Biol Mag1998;17:49-58

[9] Ukimura O.Augmented reality for computer- assisted image-guided minimally invasive urology.Interv Ultrason Urol2009:179-184

[10] Thompson S,Billia M,Hawkes D.Design and evaluation of an image-guidance system for robot-assisted radical prostatectomy.BJU Int2013;111:1081-90

[11] Porpiglia F,Checcucci E,Bertolo R.Augmented reality robot-assisted radical prostatectomy: preliminary experience.Urology2018;115:184

[12] Porpiglia F,Amparore D.Augmented-reality robot-assisted radical prostatectomy using hyper-accuracy three-dimensional reconstruction (HA3D™) technology: a radiological and pathological study.BJU Int2019;123:834-45

[13] Porpiglia F,Amparore D,Massa F.Three-dimensional elastic augmented-reality robot-assisted radical prostatectomy using hyperaccuracy three-dimensional reconstruction technology: a step further in the identification of capsular involvement.Eur Urol2019;76:505-14

[14] Schiavina R,Lodi S.Real-time augmented reality three-dimensional guided robotic radical prostatectomy: preliminary experience and evaluation of the impact on surgical planning.Eur Urol Focus2021;7:1260-7

[15] Wake N,Rostami P,Huang WC.Three-dimensional printing and augmented reality: enhanced precision for robotic assisted partial nephrectomy.Urology2018;116:227-8

[16] Porpiglia F,Amparore D.Three-dimensional augmented reality robot-assisted partial nephrectomy in case of complex tumours (PADUA ≥10): a new intraoperative tool overcoming the ultrasound guidance.Eur Urol2020;78:229-38

[17] Schiavina R,Chessa F.Augmented reality to guide selective clamping and tumor dissection during robot-assisted partial nephrectomy: a preliminary experience.Clin Genitourin Cancer2021;19:e149-55

[18] Kobayashi S,Huaulmé A.Assessment of surgical skills by using surgical navigation in robot-assisted partial nephrectomy.Int J Comput Assist Radiol Surg2019;14:1449-59

[19] Kobayashi S,Mutaguchi J.Surgical navigation improves renal parenchyma volume preservation in robot-assisted partial nephrectomy: a propensity score matched comparative analysis.J Urol2020;204:149-56

[20] Michiels C,Prudhomme T.3D-Image guided robotic-assisted partial nephrectomy: a multi-institutional propensity score-matched analysis (UroCCR study 51).World J Urol2021;

[21] Kavoussi NL,Ferguson JM.Accuracy of touch-based registration during robotic image-guided partial nephrectomy before and after tumor resection in validated phantoms.J Endourol2021;35:362-8 PMCID:PMC7987368

[22] Amparore D,Piazzolla P.Indocyanine green drives computer vision based 3d augmented reality robot assisted partial nephrectomy: the beginning of “automatic” overlapping era.Urology2022;164:e312-6

[23] Checcucci E,Cacciamani GE.Uro-technology and SoMe Working Group of the Young Academic Urologists Working Party of the European Association of UrologyArtificial intelligence and neural networks in urology: current clinical applications.Minerva Urol Nefrol2020;72:49-57

[24] Houshyar R,Bui TL.Outcomes of artificial intelligence volumetric assessment of kidneys and renal tumors for preoperative assessment of nephron-sparing interventions.J Endourol2021;35:1411-8

[25] Vezzetti E,Tornincasa S,Dagnes N.3D geometry-based automatic landmark localization in presence of facial occlusions.Multimed Tools Appl2018;77:14177-205

[26] Bertolo R,Porpiglia F,Schleicher M.Systematic review of augmented reality in urological interventions: the evidences of an impact on surgical outcomes are yet to come.World J Urol2020;38:2167-76

[27] Roberts S,Checcucci E,Taratkin M.“Augmented reality” applications in urology: a systematic review.Minerva Urol Nephrol2022;74:528-37