Role of advanced three-dimensional visualization modalities in congenital heart surgery

Abstract

The utility of three-dimensional visualization modalities such as three-dimensional printing, augmented reality, and virtual reality has transformed the field of surgery in the past few years. These modalities have demonstrated value in preoperative planning, procedural training, and surgical guidance in many surgical specialties. This review explores the current use of three-dimensional visualization modalities in surgery and further investigates its use and potential in the subspecialty of congenital heart defect surgery.

Keywords

Three-dimensional printing / augmented reality / virtual reality / congenital heart surgery

References

[1] Bernardo A.Virtual reality and simulation in neurosurgical training.World Neurosurg2017;106:1015-29

[2] Juhnke B,Saltzman D.Use of virtual reality for pre-surgical planning in separation of conjoined twins: a case report.Proc Inst Mech Eng H2019;233:1327-32

[3] de Moraes PH,Cantín M.Anatomical reproducibility through 3D printing in cranio-maxillo-facial defects.Int J Morphol2015;33:826-30

[4] Liu ZJ,Zhang YG,Jin X.Internal fixation of complicated acetabular fractures directed by preoperative surgery with 3D printing models.Orthop Surg2017;9:257-60 PMCID:PMC6584437

[5] Cao C.Virtual or augmented reality to enhance surgical education and surgical planning.Thorac Surg Clin2019;29:329-37

[6] Low D,Dip LL,Ang BT.Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas.Br J Neurosurg2010;24:69-74

[7] Lang H.Virtual and augmented reality in liver surgery.Ann Surg2020;271:e8

[8] Zablah JE.Innovations in congenital interventional cardiology.Pediatr Clin North Am2020;67:973-93

[9] Mosso-Vázquez JL,Wiederhold BK.Virtual reality for pain management in cardiac surgery.Cyberpsychol Behav Soc Netw2014;17:371-8 PMCID:PMC4043366

[10] Herron J.Augmented reality in medical education and training.J Electron Resour Med Libr2016;13:51-5

[11] Kang X,Wilson E.Stereoscopic augmented reality for laparoscopic surgery.Surg Endosc2014;28:2227-35

[12] Jang J,Barkagan M,Menze B.Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens.PLoS One2018;13:e0205188 PMCID:PMC6175509

[13] Cheng K,Curthoys I.Development and use of augmented reality and 3D printing in consulting patient with complex skull base cholesteatoma.Virtual Phys Prototyp2017;12:241-8

[14] Currie ME,Moore JT.Augmented reality system for ultrasound guidance of transcatheter aortic valve implantation.Innovations (Phila)2016;11:31-9; discussion 39

[15] Chu MW,Peters T.Augmented reality image guidance improves navigation for beating heart mitral valve repair.Innovations (Phila)2012;7:274-81

[16] Liu J,Singh G.An augmented reality system for image guidance of transcatheter procedures for structural heart disease.PLoS One2019;14:e0219174 PMCID:PMC6602420

[17] Farooqi KM,Chelliah A.3D printing and heart failure: the present and the future.JACC Heart Fail2019;7:132-42

[18] Anwar S,Miller J.3D printing is a transformative technology in congenital heart disease.JACC Basic Transl Sci2018;3:294-312 PMCID:PMC6059001

[19] Yoo SJ,Kim EK.3D printing in medicine of congenital heart diseases.3D Print Med2015;2:3 PMCID:PMC6036784

[20] Garekar S,Chokhandre M.Clinical application and multidisciplinary assessment of three dimensional printing in double outlet right ventricle with remote ventricular septal defect.World J Pediatr Congenit Heart Surg2016;7:344-50

[21] Hoashi T,Nakata T.Utility of a super-flexible three-dimensional printed heart model in congenital heart surgery.Interact Cardiovasc Thorac Surg2018;27:749-55

[22] Betancourt LG,Agarwal A.Partial anomalous left pulmonary artery in heterotaxy syndrome. A case report and review of literature.Prog Pediatr Cardiol2021;60:101304

[23] Agarwal A. Three-dimensional printed cardiac model in assisting surgical planning in Heterotaxy patient with complex systemic and pulmonary venous drainage. Society for Cardiovascular Magnetic Resonance Conference; 2018 Jan 31 - Feb 03; Barcelona, Spain.

[24] Milano EG,Wray J.Current and future applications of 3D printing in congenital cardiology and cardiac surgery.Br J Radiol2019;92:20180389 PMCID:PMC6404827

[25] Lau I,Yeong CH.Quantitative and qualitative comparison of low- and high-cost 3D-printed heart models.Quant Imaging Med Surg2019;9:107-14 PMCID:PMC6351814

[26] McMenamin PG,McHenry CR.The production of anatomical teaching resources using three-dimensional (3D) printing technology.Anat Sci Educ2014;7:479-86

[27] Li KHC,Lee EKM.The role of 3D printing in anatomy education and surgical training: a narrative review.MedEdPublish2016;6:92

[28] Jones DB,Weinberg C,Andrews R.Three-dimensional modeling may improve surgical education and clinical practice.Surg Innov2016;23:189-95

[29] Valverde I,Gonzalez A.Three-dimensional patient-specific cardiac model for surgical planning in Nikaidoh procedure.Cardiol Young2015;25:698-704

[30] Ganguli A,Grant L.3D printing for preoperative planning and surgical training: a review.Biomed Microdevices2018;20:65

[31] Goo HW,Yoo SJ.Advanced medical use of three-dimensional imaging in congenital heart disease: augmented reality, mixed reality, virtual reality, and three-dimensional printing.Korean J Radiol2020;21:133-45 PMCID:PMC6992436

[32] Gilbert F,Mladenovska T.Print me an organ?.Sci Eng Ethics2018;24:73-91

[33] Guidance for Industry and Food and Drug Administration Staff. Technical considerations for additive manufactured medical devices. Available from: https://www.fda.gov/media/97633/download [Last accessed on 15 Dec 2021]

[34] Kim B,Mass P.A novel virtual reality medical image display system for group discussions of congenital heart disease: development and usability testing.JMIR Cardio2020;4:e20633 PMCID:PMC7755535

[35] Ayoub A.The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery.BMC Oral Health2019;19:238 PMCID:PMC6839223

[36] Mahmood F,Dorfman RG.Augmented reality and ultrasound education: initial experience.J Cardiothorac Vasc Anesth2018;32:1363-7

[37] Pfandler M,Stefan P,Weigl M.Virtual reality-based simulators for spine surgery: a systematic review.Spine J2017;17:1352-63

[38] Pushparajah K,Deng S.Virtual reality three-dimensional echocardiographic imaging for planning surgical atrioventricular valve repair.JTCVS Tech2021;7:269-77 PMCID:PMC8169455

[39] Tandon A,Batsis M.Sinus venosus defects: anatomic variants and transcatheter closure feasibility using virtual reality planning.JACC Cardiovasc Imaging2019;12:921-4

[40] Ayerbe VMC,Rojas CJL.Visualization of 3D models through virtual reality in the planning of congenital cardiothoracic anomalies correction: an initial experience.World J Pediatr Congenit Heart Surg2020;11:627-9

[41] Ong CS,Huang CY.Role of virtual reality in congenital heart disease.Congenit Heart Dis2018;13:357-61

[42] Knecht S,Cattin P,Kühne M.State-of-the-art multimodality approach to assist ablations in complex anatomies-from 3D printing to virtual reality.Pacing Clin Electrophysiol2019;42:101-3

[43] Chen X.A review of haptic simulator for oral and maxillofacial surgery based on virtual reality.Expert Rev Med Devices2018;15:435-44

[44] Kim Y,Kim YO.Virtual reality and augmented reality in plastic surgery: a review.Arch Plast Surg2017;44:179-87 PMCID:PMC5447526

[45] Ender J,Mukherjee C.Value of augmented reality-enhanced transesophageal echocardiography (TEE) for determining optimal annuloplasty ring size during mitral valve repair.Ann Thorac Surg2008;86:1473-8

[46] Opolski MP,Borucki BA,Szumowski Ł.Augmented-reality computed tomography-guided transcatheter pacemaker implantation in dextrocardia and congenitally corrected transposition of great arteries.Cardiol J2018;25:412-3

[47] Salavitabar A,Lu JC,Axelrod DM.Emerging 3D technologies and applications within congenital heart disease: teach, predict, plan and guide.Future Cardiol2020;16:695-709

[48] Vávra P,Zonča P.Recent development of augmented reality in surgery: a review.J Healthc Eng2017;2017:4574172 PMCID:PMC5585624

[49] Choi H,Masamune K,Hong J.An effective visualization technique for depth perception in augmented reality-based surgical navigation.Int J Med Robot2016;12:62-72

[50] Brun H,Suther LKR.Mixed reality holograms for heart surgery planning: first user experience in congenital heart disease.Eur Heart J Cardiovasc Imaging2019;20:883-8

[51] Ye W,Li T,Yang L.Mixed-reality hologram for diagnosis and surgical planning of double outlet of the right ventricle: a pilot study.Clin Radiol2021;76:237.e1-7

[52] Mitsuno D,Akamatsu J,Okamoto T.Telementoring demonstration in craniofacial surgery with hololens, Skype, and three-layer facial models.J Craniofac Surg2019;30:28-32