Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot study

Abstract

Projecting images of a surgical site onto a patient’s face may allow quicker, more precise dental surgery, scientists in Japan report. Dental and facial surgery is anatomically complex, with underlying structures and tissues often hidden from view. Surgeons can view an individual’s two-dimensional (2D) scans on computer monitors during surgery, but this is time-consuming. Hideyuki Suenaga and colleagues at the University of Tokyo have developed a way to superimpose 3D anatomical images directly onto a patient’s face during surgery. Their augmented reality system uses data from CT and MRI scans to generate a series of points mapped in 3D space. The image is then projected using lenses and mirrors that can be viewed at any angle without special glasses. The technology is accurate to within one millimeter and uses optical tracking to update when a patient moves.

Keywords

augmented reality / computed tomography / integral videography / three-dimensional image

References

[1] Casap N, Wexler A, Elisha R. Computerized navigation for surgery of the lower jaw: comparison of 2 navigation systems. J Oral Maxillofac Surg, 2008, 66(7): 1467-1475.

[2] Nijmeh AD, Goodger NM, Hawkes D. Image-guided navigation in oral and maxillofacial surgery. Br J Oral Maxillofac Surg, 2005, 43(4): 294-302.

[3] Tran HH, Suenaga H, Kuwana K. Augmented reality system for oral surgery using 3D auto stereoscopic visualization. Med Image Comput Assist Interv, 2011, 14(Pt 1): 81-88.

[4] Lubbers HT, Matthews F, Damerau G. No plane is the best one-the volume is!. Oral Surg Oral Med Oral Pathol Oral Radiol Endod, 2011, 113(3): 421.

[5] Traub J, Sielhorst T, Heining SM. Advanced display and visualization concepts for image guided surgery. J Display Technol, 2008, 4(4): 483-490.

[6] Liao H, Hata N, Nakajima S. Surgical navigation by autostereoscopic image overlay of integral videography. IEEE Trans Inf Technol Biomed, 2004, 8(2): 114-121.

[7] Liao H, Inomata T, Sakuma I. 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay. IEEE Trans Biomed Eng, 2010, 7(6): 1476-1486.

[8] Tran HH, Matsumiya K, Masamune K. Interactive 3-D navigation system for image-guided surgery. Int J Virtual Real, 2009, 8(1): 9-16.

[9] Lubbers HT, Obwegeser JA, Matthews F. A simple and flexible concept for computer-navigated surgery of the mandible. J Oral Maxillofac Surg, 2011, 69(3): 924-930.

[10] Bettschart C, Kruse A, Matthews F. Point-to-point registration with mandibulo-maxillary splint in open and closed jaw position. Evaluation of registration accuracy for computer-aided surgery of the mandible. J Craniomaxillofac Surg, 2011, 40(7): 592-598.

[11] Krempien R, Hoppe H, Kahrs L. Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy. Int J Radiat Oncol Biol Phys, 2008, 70(3): 944-952.

[12] Marmulla R, Hoppe H, Muhling J. An augmented reality system for image-guided surgery. Int J Oral Maxillofac Surg, 2005, 34(6): 594-596.

[13] Rolland JP, Fuchs H. Optical versus video see-through head-mounted displays in medical visualization. Presence, 2000, 9(3): 287-309.