Augmented Reality in Dentistry

Abstract

Human-computer interaction is a dynamically developing field of science. The continuous improvement of technologies make it possible to create innovative user interface paradigms. The globalization of virtual reality has led to the introduction of a new term “augmented reality”. While current user interface technologies are focused mainly on human-computer interaction, augmented reality with the help of computer technologies offers the improvement of the interface between humans and the real world around them. Virtual and augmented reality technologies can be used in dentistry, including implantology and planning of maxillofacial procedures and surgeries. A scientific review shows that augmented reality glasses allow the surgeon (doctor) to perform guided surgery with or without tracking or with translucent screens. Currently, augmented reality is already finding applications in various areas of dentistry, but there is no widespread implementation of augmented reality technology in dentistry and medicine in general, as it is necessary to achieve a certain level of training of doctors.

The article reviews the current technologies of augmented reality application in medical practice, presents recent advances in the development and application of augmented reality methods over the past 10 years in educational and practical medical activities. The basic principles of the augmented reality method are described and the main software and hardware solutions for the implementation of this method in medicine are analyzed.

The development of augmented reality technologies opens new horizons and provides unique opportunities in various fields of medicine. However, due to low awareness of the operating options of new technologies, doctors have a lack of trust in them. To fully realize the potential of augmented reality in medical practice, it is necessary to adapt and implement the theoretical foundations of this technology in the training of specialists and help them see the real benefits of this innovative technology in their work.

Keywords

tracking / visualization / detector / descriptor / matcher / augmented reality / virtual reality / marker

References

[1] Rekimoto J, Nagao K. The world through the computer: Computer augmented interaction with real world environments. Proceedings of the 8th annual ACM symposium on User interface and software technology. ACM, 1995. P. 29–36. doi: 10.1145/215585.215639

[2] Rekimoto J., Nagao K. The world through the computer: Computer augmented interaction with real world environments // Proceedings of the 8th annual ACM symposium on User interface and software technology. ACM, 1995. P. 29–36. doi: 10.1145/215585.215639

[3] Makeev SN, Makeev AN. Genesis of the concept of augmented reality. Teaching experiment in education. 2013;(4(68)):8–14. EDN: RXAKTF

[4] Макеев С.Н., Макеев А.Н. Генезис понятия расширенной реальности // Учебный эксперимент в образовании. 2013. № 4(68). С. 8–14. EDN: RXAKTF

[5] Milgram P, Kishino F. A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems. 1994;E77-D(12(12)):1321–1329.

[6] Milgram P., Kishino F. A taxonomy of mixed reality visual displays // IEICE Transactions on Information Systems. 1994. Vol. E77-D, N 12(12). P. 1321–1329.

[7] Azuma R. A survey of augmented reality. Presence: Teleoperators and Virtual Environments. 1997;6(4):355–385. doi: 10.1162/pres.1997.6.4.355

[8] Azuma R. A Survey of Augmented Reality // Presence: Teleoperators and Virtual Environments. 1997. Vol. 6, N 4. P. 355–385. doi: 10.1162/pres.1997.6.4.355

[9] Gurevich P, Lanir J, Cohen B. Design and implementation of teleadvisor: a projection-based augmented reality system for remote collaboration. Comput Supported Coop Work. 2015;24:527–562. doi: 10.1007/s10606-015-9232-7

[10] Gurevich P., Lanir J., Cohen B. Design and Implementation of TeleAdvisor: a Projection-Based Augmented Reality System for Remote Collaboration // Comput Supported Coop Work. 2015. Vol. 24. P. 527–562. doi: 10.1007/s10606-015-9232-7

[11] Livingston MA, Zanbaka C, Swan JE, Smallman HS. Objective measures for the effectiveness of augmented reality. Proceedings of the Virtual Reality conference (VR 2005), Bonn (Germany), 12-16 March 2005. P. 287–288. doi: 10.1109/vr.2005.59

[12] Livingston M.A., Zanbaka C., Swan J.E., Smallman H.S. Objective measures for the effectiveness of augmented reality // Proceedings of the Virtual Reality conference (VR 2005), Bonn (Germany), 12-16 March 2005. P. 287–288. doi: 10.1109/vr.2005.59

[13] Zhang W, Han B, Hui P. Jaguar: low latency mobile augmented reality with flexible tracking. Proceedings of the 26th ACM international conference on Multimedia. 2018. P. 355–363. doi: 10.1145/3240508.3240561

[14] Zhang, W., Han B., Hui P. Jaguar: Low Latency Mobile Augmented Reality with Flexible Tracking // Proceedings of the 26th ACM international conference on Multimedia. 2018. P. 355–363. doi: 10.1145/3240508.3240561

[15] Vizilter YuV, Zheltov SYu, Bondarenko AV, et al. Image processing and analysis in machine vision problems. Course of lectures and practical classes. Moscow: Fizmatkniga; 2010. 672 p. (In Russ.) EDN: QMVOKV

[16] Визильтер Ю.В., Желтов С.Ю., Бондаренко А.В., и др. Обработка и анализ изображений в задачах машинного зрения Курс лекций и практических занятий. Москва: Физматкнига, 2010. 672 c. EDN: QMVOKV

[17] Chebotareva EN, Aksyonov SV. Finding a given object on a video using parallel computing. In: Youth and modern information technologies: collected papers of the XII All-Russian scientific and practical conference of students, graduate students and young scientists, Tomsk, November 12-14, 2014. In 2 vols. Tomsk, 2014. Vol. 2. P. 247–248. (In Russ.)

[18] Чеботарева Е.Н., Аксёнов С.В. Нахождение заданного объекта на видео с помощью параллельных вычислений. В кн.: Молодежь и современные информационные технологии: сборник трудов XII Всероссийской научно-практической конференции студентов, аспирантов и молодых ученых, г. Томск, 12–14 ноября 2014 г.: в 2 т. Томск: Изд-во ТПУ, 2014. Т. 2. С. 247–248.

[19] Lewis JP. Fast template matching. Vision Interface 95, Canadian Image Process in grand Pattern Recognition Society, Quebec City, Canada, May 15-19, 1995. P. 120–123.

[20] Lewis J.P. Fast template matching // Vision Interface 95, Canadian Image Process in grand Pattern Recognition Society, Quebec City, Canada, May 15-19, 1995. P. 120–123.

[21] Yemez Y, Schmitt F. 3D reconstruction of real objects with high resolution shape and texturе. Image and Vision computing. 2004;22(13):1137–1153. doi: 10.1016/j.imavis.2004.06.001

[22] Yemez Y., Schmitt F. 3D reconstruction of real objects with high resolution shape and texturе // Image and Vision computing. 2004. Vol. 22, N 13. P. 1137–1153. doi: 10.1016/j.imavis.2004.06.001

[23] Bay H, Tuytelaars T, Van Gool L. Surf: Speeded up robust features. Proceedings of the 9th European conference on Computer Vision. Lecture Notes in Computer Science.2006;3951(3):404–417. doi: 10.1007/11744023_32

[24] Bay H., Tuytelaars T., Van Gool L. Surf: Speeded up robust features // Proceedings of the 9th European conference on Computer Vision. Lecture Notes in Computer Science. 2006. Vol. 3951, N 3. P. 404–417. doi: 10.1007/11744023_32

[25] Burns JB, Hanson AR, Riseman EM. Extracting straight lines. IEEE Trans Pattern Anal Mach Intell. 1986;(4):425–455. doi: 10.1016/b978-0-08-051581-6.50023-4

[26] Burns J.B., Hanson A.R., Riseman E.M. Extracting straight lines // IEEE Trans Pattern Anal Mach Intell. 1986. N 4. P. 425–455. doi: 10.1016/b978-0-08-051581-6.50023-4

[27] Mitchell M. An introduction to genetic algorithms. MIT press, 1998.

[28] Canny J. A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell. 1986;8(6):679–698. doi: 10.1016/b978-0-08-051581-6.50024-6

[29] Canny J. A computational approach to edge detection // IEEE Trans Pattern Anal Mach Intell. 1986. Vol. 8, N 6. P. 679–698. doi: 10.1016/b978-0-08-051581-6.50024-6

[30] Blagoveshchenskiy IA, Demyankov NA Technologies and algorithms for building the augmented reality. Modeling and analysis of information systems. 2013;20(2):129–138. EDN: QLSCED

[31] Благовещенский И.А., Демьянков Н.А. Технологии и алгоритмы для создания дополненной реальности // Моделирование и анализ информационных систем. 2013. Т. 20, № 2. С. 129–138. EDN: QLSCED

[32] Bui TTCh, Fan NKh, Spitsyn VG. Face recognition based on the Viola-Jones method, wavelet transform and principal component method. Bulletin of the Tomsk polytechnic university. 2012;320(5):54–59. (In Russ.) EDN: OZQTBJ

[33] Буй Т.Т.Ч., Фан Н.Х., Спицын В.Г. Распознавание лиц на основе применения метода Виолы–Джонса, вейвлет-преобразования и метода главных компонент // Известия Томского политехнического университета. 2012. Т. 320, № 5. C. 54–59. EDN: OZQTBJ

[34] Lyu MR, King I, Wong T-T, et al. Arcade: Augmented reality computing arena for digital entertainment. IEEE Aerospace Conference, Proceedings 2005. P. 1–9. doi: 10.1109/aero.2005.1559626

[35] Lyu M.R., King I., Wong T.-T., et al. Arcade: Augmented reality computing arena for digital entertainment // IEEE Aerospace Conference, Proceedings 2005. P. 1–9. doi: 10.1109/aero.2005.1559626

[36] Kotkov PA, Sigua BV, Petrov SV, et al. Evaluation of the probability of an unfavorable outcome in operated patients in accordance with the platelet ratio. Certificate of state registration of the computer program No. RU 2024610964 / 16.01.2024. (In Russ.) EDN: CFBKZU

[37] Котков П.А., Сигуа Б.В., Петров С.В., и др. Оценка вероятности неблагоприятного исхода у оперированных пациентов в соответствии с тромбоцитарным отношением. Свидетельство о государственной регистрации программы для ЭВМ № RU 2024610964 / 16.01.2024. EDN: CFBKZU

[38] Sigua BV, Kozobin AA, Kotkov PA, Semin DS. Predictive score for assessing the risk of incisional hernias strangulation. Russian Sklifosovsky Journal of Emergency Medical Care. 2021;10(4):712–718. EDN: KMOQAB doi: 10.23934/2223-9022-2021-10-4-712-718

[39] Сигуа Б.В., Козобин А.А., Котков П.А., Сёмин Д.С. Балльная шкала оценки риска ущемления послеоперационных вентральных грыж // Журнал им. Н.В. Склифосовского Неотложная медицинская помощь. 2021. Т. 10, № 4. С. 712–718. EDN: KMOQAB doi: 10.23934/2223-9022-2021-10-4-712-718

[40] Kozobin AA, Sigua BV, Kotkov PA, et al. Point scale for assessing the risk of strangulation of inguinal and femoral hernias. Certificate of state registration of computer program No. RU 2023685011 / 22.11.2023. (In Russ.) EDN: OPKJJF

[41] Козобин А.А., Сигуа Б.В., Котков П.А., и др. Балльная шкала оценки риска ущемления паховых и бедренных грыж. Свидетельство о государственной регистрации программы для ЭВМ № RU 2023685011 / 22.11.2023. EDN: OPKJJF

[42] Sigua BV, Kotkov PA, Petrov SV, et al. Score scale for sanitation relaparotomies in patients with secondary peritonitis. Certificate of state registration of computer program No. RU 2023685967 / 01.12.2023. (In Russ.) EDN: UJAQPG

[43] Сигуа Б.В., Котков П.А., Петров С.В., и др. Балльная шкала санационных релапаротомий у больных с вторичным перитонитом. Свидетельство о государственной регистрации программы для ЭВМ № RU 2023685967 / 01.12.2023. EDN: UJAQPG

[44] Sigua BV, Kotkov PA, Petrov SV, et al. Predicting the probability of success of conservative therapy in acute adhesive intestinal obstruction. Certificate of state registration of computer program No. RU 2023688061 / 20.12.2023. (In Russ.) EDN: ETWBWA

[45] Сигуа Б.В., Котков П.А., Петров С.В., и др. Прогнозирование вероятности успеха консервативной терапии при острой спаечной кишечной непроходимости. Свидетельство о государственной регистрации программы для ЭВМ № RU 2023688061 / 20.12.2023. EDN: ETWBWA

[46] Vysotin DA, Kulikova EV, Shmatko AD. Online simulator for solving situational problems in the specialty “medical and preventive care”. Certificate of state registration of the computer program No. RU 2022664181 / 07.26.2022. (In Russ.) EDN: ARAGST

[47] Высотин Д.А., Куликова Е.В., Шматко А.Д. Онлайн-тренажер решения ситуационных задач по специальности «медико-профилактическое дело». Свидетельство о государственной регистрации программы для ЭВМ № RU 2022664181 / 26.07.2022. EDN: ARAGST

RIGHTS & PERMISSIONS

Eco-Vector