Retinal projection head-mounted display

Abstract

Retinal projection displays (RPDs) are an important development direction for head-mounted displays (HMDs). This paper reviews the literature on optical engineering aspects based on the data on advanced technology in RPD design and development. The review includes the principles and applications of four theories, e.g., the Maxwellian view and its modified modality and the monocular and binocular depth cues of stereoscopic objects in the physiology of the human visual system. To support the Maxwellian view and achieve retinal projection systems with depth cues, results of previous design works were summarized using different methods and their advantages and disadvantages are analyzed. With an extremely long focal depth, a prototype of a full-color stereoscopic see-through RPD system was discussed. Finally, a brief outlook of the future development trends and applications of the RPDs was presented

Graphical abstract

Keywords

retinal projection display (RPD) / Maxwellian view / depth cues / stereoscopic see-through

References

[1] Rauschnabel P A, Brem A, Ro Y. Augmented reality smart glasses: definition, conceptual insights, and managerial importance. Working paper, The University of Michigan-Dearborn, 2015

[2] Kress B. The segmentation of the HMD market: optics for smart glasses, smart eyewear, AR and VR headsets. In: Proceedings of SPIE-The International Society for Optical Engineering, 2014, 9202: 92020D-1–92020D-14

[3] Schowengerdt B T, Seibel E J, Furness T A. Binocular retinal scanning laser display with integrated focus cues for ocular accommodation. In: Proceedings of SPIE-The International Society for Optical Engineering, 2003, 5006: 1–9

[4] Cakmakci O, Rolland J. Head-worn displays: a review. Journal of Display Technology, 2006, 2(3): 199–216

[5] Wit G C D. A retinal scanning display for virtual reality. Dissertation for the Doctoral Degree. TU Delft: Delft University of Technology, 1997

[6] Hakan U. Optical advantages of retinal scanning displays. In: Proceedings of SPIE-The International Society for Optical Engineering, 2000, 4021: 20–26

[7] Webb R H, Hughes G W, Pomerantzeff O. Flying spot TV ophthalmoscope. Applied Optics, 1980, 19(17): 2991–2997

[8] Webb R H, Hughes G W, Delori F C. Confocal scanning laser ophthalmoscope. Applied Optics, 1987, 26(8): 1492–1499

[9] Ellingford A. The Rodenstock scanning laser ophthalmoscope in clinical practice. Journal of Audiovisual Media in Medicine, 1994, 17(2): 67–70

[10] Varano M, Scassa C. Scanning laser ophthalmoscope microperimetry. Seminars in Ophthalmology, 1998, 13(4): 203–209

[11] Yoshinaka K. Display Device, Japanese Patent: 61198892. 1986–09–03

[12] Hu X, Liu Y, Wang J, Liu B. Current progress in head-mounted display based on retinal scanning. Hongwai Yu Jiguang Gongcheng, 2014, 43(3): 871–878 (in Chinese)

[13] Jacobs R J, Bailey I L, Bullimore M A. Artificial pupils and Maxwellian view. Applied Optics, 1992, 31(19): 3668–3677

[14] Kollin J. A retinal display for virtual-environment applications. SID International Symposium Digest of Technical Papers, 1993, 24: 827–827

[15] Kollin J S, Tidwell M R. Optical engineering challenges of the virtual retinal display. In: Proceedings of SPIE-The International Society for Optical Engineering, 1995, 2537: 48–60

[16] Sugawara M, Suzuki M, Miyauchi N. Late-News Paper: Retinal imaging laser eyewear with focus-free and augmented reality. Sid Symposium Digest of Technical Papers, 2016, 47(1): 164–167

[17] Davis W O, Brown D, Ma Y, Coy J W. Evolution of MEMS scanning mirrors for laser projection in compact consumer electronics. International Society for Optics and Photonics, 2010, 7594(5): 75940A-1–75940A-12

[18] Watanabe M, Takayama H, Asai N, Matsuda R, Yamada S. A retinal scanning display with a wavefront curvature modulator. Journal of the Society for Information Display, 2003, 11(3): 511–515

[19] https://www.avegant.com/

[20] Wearable see-through display “Laser Eyewear” developed based on original laser retina imaging optics, http://www.qdlaser.com/pdf/Press-Release-Laser-Eye-Wear-QD-Laser-Inc.20140605-finalfinal.pdf

[21] ttp://www.laserfocusworld.com/articles/2014/05/new-smart-glasses-from-qd-laser-rely-on-laser-retinal-imaging.html

[22] Jia J. Fast algorithm for CGH calculation and system design for holographic 3D display. Dissertation for the Doctoral Degree. Beijing: Beijing Institute of Technology, 2013

[23] Takahashi H. Stereoscopic see-through retinal projection head-mounted display. In: Proceedings of SPIE-The International Society for Optical Engineering, 2008, 6803: 68031N-1–68031N-8

[24] Yang Z, Guo Z, Yang Z. Design of retinal projection display system. Journal of Applied Optics, 2011, 32(2): 222–225

[25] Yang M, Guo Z, Yang Z. Helmet-mounted displays based on retinal projection display. Journal of Applied Optics, 2012, 33(2): 370–373

[26] Ando T, Yamasaki K, Okamoto M, Matsumoto T, Shimizu E. Evaluation of HOE for head-mounted display. SPIE Proceedings, Practical Holography XIII, 1999, 3637: 110–118

[27] Ando T, Yamasaki K, Okamoto M, Matsumoto T, Shimizu E. Retinal projection display using holographic optical element. SPIE Proceedings, Practical Holography XIV and Holographic Materials VI, 2000, 3956: 211–216

[28] Takatsuka Y, Yabu H, Yoshimoto K, Takahashi H. Retinal projection display using diffractive optical element. In: Proceedings of Intelligent Information Hiding and Multimedia Signal, 2014: 403–406

[29] Takahashi H, Ito Y, Nakata S, Yamada K. Retinal projection type super multi-view head-mounted display. Society of Photo-Optical Instrumentation Engineers (SPIE), Conference Series, 2014, 9012: 90120L-1–90120L-6

[30] Bayer M M. Retinal scanning display: a novel HMD approach for army aviation. In: Proceedings of SPIE-The International Society for Optical Engineering, 2002, 4711: 202–213

[31] McQuaide S C, Seibel E J, Burstein R, Furness T A III. 50.4: Three-dimensional virtual retinal display system using a deformable membrane mirror. SID Symposium Digest of Technical Papers, 2002, 33(1): 1324–1327

[32] McQuaide S C, Seibel E J, Kelly J P, Schowengerdt B T, Furness T A III. A retinal scanning display system that produces multiple focal planes with a deformable membrane mirror. Displays, 2003, 24(2): 65–72

[33] Westheimer G. The Maxwellian view. Vision Research, 1966, 6(11–12): 669–682

[34] Maxwell J C, Zaidi Q. On the theory of compound colours, and the relations of the colours of the spectrum. Color Research and Application, 1993, 18(4): 270–287

[35] Viirre E, Johnston R, Pryor H, Nagata S, Furness T A 3rd. Laser safety analysis of a retinal scanning display system. Journal of Laser Applications, 1997, 9(5): 253–260

[36] Urey H, DeWitt F A IV, Lopez P A, Tauscher J. MEMS raster correction scanner for SXGA resolution retinal scanning display. SPIE Proceedings, 2003, 4985: 106–114

Acknowledgements

This work was partially supported by the National High Technology Research and Development Program of China (No. 2015AA016301) and the Beijing Natural Science Foundation Program (No. 4152044).

RIGHTS & PERMISSIONS

2016 Higher Education Press and Springer-Verlag Berlin Heidelberg