Please wait a minute...

Frontiers of Optoelectronics

Front. Optoelectron.    2017, Vol. 10 Issue (1) : 1-8     DOI: 10.1007/s12200-016-0662-8
Retinal projection head-mounted display
Junguo LIN,Dewen CHENG(),Cheng YAO,Yongtian WANG
Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optoelectronics, Beijing Institute of Technology, Beijing 100081, China
Download: PDF(391 KB)   HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Retinal projection displays (RPDs) are an important development direction for head-mounted displays (HMDs). This paper reviews the literature on optical engineering aspects based on the data on advanced technology in RPD design and development. The review includes the principles and applications of four theories, e.g., the Maxwellian view and its modified modality and the monocular and binocular depth cues of stereoscopic objects in the physiology of the human visual system. To support the Maxwellian view and achieve retinal projection systems with depth cues, results of previous design works were summarized using different methods and their advantages and disadvantages are analyzed. With an extremely long focal depth, a prototype of a full-color stereoscopic see-through RPD system was discussed. Finally, a brief outlook of the future development trends and applications of the RPDs was presented

Keywords retinal projection display (RPD)      Maxwellian view      depth cues      stereoscopic see-through     
Corresponding Authors: Dewen CHENG   
Just Accepted Date: 14 November 2016   Online First Date: 29 November 2016    Issue Date: 17 March 2017
 Cite this article:   
Junguo LIN,Dewen CHENG,Cheng YAO, et al. Retinal projection head-mounted display[J]. Front. Optoelectron., 2017, 10(1): 1-8.
E-mail this article
E-mail Alert
Articles by authors
Junguo LIN
Cheng YAO
Yongtian WANG
Fig.1  Principle of the Maxwellian view
Fig.2  Normal viewing of HMD
Fig.3  (a) Dissociation between real and virtual objects [23]; (b) integration of real and virtual objects
Fig.4  Principle of the modified Maxwellian view. (a) Side view; (b) top view [23]
Fig.5  Process of obtaining thin light beams. (a) Pinhole image; (b) laser image [16]
Fig.6  Optical path of the RPD using a half-mirror [25]
Fig.7  Specification of the HOE [27]
Fig.8  Compact optics of the RPD constituted by a free-surface reflection mirror [16]
Fig.9  Schematic of accommodation [22]
Fig.10  (a) Structure of the HOE; (b) schematic of the multi-view system [29]
Fig.11  Schematic of the binocular parallax [22]
Fig.12  Stereogram of the side-by-side format
Fig.13  Universal design optical structure of the RPD
Fig.14  Schematic of the binocular stereoscopic RPD
Fig.15  Experimental symmetric prototype
Fig.16  Image by the Maxwellian view. Focuses on (a) nearby and (b) distant
1 Rauschnabel P A, Brem A, Ro Y. Augmented reality smart glasses: definition, conceptual insights, and managerial importance. Working paper, The University of Michigan-Dearborn, 2015
2 Kress B. The segmentation of the HMD market: optics for smart glasses, smart eyewear, AR and VR headsets. In: Proceedings of SPIE-The International Society for Optical Engineering, 2014, 9202: 92020D-1–92020D-14
3 Schowengerdt B T, Seibel E J, Furness T A. Binocular retinal scanning laser display with integrated focus cues for ocular accommodation. In: Proceedings of SPIE-The International Society for Optical Engineering, 2003, 5006: 1–9
4 Cakmakci O, Rolland J. Head-worn displays: a review. Journal of Display Technology, 2006, 2(3): 199–216
doi: 10.1109/JDT.2006.879846
5 Wit G C D. A retinal scanning display for virtual reality. Dissertation for the Doctoral Degree. TU Delft: Delft University of Technology, 1997
6 Hakan U. Optical advantages of retinal scanning displays. In: Proceedings of SPIE-The International Society for Optical Engineering, 2000, 4021: 20–26
7 Webb R H, Hughes G W, Pomerantzeff O. Flying spot TV ophthalmoscope. Applied Optics, 1980, 19(17): 2991–2997
doi: 10.1364/AO.19.002991 pmid: 20234539
8 Webb R H, Hughes G W, Delori F C. Confocal scanning laser ophthalmoscope. Applied Optics, 1987, 26(8): 1492–1499
doi: 10.1364/AO.26.001492 pmid: 20454349
9 Ellingford A. The Rodenstock scanning laser ophthalmoscope in clinical practice. Journal of Audiovisual Media in Medicine, 1994, 17(2): 67–70
doi: 10.3109/17453059409063659 pmid: 8034907
10 Varano M, Scassa C. Scanning laser ophthalmoscope microperimetry. Seminars in Ophthalmology, 1998, 13(4): 203–209
doi: 10.3109/08820539809056054 pmid: 9878671
11 Yoshinaka K. Display Device, Japanese Patent: 61198892. <Date>1986–09–03</Date>
12 Hu X, Liu Y, Wang J, Liu B. Current progress in head-mounted display based on retinal scanning. Hongwai Yu Jiguang Gongcheng, 2014, 43(3): 871–878 (in Chinese)
13 Jacobs R J, Bailey I L, Bullimore M A. Artificial pupils and Maxwellian view. Applied Optics, 1992, 31(19): 3668–3677
doi: 10.1364/AO.31.003668 pmid: 20725339
14 Kollin J. A retinal display for virtual-environment applications. SID International Symposium Digest of Technical Papers, 1993, 24: 827–827
15 Kollin J S, Tidwell M R. Optical engineering challenges of the virtual retinal display. In: Proceedings of SPIE-The International Society for Optical Engineering, 1995, 2537: 48–60
16 Sugawara M, Suzuki M, Miyauchi N. Late-News Paper: Retinal imaging laser eyewear with focus-free and augmented reality. Sid Symposium Digest of Technical Papers, 2016, 47(1): 164–167
17 Davis W O, Brown D, Ma Y, Coy J W. Evolution of MEMS scanning mirrors for laser projection in compact consumer electronics. International Society for Optics and Photonics, 2010, 7594(5): 75940A-1–75940A-12
18 Watanabe M, Takayama H, Asai N, Matsuda R, Yamada S. A retinal scanning display with a wavefront curvature modulator. Journal of the Society for Information Display, 2003, 11(3): 511–515
doi: 10.1889/1.1821288
20 Wearable see-through display “Laser Eyewear” developed based on original laser retina imaging optics,
22 Jia J. Fast algorithm for CGH calculation and system design for holographic 3D display. Dissertation for the Doctoral Degree. Beijing: Beijing Institute of Technology, 2013
23 Takahashi H. Stereoscopic see-through retinal projection head-mounted display. In: Proceedings of SPIE-The International Society for Optical Engineering, 2008, 6803: 68031N-1–68031N-8
24 Yang Z, Guo Z, Yang Z. Design of retinal projection display system. Journal of Applied Optics, 2011, 32(2): 222–225
25 Yang M, Guo Z, Yang Z. Helmet-mounted displays based on retinal projection display. Journal of Applied Optics, 2012, 33(2): 370–373
26 Ando T, Yamasaki K, Okamoto M, Matsumoto T, Shimizu E. Evaluation of HOE for head-mounted display. SPIE Proceedings, Practical Holography XIII, 1999, 3637: 110–118
doi: 10.1117/12.343762
27 Ando T, Yamasaki K, Okamoto M, Matsumoto T, Shimizu E. Retinal projection display using holographic optical element. SPIE Proceedings, Practical Holography XIV and Holographic Materials VI, 2000, 3956: 211–216
doi: 10.1117/12.379998
28 Takatsuka Y, Yabu H, Yoshimoto K, Takahashi H. Retinal projection display using diffractive optical element. In: Proceedings of Intelligent Information Hiding and Multimedia Signal, 2014: 403–406
29 Takahashi H, Ito Y, Nakata S, Yamada K. Retinal projection type super multi-view head-mounted display. Society of Photo-Optical Instrumentation Engineers (SPIE), Conference Series, 2014, 9012: 90120L-1–90120L-6
30 Bayer M M. Retinal scanning display: a novel HMD approach for army aviation. In: Proceedings of SPIE-The International Society for Optical Engineering, 2002, 4711: 202–213
31 McQuaide S C, Seibel E J, Burstein R, Furness T A III. 50.4: Three-dimensional virtual retinal display system using a deformable membrane mirror. SID Symposium Digest of Technical Papers, 2002, 33(1): 1324–1327
32 McQuaide S C, Seibel E J, Kelly J P, Schowengerdt B T, Furness T A III. A retinal scanning display system that produces multiple focal planes with a deformable membrane mirror. Displays, 2003, 24(2): 65–72
doi: 10.1016/S0141-9382(03)00016-7
33 Westheimer G. The Maxwellian view. Vision Research, 1966, 6(11–12): 669–682
doi: 10.1016/0042-6989(66)90078-2 pmid: 6003389
34 Maxwell J C, Zaidi Q. On the theory of compound colours, and the relations of the colours of the spectrum. Color Research and Application, 1993, 18(4): 270–287
doi: 10.1002/col.5080180411
35 Viirre E, Johnston R, Pryor H, Nagata S, Furness T A 3rd. Laser safety analysis of a retinal scanning display system. Journal of Laser Applications, 1997, 9(5): 253–260
doi: 10.2351/1.4745467 pmid: 10174266
36 Urey H, DeWitt F A IV, Lopez P A, Tauscher J. MEMS raster correction scanner for SXGA resolution retinal scanning display. SPIE Proceedings, 2003, 4985: 106–114
Full text