Sign language learning based on high-speed fringe projection profilometry employing defocused binary fringe

Abstract

A high-speed fringe projection profilometry employing defocused binary fringe is presented to record the 3-D sign language, including gesture and mouth movement, to help people learn the sign language. It employs a number of advanced approaches, such as fringes binarization and defocus method, high precision phase calculation based on the phase-shifting method and the three pitches heterodyne unwrapping (TPHU) method, and how to combine multiple binary fringes into a 24-bit fringe. Experiments have shown that the proposed system can acquire and display high-quality 3D gesture and mouth movement at a speed of 500 frames per second.

References

[1] FengS J, ZuoC, TaoT Y, HuY, ZhangM L, ChenQ, GuG H. Optics and Lasers in Engineering, 2018, 103: 127

[2] FengS J, ChenQ, ZuoC, TaoT Y, HuY, AsundiA. Optics Express, 2017, 25: 540

[3] TaoT Y, ChenQ, DaJ, FengS J, HuY, ZuoC. Optics Express, 2016, 24: 20253

[4] ZhangS, YauS-T. Optics Express, 2006, 14: 2644

[5] GaiS Y, DaF P. Optics and Lasers in Engineering, 2010, 4: 205

[6] TakedaM, InaH, KobayashiS. Journal of the Optical Society of America, 1982, 72: 156

[7] TakedaM, MutohK. Applied Optics, 1983, 22: 3977

[8] ZhangZ B, ZhongJ G. Optics Express, 2013, 21: 18777

[9] AbidA, GdeisatM, BurtonD, LalorM, LilleyF. Applied Optics, 2007, 46: 6120

[10] ZhongM, ChenF, XiaoC, WeiY C. Optics and Lasers in Engineering, 2017, 88: 243

[11] GdeisataM A, AbidA, BurtonD R, LaborM J, LilleyF. Optics and Lasers in Engineering, 2009, 47: 1348

[12] WangZ Y, MaJ, MinhV. Optics and Lasers in Engineering, 2012, 50: 1052

[13] MaJ, WangZ Y, PanT Y. Optics and Lasers in Engineering, 2014, 55: 205

[14] DuG L, WangM M, ZhouC L, SiS C, LiH, LeiZ K, LiY J. Journal of Modern Optics, 2017, 64: 231

[15] ZuoC, HuangL, ZhangM L, ChenQ, AsundiA. Optics and Lasers in Engineering, 2016, 85: 84

[16] XingS, GuoH. Applied Optics, 2017, 56: 1591

[17] WangY, ZhangS. Optics Express, 2011, 19: 5149

[18] ZuoC, ChenQ, GuG, FengS, FengF. Optics Express, 2012, 20: 19493

[19] ZhangZ, TowersC, TowersD P. Optics Express, 2006, 14: 6444

[20] SchaerM, GrosseM, KowarschikR. Applied Optics, 2010, 49: 3622

[21] ZuoC, ChenQ, GuG, FengS, FengF, LiR, ShenG. Optics and Lasers in Engineering, 2013, 51: 953

[22] HuangP S, HuQ J, ChiangF P. Applied Optics, 2002, 41: 4503