Optimized Method for Real-time Texture Reconstruction with RGB-D Camera

Abstract

With the appearance of RGB-D camera, the field of three-dimensional (3D) reconstruction receives more and more attention. In this paper, we present an optimization approach to produce high-quality textured 3D models based on the real-time 3D reconstruction system. The resulting models of real-time texture reconstruction often suffer from blurring, ghosting, and other artifacts. Our approach addresses this texture quality problem using blur detection and an optimized weight function. Experimental results demonstrate that our approach can improve the quality of textured 3D models by reducing the blur and ghosts on the model surface.

Keywords

Real-time 3D reconstruction / RGB-D camera / Texture reconstruction / Blur detection

References

[1] Newcombe RA, Izadi S, Hilliges O et al (2012) KinectFusion: real-time dense surface mapping and tracking. In: Proceedings of IEEE international symposium on mixed and augmented reality, pp 127–136

[2] Whelan T, Mc Donald J, Kaess M et al (2012) Kintinuous: spatially extended kinectfusion. In: Proceedings of 3rd RSS workshop on RGB-D: advanced reasoning with depth cameras

[3] Chen JW, Bautembach D, Izadi S. Scalable real-time volumetric surface reconstruction. ACM Trans Graph (TOG), 2013, 32: 113.

[4] Nguyen MH, Wünsche B, Delmas P et al (2013) High-definition texture reconstruction for 3D image-based modelling. In: Proceedings of WSCG, pp 39–48

[5] Gao PQ, Guo XZ, Yang DT et al (2012) 3D model reconstruction from video recorded with a compact camera. In: Proceedings of 9th international conference on fuzzy systems and knowledge discovery, pp 2528–2532

[6] Rusu R, Cousins S (2011) 3D is here: point cloud library (PCL). In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 1–4

[7] Heindl C, Kopf C (2012) ReconstructMe. http://reconstructme.net. Accessed 30 May 2015

[8] Zhou QY, Koltun V. Color map optimization for 3D reconstruction with consumer depth cameras. ACM Trans Graph (TOG), 2014, 33: 155.

[9] Whelan T, Johannsson H, Kaess M et al (2013) Robust real-time visual odometry for dense RGB-D mapping. In: Proceedings of IEEE international conference on robotics and automation (ICRA), pp 5724–5731

[10] Nießner M, Zollhöfer M, Izadi S, et al. Real-time 3D reconstruction at scale using voxel hashing. ACM Trans Graph (TOG), 2013, 32: 169.

[11] Bylow E, Sturm J, Kerl C et al (2013) Real-time camera tracking and 3D reconstruction using signed distance functions. In: Proceedings of robotics: science and systems (RSS) conference

[12] Sturm J, Bylow E, Kahl F, et al. CopyMe3D: Scanning and printing persons in 3D. Pattern Recognition, 2013, Berlin: Springer 405-414.

[13] Endres F, Hess J, Sturm J, et al. 3-D mapping with an RGB-D camera. IEEE Trans Robot, 2014, 30: 177-187.

[14] Tong HH, Li MJ, Zhang HJ et al (2005) Blur detection for digital images using wavelet transform. In: Proceedings of IEEE international conference on multimedia and expo, pp 17–20

[15] Kahler O, Prisacariu VA, Ren CY, et al. Very high frame rate volumetric integration of depth images on mobile devices. IEEE Trans Visual Comput Graph, 2015, 21: 1241-1250.