Automatic three-dimensional reconstruction based on four-view stereo vision using checkerboard pattern

Abstract

An automatic three-dimensional (3D) reconstruction method based on four-view stereo vision using checkerboard pattern is presented. Mismatches easily exist in traditional binocular stereo matching due to the repeatable or similar features of binocular images. In order to reduce the probability of mismatching and improve the measure precision, a four-camera measurement system which can add extra matching constraints and offer multiple measurements is applied in this work. Moreover, a series of different checkerboard patterns are projected onto the object to obtain dense feature points and remove mismatched points. Finally, the 3D model is generated by performing Delaunay triangulation and texture mapping on the point cloud obtained by four-view matching. This method was tested on the 3D reconstruction of a terracotta soldier sculpture and the Buddhas in the Mogao Grottoes. Their point clouds without mismatched points were obtained and less processing time was consumed in most cases relative to binocular matching. These good reconstructed models show the effectiveness of the method.

Keywords

three-dimensional reconstruction / four-view stereo vision / checkerboard pattern / dense point

References

[1] OliveiraA, OliveiraJ F, PereiraJ M, AraújoB R D, BoavidaJ. 3D modelling of laser scanned and photogrammetric data for digital documentation: The Mosteiro da Batalha case study [J]. Journal of Real-Time Image Processing, 2014, 9(4): 673-688

[2] ChenZ-y, XuB, DevereuxB. Urban landscape pattern analysis based on 3D landscape models [J]. Applied Geography, 2014, 55: 82-91

[3] LiH, YangJ-y, SuP-c, WangW-shan. Computer aided modeling and pore distribution of bionic porous bone structure [J]. Journal of Central South University, 2012, 19(12): 3492-3499

[4] LiuX-l, LiX-b, LiF-b, ZhaoG-y, QinY-hui. 3D cavity detection technique and its application based on cavity auto scanning laser system [J]. Journal of Central South University of Technology, 2008, 15(2): 285-288

[5] GomesL, SilvaL, BellonO, RP. 3D reconstruction methods for digital preservation of cultural heritage: A survey [J]. Pattern Recognition Letters, 2014, 50: 3-14

[6] SonH, KimC, KimC. 3D reconstruction of as-built industrial instrumentation models from laser-scan data and a 3D CAD database based on prior knowledge [J]. Automation in Construction, 2015, 49: 193-200

[7] Nefti-MezianiS, ManzoorU, DavisS, PupalaS K. 3D perception from binocular vision for a low cost humanoid robot NAO [J]. Robotics & Autonomous Systems, 2015, 68: 129-139

[8] ChenS-y, WangY-h, CattaniC. Key issues in modeling of complex 3D structures from video sequences [J]. Mathematical Problems in Engineering, 2012, 2012: 856523

[9] CiaccioE J, TennysonC A, BhagatG, LewisS K, GreenP H R. Use of shape-from-shading to estimate three-dimensional architecture in the small intestinal lumen of celiac and control patients [J]. Computer Methods and Programs in Biomedicine, 2013, 111(3): 676-684

[10] HaroG, PardàsM. Shape from incomplete silhouettes based on the reprojection error [J]. Image and Vision Computing, 2010, 28(9): 1354-1368

[11] ThelenA, FreyS, HirschS, HeringP. Improvements in shape-from-focus for holographic reconstructions with regard to focus operators, neighborhood-size, and height value interpolation [J]. IEEE Transactions on Image Processing, 2009, 18(1): 151-157

[12] SabaterN, AlmansaA, MorelJ M. Meaningful matches in stereovision [J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2012, 34(5): 930-942

[13] SettiF, BiniR, LunardelliM, BosettiP, BruschiS, CeccoM D. Shape measurement system for single point incremental forming (SPIF) manufacts by using trinocular vision and random pattern [J]. Measurement Science and Technology, 2012, 23(11): 115402

[14] HaertelM, EM, PintoT L F C, JúniorA A G. Trinocular stereo system with object space oriented correlation for inner pipe inspection [J]. Measurement, 2015, 73162-170

[15] RashidizadH, RahimiA. Building three-dimensional scanner based on structured light technique using fringe projection pattern [J]. Journal of Computing & Information Science in Engineering, 2014, 14(3): 035001

[16] TsaiR Y. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses [J]. IEEE Journal of Robotics & Automation, 1987, 34323-344

[17] HarrisC, StephensM. A combined corner and edge detector [C]. Proceedings of the Fourth Alvey Vision Conference. Manchester, UK: The University of Sheffield Printing Unit, 1988147-151

[18] LazarosN, SirakoulisG C, GasteratosA. Review of stereo vision algorithms: from software to hardware [J]. International Journal of Optomechatronics, 2008, 2(4): 435-462

[19] XuS-b, XuD-s, FangHua. Stereo matching algorithm based on detecting feature points [J]. Advanced Materials Research, 2012, 433–440: 6190-6194

[20] TsaiV J D. Delaunay triangulations in TIN creation: An overview and a linear-time algorithm [J]. International Journal of Geographical Information Systems, 1993, 7(6): 501-524

[21] WrightR S, HaemelN, SellersG, LipchakBOpenGL SuperBible: Comprehensive tutorial and reference [M], 2010, New Jersey, Addison-Wesley