Registration Based on ORB and FREAK Features for Augmented Reality Systems

Abstract

This paper proposes a novel registration method for augmented reality (AR) systems based on Oriented FAST and Rotated BRIEF (ORB) and Fast Retina Keypoint (FREAK) natural features. In the proposed ORB-FREAK method, feature extraction is implemented based on the combination of ORB and FREAK, and the feature points are matched using Hamming distance. To get good matching points, cross-checks and least median squares are used to perform outlier filtration, and camera pose is estimated using the matched points. Finally, AR is rendered. Experiments show that the proposed method improves the speed of registration to be in real time; the proposed method can accurately register the target object under the circumstances of partial occlusion of the object; and it also can overcome the effects of rotation, scale change, ambient light and distance.

Keywords

Augmented reality registration / Oriented FAST and rotated BRIEF / Fast retina keypoint / Pose estimation

References

[1] Lee SH, Choi J, Park JI. Interactive E-Learning system using pattern recognition and augmented reality. IEEE Trans Consum Electron, 2009, 55: 883-890.

[2] Furht B. Handbook of augmented reality, 2011, New York: Springer

[3] Carlos C, Daniel B, Francisco M, et al. Moving object detection for real-time augmented reality applications in a GPGPU. IEEE Trans Consum Electron, 2012, 58: 117-125.

[4] Azuma RT. A survey of augmented reality. Presence: teleoperators and virtual environments, 1997, 6: 355-385.

[5] Azuma R, Baillot Y, Behringer R, et al. Recent advances in augmented reality. IEEE Comput Gr Appl, 2001, 21: 34-47.

[6] William AH, Khoi N, Torsten L. Computer-vision-based registration techniques for augmented reality. SPIE, 1996, 2904: 538-548.

[7] Zhou F, Duh HBL, Billinghurst M (2008) Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. In: IEEE/ACM international symposium on mixed and augmented reality, pp 193–202

[8] Kim K, Park NY, Woo W. Vision-based all-in-one solution for augmented reality and its storytelling applications. The Visual Computer, 2014, 30: 417-429.

[9] Abawi DF, Bienwald J, Dorner R (2004) Accuracy in optical tracking with fiducial markers: an accuracy function for ARToolKit. In: IEEE and ACM international symposium on mixed and augmented reality, pp 260–261

[10] Fiala M (2005) ARTag, a fiducial marker system using digital techniques. In: IEEE conference on computer vision & pattern recognition, pp 590–596

[11] Harris C (1988) A combined corner and edge detector. In: Proc 4th Alvey Vision Conf, pp 147–151

[12] Lowe DG. Distinctive image features from scale-invariant keypoints. Int J Comput Vis, 2004, 60: 91-110.

[13] Chen J, Wang YT, Liu Y, et al. System initialization algorithm based on SIFT key points for markerless augmented reality applications. Infrared Laser Eng, 2007, 36: 949-953 (in Chinese)

[14] Bay H, Tuytelaars T, Gool LV (2006) Surf: speeded up robust features. In: 9th European conference on computer vision, pp 404–417

[15] Crescenzio FD, Fantini M, Persiani FL, et al. Augmented reality for aircraft maintenance training and operations support. IEEE Comput Gr Appl, 2011, 31: 96-101.

[16] Rublee E, Rabaud V, Konolige K et al (2011) ORB: an efficient alternative to SIFT or SURF. In: IEEE international conference on computer vision, pp 2564–2571

[17] Rosten E, Drummond T (2006) Machine learning for high-speed corner detection. In: European conference on computer vision, pp 430–443

[18] Calonder M, Lepetit V, Strecha C, et al. Brief: binary robust independent elementary features. ECCV, 2010, 2010: 778-792.

[19] Xia Y, Zhou WJ (2013) A tracking and registration method based on ORB and KLT for augmented reality system. In: Wireless and optical communication conference, pp 344–348

[20] Alahi A, Ortiz R, Vandergheynst P (2012) Freak: fast retina keypoint. In: IEEE conference on computer vision and pattern recognition, pp 510–517

[21] Tu ZY, Sun JZ. Applications and research on augmented reality. Comput Eng Appl, 2003, 39: 100-102 (in Chinese)

[22] Rousseeuw PJ, Leroy AM. Robust regression and outlier detection, 1992, New Jersey: Wiley-Interscience.

[23] Zhang ZY. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell, 2000, 22: 1330-1334.

[24] Mikolajczyk K, Tuytelaars T, Schmid C, et al. A comparison of affine region detectors. Int J Comput Vis, 2005, 65: 43-72.

[25] Uchiyama H, Marchand E (2012) Object detection and pose tracking for augmented reality: recent approaches. In: 18th Korea-Japan Joint Workshop on Frontiers of Computer Vision, p 1–8