Visual attention and clustering-based automatic selection of landmarks using single camera

Abstract

An improved method with better selection capability using a single camera was presented in comparison with previous method. To improve performance, two methods were applied to landmark selection in an unfamiliar indoor environment. First, a modified visual attention method was proposed to automatically select a candidate region as a more useful landmark. In visual attention, candidate landmark regions were selected with different characteristics of ambient color and intensity in the image. Then, the more useful landmarks were selected by combining the candidate regions using clustering. As generally implemented, automatic landmark selection by vision-based simultaneous localization and mapping (SLAM) results in many useless landmarks, because the features of images are distinguished from the surrounding environment but detected repeatedly. These useless landmarks create a serious problem for the SLAM system because they complicate data association. To address this, a method was proposed in which the robot initially collected landmarks through automatic detection while traversing the entire area where the robot performed SLAM, and then, the robot selected only those landmarks that exhibited high rarity through clustering, which enhanced the system performance. Experimental results show that this method of automatic landmark selection results in selection of a high-rarity landmark. The average error of the performance of SLAM decreases 52% compared with conventional methods and the accuracy of data associations increases.

Keywords

simultaneous localization and mapping / automatic landmark selection / visual attention / clustering

References

[1] ThrunS, BurgardW, FoxDProbabilistic robotics [M], 2006, Cambridge, USA, MIT Press: 309-312

[2] LoweD. Object recognition from local scale-invariant features [C]. Proceedings of the International Conference on Computer Vision, 1999, Kerkira, Greece, IEEE: 1150-1157

[3] BayH, EssA, TuytelaarsT, GoolL. Speeded-Up robust features (SURF) [J]. Computer Vision and Image Understanding, 2008, 110: 346-359

[4] HarrisC, StephensM. A combined corner and edge detector [C]. Proceedings of the 4th Alvey Vision Conference, 1988, London, UK, The Pleassey Company: 147-151

[5] SiagianC, IttiL. Biologically inspired mobile robot vision localization [J]. IEEE Transactions on Robotics, 2009, 25(4): 861-873

[6] SiagianC, IttiL. Rapid biologically-inspired scene classification using features shared with visual attention [J]. IEEE Trans Pattern Anal Mach Intell, 2007, 29(2): 300-312

[7] FrintropS, JensfeltP. Attentional landmarks and active gaze control for visual SLAM [M]. IEEE Transactions on Robotics, 2008, 24(5): 1054-1065

[8] FrintropS, JensfeltP, ChristensenH. Attentional landmark selection for visual SLAM [C]. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2006, Beijing, China, IEEE: 2582-2587

[9] ThrunS, BurgardW, FoxDProbabilistic robotics [M], 2006, Cambridge, USA, MIT Press: 323-329

[10] ComaniciuD, MeerP. Mean shift: A robust approach toward feature space analysis [J]. IEEE Trans Pattern Anal Machine Intell, 2002, 24: 603-619

[11] RAWSEEDS.Robotics advancement through web-publishing of sensorial and elaborated extensive data sets [EB/OL], 2009

[12] IttiL, KochC, NieburE. Model of saliency based visual attention for rapid scene analysis [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 1998, 20(11): 1254-1259

[13] LivingstoneM, HubelD. Anatomy and physiology of a color system in the primate visual cortex [J]. Journal Neurosci, 1984, 4: 309-356

[14] EngelS, ZhangX, WandellB. Colour tuning in human visual cortex measured with functional magnetic resonance imaging [J]. Nature, 1997, 388(6637): 68-71

[15] ComaniciuD, MeerP. Mean shift: A robust approach toward feature space analysis [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5): 603-619

[16] RAWSEEDSRobotics Advancement through Web-publishing of Sensorial and Elaborated Extensive Data Sets, Bicocca 2009-02-25b [EB/OL], 2009

[17] WilliamsB, CumminsM, NeiraJ, NewmanP, ReidI, TardosJ. A comparison of loop closing techniques in monocular SLAM [J]. Robotics and Autonomous Systems, 2009, 57(12): 1188-1197