Advancing the incremental fusion of robotic sensory features using online multi-kernel extreme learning machine

Abstract

Robot recognition tasks usually require multiple homogeneous or heterogeneous sensors which intrinsically generate sequential, redundant, and storage demanding data with various noise pollution. Thus, online machine learning algorithms performing efficient sensory feature fusion have become a hot topic in robot recognition domain. This paper proposes an online multi-kernel extreme learning machine (OM-ELM) which assembles multiple ELM classifiers and optimizes the kernel weights with a p-norm formulation of multi-kernel learning (MKL) problem. It can be applied in feature fusion applications that require incremental learning over multiple sequential sensory readings. The performance of OM-ELM is tested towards four different robot recognition tasks. By comparing to several state-of-the-art online models for multi-kernel learning, we claim that our method achieves a superior or equivalent training accuracy and generalization ability with less training time. Practical suggestions are also given to aid effective online fusion of robot sensory features.

Keywords

multi-kernel learning / online learning / extreme learning machine / feature fusion / robot recognition

References

[1] Sonnenburg S, Rätsch G, Schäfer C, Schölkopf B. Large scale multiple kernel learning. The Journal of Machine Learning Research, 2006, 7: 1531–1565

[2] Lanckriet G R, Cristianini N, Bartlett P, Ghaoui L E, Jordan M I. Learning the kernel matrix with semidefinite programming. The Journal of Machine Learning Research, 2004, 5: 27–72

[3] Zien A, Ong C S. Multiclass multiple kernel learning. In: Proceedings of International Conference on Machine Learning. 2007, 1191–1198

[4] Rakotomamonjy A, Bach F, Canu S, Grandvalet Y. Simplemkl. Journal of Machine Learning Research, 2008, 9: 2491–2521

[5] Shalev-Shwartz S. Online learning and online convex optimization. Foundations and Trends in Machine Learning, 2011, 4(2): 107–194

[6] Cesa-Bianchi N, Lugosi G. Prediction, Learning, and Games. Cambridge: Cambridge University Press, 2006

[7] Huang G B, Zhu Q Y, Siew C K. Extreme learning machine: theory and applications. Neurocomputing, 2006, 70(1): 489–501

[8] Huang G B, Chen L, Siew C K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Transactions on Neural Networks, 2006, 17(4): 879–892

[9] Lowe D G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision, 2004, 60(2): 91–110

[10] Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2005, 886–893

[11] Van De Weijer J, Schmid C. Coloring local feature extraction. In: Proceedings of European Conference on Computer Vision. 2006, 334–348

[12] Wang H, Ullah M M, Klaser A, Laptev I, Schmid C. Evaluation of local spatio-temporal features for action recognition. In: Proceedings of British Machine Vision Conference. 2009, 1–11

[13] Taylor G W, Fergus R, LeCun Y, Bregler C. Convolutional learning of spatio-temporal features. In: Proceedings of European Conference on Computer Vision. 2010, 140–153

[14] Li Z, Liu J, Yang Y, Zhou X, Lu H. Clustering-guided sparse structural learning for unsupervised feature selection. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(9): 2138–2150

[15] Li Z, Liu J, Tang J, Lu H. Robust structured subspace learning for data representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(1): 2085–2098

[16] Kokar M M, Tomasik J A, Weyman J. Formalizing classes of information fusion systems. Information Fusion, 2004, 5(3): 189–202

[17] Khaleghi B, Khamis A, Karray F O, Razavi S N. Multisensor data fusion: a review of the state-of-the-art. Information Fusion, 2011, 14(1): 28–44

[18] Waske B, Benediktsson J A. Fusion of support vector machines for classification of multisensor data. IEEE Transactions on Geoscience and Remote Sensing, 2007, 45(12): 3858–3866

[19] Reiter A, Allen P K, Zhao T. Learning features on robotic surgical tools. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2012, 38–43

[20] Campos F M, Correia L, Calado J. Robot visual localization through local feature fusion: an evaluation of multiple classifiers combination approaches. Journal of Intelligent and Robotic Systems, 2015, 77(2): 377–390

[21] Jie L, Orabona F, Fornoni M, Caputo B, Cesa-Bianchi N. OM-2: an online multi-class multi-kernel learning algorithm. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2010, 43–50

[22] Gijsberts A, Metta G. Incremental learning of robot dynamics using random features. In: Proceedings of IEEE International Conference on Robotics and Automation. 2011, 951–956

[23] Nguyen-Tuong D, Peters J. Incremental online sparsification for model learning in real-time robot control. Neurocomputing, 2011, 74(11): 1859–1867

[24] Cho S, Jo S. Incremental online learning of robot behaviors from selected multiple kinesthetic teaching trials. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2013, 43(3): 730–740

[25] Jamone L, Natale L, Nori F, Metta G, Sandini G. Autonomous online learning of reaching behavior in a humanoid robot. International Journal of Humanoid Robotics, 2012, 9(10): 6–8

[26] Luo J, Pronobis A, Caputo B, Jensfelt P. Incremental learning for place recognition in dynamic environments. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. 2007, 721–728

[27] Ciliberto C, Smeraldi F, Natale L, Metta G. Online multiple instance learning applied to hand detection in a humanoid robot. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. 2011, 1526–1532

[28] Araki T, Nakamura T, Nagai T, Funakoshi K, Nakano M, Iwahashi N. Online object categorization using multimodal information autonomously acquired by robots. Advanced Robotics, 2012, 26(17): 1995–2020

[29] Su L j, Yao M. Extreme learning machine with multiple kernels. In: Proceedings of IEEE International Conference on Control and Automation. 2013, 424–429

[30] Liu X, Wang L, Huang G B, Zhang J, Yin J. Multiple kernel extreme learning machine. Neurocomputing, 2015, 149: 253–264

[31] Cao L L, Huang W B, Sun F C. Optimization-based extreme learning machine with multi-kernel learning approach for classification. In: Proceedings of International Conference on Pattern Recognition. 2014, 3564–3569

[32] Liang N Y, Huang G B, Saratchandran P, Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Transaction on Neural Networks, 2006, 17(6): 1411–1423

[33] Hoang M T T, Huynh H T, Vo N H, Won Y. A robust online sequential extreme learning machine. Lecture Notes in Computer Science, 2007, 4491: 1077–1086

[34] Lan Y, Soh Y C, Huang G B. Ensemble of online sequential extreme learning machine. Neurocomputing, 2009, 72(13): 3391–3395

[35] Hush D, Kelly P, Scovel C, Steinwart I. QP algorithms with guaranteed accuracy and run time for support vector machines. The Journal of Machine Learning Research, 2006, 7: 733–769

[36] Jie L, Orabona F, Caputo B. An online framework for learning novel concepts over multiple cues. In: Proceedings of Asian Conference on Computer Vision. 2010, 269–280

[37] Hoi S C, Jin R, Zhao P, Yang T. Online multiple kernel classification. Machine Learning, 2013, 90(2): 289–316

[38] Huang G B, Ding X, Zhou H. Optimization-based extreme learning machine for classification. Neurocomputing, 2010, 74(1): 155–163

[39] Huang G B, Zhou H, Ding X, Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Transactions on Systems, Man, and Cybernetics: Cybernetics, 2012, 42(2): 513–529

[40] Huang G B. What are extreme learning machines? filling the gap between Frank Rosenblatt’s dream and John von Neumann’s puzzle. Cognitive Computation, 2015, 7(3): 263–278

[41] Orabona F, Jie L, Caputo B. Multi kernel learning with online-batch optimization. The Journal of Machine Learning Research, 2012, 13(1): 227–253

[42] Orabona F, Jie L, Caputo B. Online-batch strongly convex multi kernel learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2010, 787–794

[43] Fink M, Shalev-Shwartz S, Singer Y, Ullman S. Online multiclass learning by interclass hypothesis sharing. In: Proceedings of International Conference on Machine Learning. 2006, 313–320

[44] Huang G B, Wang D H, Lan Y. Extreme learning machines: a survey. International Journal of Machine Learning and Cybernetics, 2011, 2(2): 107–122

[45] Bach F R, Lanckriet G R, Jordan M I. Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of International Conference on Machine Learning. 2004, 6

[46] Jin R, Hoi S C, Yang T. Online multiple kernel learning: algorithms and mistake bounds. Lecture Notes in Computer Science, 2010, 6331(4): 390–404

[47] Xiao W, Sun F C, Liu H P, He C. Dexterous robotic-hand grasp learning using piecewise linear dynamic systems model. In: Proceedings of International Conference on Cognitive Systems and Information Processing. 2014, 845–855

[48] Xiao W, Sun F C, Liu H P, Huang C. Manipulation techniques of dexterous robotic hand based on cyber-physical fusion. Journal of Tsinghua University (Science and Technology), 2013, 11: 1601–1608

[49] Bekiroglu Y, Kragic D, Kyrki V. Learning grasp stability based on tactile data and hmms. In: Proceedings of IEEE International Symposium on Robot and Human Interactive Communication. 2010, 132–137

[50] Bekiroglu Y, Laaksonen J, Jorgensen J A, Kyrki V, Kragic D. Assessing grasp stability based on learning and haptic data. IEEE Transactions on Robotics, 2011, 27(3): 616–629

[51] Yang J, Liu H, Sun F, Gao M. Tactile sequence classification using joint kernel sparse coding. In: Proceedings of International Joint Conference on Neural Networks. 2015, 1–6

[52] Lazebnik S, Schmid C, Ponce J. Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2006, 2169–2178

[53] Madry M, Bo L, Kragic D, Fox D. ST-HMP: Unsupervised spatiotemporal feature learning for tactile data. In: Proceedings of IEEE International Conference on Robotics and Automation. 2014, 2262–2269

[54] Orabona F. DOGMA: a Matlab toolbox for online learning, 2009

[55] Bo L, Ren X, Fox D. Hierarchical matching pursuit for image classification: architecture and fast algorithms. In: Proceedings of Conference on Neural Information Processing Systems. 2011, 2115–2123

[56] Hinton G. A practical guide to training restricted boltzmann machines. Momentum, 2010, 9(1): 926

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg