Real-time object tracking via compressive feature selection

Abstract

Recently, compressive tracking (CT) has been widely proposed for its efficiency, accuracy and robustness on many challenging sequences. Its appearance model employs non-adaptive random projections that preserve the structure of the image feature space. A very sparse measurement matrix is used to extract features by multiplying it with the feature vector of the image patch. An adaptive Bayes classifier is trained using both positive samples and negative samples to separate the target from background. On the CT framework, however, some features used for classification have weak discriminative abilities, which reduces the accuracy of the strong classifier. In this paper, we present an online compressive feature selection algorithm(CFS) based on the CT framework. It selects the features which have the largest margin when using them to classify positive samples and negative samples. For features that are not selected, we define a random learning rate to update them slowly. It makes those weak classifiers preserve more target information, which relieves the drift when the appearance of the target changes heavily. Therefore, the classifier trained with those discriminative features couples its score in many challenging sequences, which leads to a more robust tracker. Numerous experiments show that our tracker could achieve superior result beyond many state-of-the-art trackers.

Keywords

object tracking / compressive sensing / supervised learning / real-time

References

[1] Danelljan M, Khan F S, Felsberg M, Weijer J. Adaptive color attributes for real-time visual tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2014, 1090–1097

[2] Fiaschi L, Diego F, Gregor K, Schieyg M, Koethe U, Zlatic M, Hamprecht F. Tracking indistinguishable translucent objects over time using weakly supervised structured learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 2736–2743

[3] Kwon J, Lee K M. Interval tracker: tracking by interval analysis. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 3494–3501

[4] Lee D Y, Sim J Y, Kim C S. Visual tracking using pertinent patch selection and masking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2014, 3486–3493

[5] Kwon J, Roh J, Lee K M, Van Gool L. Robust visual tracking with double bounding box model. In: Proceedings of the 13th European Conference on Computer Vision. 2014, 377–392

[6] Hall D, Perona P. Online, real-time tracking using a category-toindividual detector. In: Proceedings of the 13th European Conference on Computer Vision. 2014, 361–376

[7] Gao J, Ling H, Hu W, Xing J. Transfer learning based visual tracking with gaussian processes regression. In: Proceedings of the 13th European Conference on Computer Vision. 2014, 188–203

[8] Yang H, Shao L, Zheng F, Wang L, Song Z. Recent advances and trends in visual tracking: a review. Neurocomputing, 2011, 74(18): 3823–3831

[9] Yilmaz A, Javed O, Shah M. Object tracking: a survey. ACM computing surveys, 2006, 38(4)

[10] Isard M, MacCormick J. BraMBLe: a Bayesian multiple-blob tracker. In: Proceedings of the 8th International Conference on Computer Vision. 2001, 2: 34–41

[11] Lepetit V, Fua P. Keypoint recognition using randomized trees. Pattern Analysis and Machine Intelligence, 2006, 28(9): 1465–1479

[12] Hager G D, Belhumeur P N. Efficient region tracking with parametric models of geometry and illumination. Pattern Analysis and Machine Intelligence, 1998, 20(10): 1025–1039

[13] Comaniciu D, Ramesh V, Meer P. Real-time tracking of non-rigid objects using mean shift. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2000, 142–149

[14] Grabner H, Grabner M, Bischof H. Real-time tracking via on-line boosting. In: Proceedings of British Machine Vision Conference. 2006

[15] Mei X, Ling H. Robust visual tracking using l1 minimization. In: Proceedings of the 12th IEEE International Conference on Computer Vision. 2009, 1436–1443

[16] Huang Z, He F Z, Cai X T, Zou Z, Liu J, Liang M, Chen X. Efficient random saliency map detection. Science China Information Sciences, 2011, 54(6): 1207–1217

[17] Liu H, He F, Cai X, Chen X, Chen Z. Performance-based control interfaces using mixture of factor analyzers. The Visual Computer, 2011, 27: 595–603

[18] Liu H J, He F Z, Zhu F X, Zhu Q. Real-time control of human actions using inertial sensors. Science China Information Sciences, 2014, 57(7): 1–11

[19] Chen K, Zhao L J. Robust realtime face recognition and tracking system. Journal of Computer Science & Technology, 2009, 9

[20] Lin R S, Ross D A, Lim J, Yang M H. Adaptive discriminative generative model and its applications. In: Proceedings of Advances in Neural Information Processing Systems. 2004, 801–808

[21] Black M J, Jepson A D. Eigentracking: robust matching and tracking of articulated objects using a view-based representation. International Journal of Computer Vision, 1998, 26(1): 63–84

[22] Jepson A D, Fleet D J, El-Maraghi T F. Robust online appearance models for visual tracking. Pattern Analysis and Machine Intelligence, 2003, 25(10): 1296–1311

[23] Adam A, Rivlin E, Shimshoni I. Robust fragments-based tracking using the integral histogram. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2006, 798–805

[24] Ross D A, Lim J, Lin R S, Yang M H. Incremental learning for robust visual tracking. International Journal of Computer Vision, 2008, 77(1): 125–141

[25] Lim J, Ross D A, Lin R S, Yang M H. Incremental learning for visual tracking. In: Proceedings of Advances in Neural Information Processing Systems. 2004, 793–800

[26] Liu L W, Ai H Z. Learning structure models with context information for visual tracking. Journal of Computer Science and Technology, 2013, 28(5): 818–826

[27] Avidan S. Support vector tracking. Pattern Analysis and Machine Intelligence, 2004, 26(8): 1064–1072

[28] Avidan S. Ensemble tracking. Pattern Analysis and Machine Intelligence, 2007, 29(2): 261–271

[29] Grabner H, Leistner C, Bischof H. Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European Conference on Computer Vision. 2008, 234–247

[30] Kalal Z, Matas J, Mikolajczyk K. P-N learning: bootstrapping binary classifiers by structural constraints. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2010, 49–56

[31] Zhou Q H, Lu H, Yang M H. Online multiple support instance tracking. In: Proceedings of Automatic Face & Gesture Recognition and Workshops. 2011, 545–552

[32] Hare S, Saffari A, Torr P H S. Struck: structured output tracking with kernels. In: Proceedings of the 2011 International Conference on Computer Vision. 2011, 263–270

[33] Babenko B, Yang M H, Belongie S. Visual tracking with online multiple instance learning. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2009, 983–990

[34] Zhang K, Zhang L, Yang M H. Real-time object tracking via online discriminative feature selection. IEEE Transactions on Image Processing, 2013, 22(12): 4664–4677

[35] Collins R T, Liu Y, Leordeanu M. Online selection of discriminative tracking features. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(10): 1631–1643

[36] Zhang K, Zhang L, Yang M H. Real-time compressive tracking. In: Proceedings of the 12th European Conference on Computer Vision. 2012, 864–877

[37] Achlioptas D. Database-friendly random projections: Johnson- Lindenstrauss with binary coins. Journal of Computer and System Sciences, 2003, 66(4): 671–687

[38] Baraniuk R, Davenport M, DeVore R, Wakin M. A simple proof of the restricted isometry property for random matrices. Constructive Approximation, 2008, 28(3): 253–263

[39] Gonzalez R C. Digital image processing. Pearson Education India, 2009, 116–119

[40] Jordan A. On discriminative vs. generative classifiers: a comparison of logistic regression and naive bayes. Advances in Neural Information Processing Systems, 2002, 14: 841

[41] Duda R O, Hart P E, Stork D G. Pattern Classification. New York: John Wiley & Sons, 2012, 45–46

[42] Sevilla-Lara L, Learned-Miller E. Distribution fields for tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2012, 1910–1917

[43] Oron S, Bar-Hillel A, Levi D, Avidan S. Locally orderless tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2012, 1940–1947

[44] Liu B, Huang J, Yang L, Kulikowsk C. Robust tracking using local sparse appearance model and k-selection. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2011, 1313–1320

[45] Henriques J F, Caseiro R, Martins P, Batista J. Exploiting the circulant structure of tracking-by-detection with kernels. In: Proceedings of the 12th European Conference on Computer Vision. 2012, 702–715

[46] Kwon J, Lee K M. Tracking by sampling trackers. In: Proceedings of International Conference on Computer Vision. 2011, 1195–1202

[47] Kwon J, Lee K M. Visual tracking decomposition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2010, 1269–1276

[48] Wang D, Lu H, Yang M H. Least soft-threshold squares tracking. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2013, 2371–2378

[49] Wang D, Lu H. Visual tracking via probability continuous outlier model. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2014, 3478–3485

[50] Li Y, Zhu J, Hoi S C H. Reliable patch trackers: robust visual tracking by exploiting reliable patches. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2015, 353–361

[51] Wu Y, Lim J, Yang M H. Online object tracking: a benchmark. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2013, 2411–2418

[52] Cai X T, He F Z, Li W D, Li X X, Wu Y Q. Encryption based partial sharing of CAD models, Integrated Computer-Aided Engineering, 2015, 22(3): 243–260

[53] Li X X, He F Z, Cai X T, Zhang D J, Chen Y L. A method for topological entity matching in the integration of heterogeneous cad systems. Integrated Computer-Aided Engineering, 2013, 20(1): 15–30

[54] Cheng Y, He F Z, Cai X T, Zhang D J. A group Undo/Redo method in 3D collaborative modeling systems with performance evaluation. Journal of Network and Computer Applications, 2013, 36(6): 1512–1522

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg 2016