Nearest-neighbor classifier motivated marginal discriminant projections for face recognition

Abstract

Marginal Fisher analysis (MFA) is a representative margin-based learning algorithm for face recognition. A major problem in MFA is how to select appropriate parameters, k₁ and k₂, to construct the respective intrinsic and penalty graphs. In this paper, we propose a novel method called nearest-neighbor (NN) classifier motivated marginal discriminant projections (NN-MDP). Motivated by the NN classifier, NN-MDP seeks a few projection vectors to prevent data samples from being wrongly categorized. Like MFA, NN-MDP can characterize the compactness and separability of samples simultaneously. Moreover, in contrast to MFA, NN-MDP can actively construct the intrinsic graph and penalty graph without unknown parameters. Experimental results on the ORL, Yale, and FERET face databases show that NN-MDP not only avoids the intractability, and high expense of neighborhood parameter selection, but is also more applicable to face recognition with NN classifier than other methods.

Keywords

dimensionality reduction (DR) / face recognition / marginal Fisher analysis (MFA) / locality preserving projections (LPP) / graph construction / margin-based / nearest-neighbor (NN) classifier

References

[1] Turk M, Pentland A. Eigenfaces for recognition. Journal of Cognitive Neuroscience, 1991, 3(1): 71-86

[2] Martinez A M, Kak A C. PCA versus LDA. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(2): 228-233

[3] Belhumeur P N, Hespanha J P, Kriegman D J. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 711-720

[4] Tenenbaum J B, De S V, Langford J C. A global geometric framework for nonlinear dimensionality reduction. Science, 2000, 290(5500): 2319-2323

[5] Roweis S T, Saul L K. Nonlinear dimensionality reduction by locally linear embedding. Science, 2000, 290(5500): 2323-2326

[6] Belkin M, Niyogi P. Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Computation, 2003, 15(6): 1373-1396

[7] Yan S C, Xu D, Zhang B Y, Zhang H J, Yang Q, Lin S. Graph embedding and extensions: A general framework for dimensionality reduction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(1): 40-51

[8] He X, Niyogi P. Locality preserving projections. In: Proceedings of 2003 Neural Information Processing Systems. 2003, 153-160

[9] Yang J, Zhang D, Yang J Y, Niu B. Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(4): 650-664

[10] Yu W W, Teng X L, Liu C Q. Face recognition using discriminant locality preserving projections. Image and Vision Computing, 2006, 24(3): 239-248

[11] Zhao H T, Sun S Y, Jing Z L, Yang J Y. Local structure based supervised feature extraction. Pattern Recognition, 2006, 39(8): 1546-1550

[12] Sugiyama M. Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis. Journal of Machine Learning Research, 2007, 8(May): 1027-1061

[13] Xu D, Yan S C, Tao D C, Lin S, Zhang H J. Marginal Fisher analysis and its variants for human Gait recognition and content-based image retrieval. IEEE Transactions on Image Processing, 2007, 16(11): 2811-2821

[14] Huang P, Chen C K. Enhanced marginal Fisher analysis for face recognition. In: Proceedings of 2009 International Conference on Artificial Intelligence and Computational Intelligence. 2009, 403-407

[15] Zhao C R, Lai Z H, Sui Y, Chen Y. Local maximal marginal embedding with application to face recognition. In: Proceeding of 2008 Chinese Conference on Pattern Recognition. 2008, 1-6

[16] Xu J, Yang J. Nonparametric Marginal Fisher analysis for feature extraction. In: Proceedings of 6th International Conference on Intelligent Computing. 2010, 221-228

[17] Cai D, He X, Zhou K, Han J, Bao H. Locality sensitive discriminant analysis. In: Proceedings of 20th International Joint Conference on Artificial Intelligence. 2007, 708-713

[18] Yang B, Chen S C. Sample-dependent graph construction with application to dimensionality reduction. Neurocomputing, 2010, 74(1-3): 301-314

[19] Zhang L, Qiao L, Chen S C. Graph-optimized locality preserving projections. Pattern Recognition, 2010, 43(6): 1993-2002

[20] Qiao L, Chen S C. Sparsity preserving discriminant analysis for single training image face recognition. Pattern Recognition Letters, 2010, 31(5): 422-429

[21] Qiao L, Chen S C, Tan X. Sparsity preserving projections with applications to face recognition. Pattern Recognition, 2010, 43(1): 331-341

[22] Li S Z, Lu J W. Face recognition using the nearest feature line method. IEEE Transactions on Neural Networks, 1999, 10(2): 439-443

[23] Yu H, Yang J. A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recognition, 2001, 34(11): 2067-2070

[24] Gu Z H, Yang J. Sparse margin based discriminant analysis for face recognition. In: Proceedings of 17th IEEE International Conference on Image Processing. 2010, 1669-1672

[25] Huang J B, Yang M H. Fast sparse representation with prototypes. In: Proceedings of 23rd IEEE Conference on Vision and Pattern Recognition. 2010, 3618-3625

[26] Vapnik V N. The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995

Acknowledgements

This work was partially supported by the National Science Foundation of China (Grant Nos. 60973098, 90820306 and 60875004).

RIGHTS & PERMISSIONS

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg