Face recognition algorithm using collaborative sparse representation based on CNN features

Abstract

Considering that the algorithm accuracy of the traditional sparse representation models is not high under the influence of multiple complex environmental factors, this study focuses on the improvement of feature extraction and model construction. Firstly, the convolutional neural network(CNN) features of the face are extracted by the trained deep learning network. Next, the steady-state and dynamic classifiers for face recognition are constructed based on the CNN features and Haar features respectively, with two-stage sparse representation introduced in the process of constructing the steady-state classifier and the feature templates with high reliability are dynamically selected as alternative templates from the sparse representation template dictionary constructed using the CNN features. Finally, the results of face recognition are given based on the classification results of the steady-state classifier and the dynamic classifier together. Based on this, the feature weights of the steady-state classifier template are adjusted in real time and the dictionary set is dynamically updated to reduce the probability of irrelevant features entering the dictionary set. The average recognition accuracy of this method is 94.45% on the CMU PIE face database and 96.58% on the AR face database, which is significantly improved compared with that of the traditional face recognition methods.

Keywords

sparse representation / deep learning / face recognition / dictionary update / feature extraction

References

[1] CHAUDHRY A, ELGAZZAR H. Design and implementation of a hybrid face recognition technique//2019 IEEE 9th Annual Computing and Communication Workshop and Conference, January 7-9, 2019, Las Vegas, NV, USA. New York: IEEE, 2019: 384-391.

[2] DONOHO D L. Compressed sensing. IEEE Transactions on Information Theory, 2006, 52(4): 1289-1306.

[3] WRIGHT J, YANG A Y, GANESH A,et al. Robust face recognition via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(2): 210-227.

[4] SUN Y B, LIU Q S, TANG J H, et al. Learning discriminative dictionary for group sparse representation. IEEE Transactions on Image Processing, 2014, 23(9): 3816-3828.

[5] ZAMANI F, JAMZAD M, RABIEE H R. Atom specific multiple kernel dictionary based sparse representation classifier for medium scale image classification. Journal of Visual Communication and Image Representation, 2021, 79: 103228.

[6] YAN C M, ZHANG Y Y, ZHANG D. Face recognition based on improved label consistent KSVD dictionary learning. Computer Engineering & Science, 2022, 44(2): 291-297.

[7] DI L, JIE H W, LIANG J Z. Sparse integrated dictionary learning for small-sample face recognition. Journal of Intelligent Systems, 2021, 16(2): 218-227.

[8] MA X, ZHANG P D, FENG J F. Sparse representation via deep learning features based face recognition method. CAAI Transactions on Intelligent Systems, 2016, 11(3): 279-286.

[9] HUANG X Y, LIU F, BAO Q Y, et al. A face correction recognition method for generative adversarial networks based on multi-task learning and identity constraints. Journal of Electronics, 2023(10): 2936-2949.

[10] HU L R, LI X, TAN K. Mask face recognition algorithm based on improved attention mechanism. Computer Simulation, 2023, 40(7): 180-183.

[11] LI X S, DING W J, FANG Y, et al. Occluded face recognition based on image depth prior and robust markov random field. Computer Science, 2024, 51(7): 244-256.

[12] WANG J J, SONG S H, DU Y M. Simulation of local blur face image recognition considering Gabor wavelet features. Computer Simulation, 2023, 40(9): 237-241.

[13] LIU X M, ZHAO H P. Research on face recognition under illumination variation based on Retinex algorithm. Laser Journal, 2023, 44(7): 218-222.

[14] ZUO M, XIE S G, ZHANG X, et al. DOA estimation based on weighted l₁-norm sparse representation for low SNR scenarios. Sensors, 2021, 21(13): 4614.

[15] NAKACHI T, KIYA H. L0 norm optimization in scrambled sparse representation domain and its application to EtC system. IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences, 2020, 103(12): 1589-1598.

[16] BLAUCH N M, BEHRMANN M, PLAUT D C. Computational insights into human perceptual expertise for familiar and unfamiliar face recognition. Cognition, 2021, 208: 104341.

[17] BHASHA A V, VENKATRAMANA REDDY B D. Automated image super resolution with the aid of activation function optimized deep CNN and adaptive wavelet lifting approach. International Journal of Image and Graphics, 2022, 22(5): 2250046.

[18] SONG W F, LI S, LIU J, et al. Multitask cascade convolution neural networks for automatic thyroid nodule detection and recognition. IEEE Journal of Biomedical and Health Informatics, 2019, 23(3): 1215-1224.

[19] SUN Z, CHIONG R, HU Z P, et al. Deep subspace learning for expression recognition driven by a two-phase representation classifier. Signal, Image and Video Processing, 2020, 14(3): 437-444.

[20] GUO J M, YANG J S, SESHATHIRI S, et al. A light-weight CNN for object detection with sparse model and knowledge distillation. Electronics, 2022, 11(4): 575.

[21] DU H, SHI H L, ZENG D, et al. The elements of end-to-end deep face recognition: a survey of recent advances. ACM Computing Surveys, 2022, 54(10s): 1-42.

[22] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition//2016 IEEE Conference on Computer Vision and Pattern Recognition, June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 2016: 770-778.

[23] HAN C R, SHAN S G, KAN M N, et al. Personalized convolution for face recognition. International Journal of Computer Vision, 2022, 130(2): 344-362.

[24] HAMMOUCHE R, ATTIA A, AKHROUF S, et al. Gabor filter bank with deep autoencoder based face recognition system. Expert Systems with Applications, 2022, 197: 116743.

[25] NGUYEN T S, LUONG M, KAANICHE M, et al. A novel multi-branch wavelet neural network for sparse representation based object classification. Pattern Recognition, 2023, 135: 109155.

[26] AKHAVAN S, BAGHESTANI F, KAZEMI P, et al. Dictionary learning for sparse representation of signals with hidden Markov model dependency. Digital Signal Processing, 2022, 123: 103420.

[27] LIAO M M, GU X D. Face recognition based on dictionary learning and subspace learning. Digital Signal Processing, 2019, 90: 110-124.

[28] YANG S C, WEN Y, HE L H, et al. Sparse common feature representation for undersampled face recognition. IEEE Internet of Things Journal, 2021, 8(7): 5607-5618.

[29] KONG Y, WANG T Y, FENG Z P, et al. Discriminative dictionary learning based sparse representation classification for intelligent fault identification of planet bearings in wind turbine. Renewable Energy, 2020, 152: 754-769.

[30] HUBEL D H, WIESEL T N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. The Journal of Physiology, 1962, 160(1): 106-154.

[31] WAIBEL A, HANAZAWA T, HINTON G,et al. Phoneme recognition using time-delay neural networks. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1989, 37(3): 328-339.

[32] YANG X L, LI M, ZHAO S L, et al. Facial expression recognition algorithm based on CNN and LBP feature fusion//3rd International Conference on Robotics and Artificial Intelligence,December 29-31, 2017, Shanghai, China. New York: ACM, 2017: 33-38.