Face anti-spoofing algorithm combined with CNN and brightness equalization

Abstract

Face anti-spoofing is a relatively important part of the face recognition system, which has great significance for financial payment and access control systems. Aiming at the problems of unstable face alignment, complex lighting, and complex structure of face anti-spoofing detection network, a novel method is presented using a combination of convolutional neural network and brightness equalization. Firstly, multi-task convolutional neural network (MTCNN) based on the cascade of three convolutional neural networks (CNNs), P-net, R-net, and O-net are used to achieve accurate positioning of the face, and the detected face bounding box is cropped by a specified multiple, then brightness equalization is adopted to perform brightness compensation on different brightness areas of the face image. Finally, data features are extracted and classification is given by utilizing a 12-layer convolution neural network. Experiments of the proposed algorithm were carried out on CASIA-FASD. The results show that the classification accuracy is relatively high, and the half total error rate (HTER) reaches 1.02%.

Keywords

face anti-spoofing / MTCNN / brightness equalization / convolutional neural network

References

[1] RamachandraR, BuschC. Presentation attack detection methods for face recognition systems: A comprehensive survey [J]. ACM Computing Surveys (CSUR), 2017, 50(1): 1-37

[2] ZhangC, GuY, HuK, WangY G. Face recognition using SIFT features under 3D meshes [J]. Journal of Central South University, 2015, 22(5): 1817-1825

[3] MehrasaN, AliA, HomayunM. A supervised multimanifold method with locality preserving for face recognition using single sample per person [J]. Journal of Central South University, 2017, 24(12): 2853-2861

[4] MaattaJ, HadidA, PiekikainenM. Face spoofing detection from single images using micro-texture analysis [C]. 2011 International Joint Conference on Biometrics (IJCB), 2011, Washington, IEEE, 17

[5] TanX, LiY, LiuJ, LinJ. Face liveness detection from a single image with sparse low rank bilinear discriminative model [C]. European Conference on Computer Vision, 2010, Berlin, Heidelberg, Springer, 504517

[6] de FreitasP T, AnjosA, de MartinoJ M, MarcelS. Can face anti-spoofing countermeasures work in a real world scenario? [C]. 2013 International Conference on Biometrics (ICB), 2013, Madrid, IEEE, 18

[7] ChingovskaI, AnjosA, MarcelS. On the effectiveness of local binary patterns in face anti-spoofing [C]. 2012 BIOSIG-Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG), 2012, Darmstadt, IEEE, 17

[8] KollreiderK, FrontharelH, FarajM I, bigunJ. Real-time face detection and motion analysis with application in “liveness” assessment [J]. IEEE Transactions on Information Forensics and Security, 2007, 2(3): 548-558

[9] de MarsicoM, NappiM, RiccioD, DugelayJ. Moving face spoofing detection via 3D projective invariants [C]. 5th IAPR International Conference on Biometrics (ICB), 2012, New Delhi, IEEE, 7378

[10] PavlidisI, SymosekP. The imaging issue in an automatic face/disguise detection system [C]. Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Application (Cat. No. PR00640), 2000, South Carolina, IEEE, 1524

[11] YangJ, LeiZ, LiS Z. Learn convolutional neural network for face anti-spoofing [J]. Computer Science, 2014, 9218: 373-384

[12] LiuY, JourablooA, LiuX. Learning deep models for face anti-spoofing: Binary or auxiliary supervision [C]. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018, 2018, Salt Lake City, IEEE, 389398

[13] AtoumY, LiuY, JourablooA, LiuX. Face anti-spoofing using patch and depth-based CNNs [C]. 2017 IEEE International Joint Conference on Biometrics (IJCB), 2017, Denver, IEEE, 319328

[14] RehmanY A U, PoL M, liuM. Deep learning for face anti-spoofing: An end-to-end approach [C]. 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), 2017, Poznan, IEEE, 195200

[15] ViolaP, JonesM J. Robust real-time face detection [J]. International Journal of Computer Vision, 2004, 57(2): 137-154

[16] ZhangK, ZhangZ, LiZ, QiaoY. Joint face detection and alignment using multitask cascaded convolutional networks [J]. IEEE Signal Processing Letters, 2016, 23(10): 1499-1503

[17] PengX-b, JiangJ-guo. An image segmentation thresholding method based on luminance proportion [J]. Computer Technology and Development, 2006, 16(11): 10-12(in Chinese)

[18] ZhangZ, YanJ, LiuS, LeiZ, LiS Z. A face antispoofing database with diverse attacks [C]. 5th IAPR International Conference on Biometrics (ICB), 2012, New Delhi, IEEE, 2631

[19] XuZ, LiS, DengW. Learning temporal features using LSTM-CNN architecture for face anti-spoofing [C]. 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), 2015, Kuala Lumpur, IEEE, 141145

[20] LiL, FengX, BoulkenafetZ, XiaZ, LiM, HadidA. An original face anti-spoofing approach using partial convolutional neural network [C]. Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA), 2016, Oulu, IEEE, 16

[21] GanJ, LiS, ZhaiY, LiuC. 3d convolutional neural network based on face anti-spoofing [C]. 2nd international conference on multimedia and image processing (ICMIP), 2017, Wuhan, IEEE, 15