Facial expression recognition based on improved completed local ternary patterns

Abstract

The information of expression texture extracted by the completed local ternary patterns (CLTP) method is not accurate enough, which may cause low recognition rate. Therefore, an improved completed local ternary patterns (ICLTP) is proposed here. Firstly, the Scharr operator is used to calculate gradient magnitudes of images to enhance the detail of texture, which is beneficial to obtaining more accurate expression features. Secondly, two different neighborhoods of CLTP features are combined to obtain much information of facial expression. Finally, K nearest neighbor (KNN) and sparse representation classifier (SRC) are combined for classification and a 10-fold cross-validation method is tested in the JAFFE and CK+ databases. The results show that the ICLTP method can improve the recognition rate of facial expression and reduce the confusion between various expressions. Especially, the misrecognition rate of other six expressions recognized as neutral is reduced in the 7-class expression recognition.

References

[1] ShanC, GongS, McowanP W. Image & Vision Computing, 2009, 27: 803

[2] ZhaoG, PietikäinenM. Pattern Recognition Letters, 2009, 30: 1117

[3] Doshi N P, Schaefer G and Hossain S, Improved Dominant Local Binary Pattern Texture Features, IEEE International Conference on Informatics, Electronics and Vision, 1157 (2016).

[4] JabidT, KabirM H, ChaeO. ETRI Journal, 2010, 32: 784

[5] TanX, TriggsB. IEEE Transactions on Image Processing, 2010, 19: 1635

[6] RassemT H, KhooB E. The Scientific World Journal, 2014, 2014: 254

[7] Rassem T H, Mohammed M F and Khoo B E, Performance Evaluation of Completed Local Ternary Patterns (CLTP) for Medical, Scene and Event Image Categorisation, IEEE International Conference on Software Engineering and Computer Systems, 33 (2015).

[8] AhmedF, HossainE. Chinese Journal of Engineering, 2013, 2013: 1

[9] Ameur B, Masmoudi S and Derbel A G, Fusing Gabor and LBP Feature Sets for KNN and SRC-based Face Recognition, IEEE International Conference on Advanced Technologies for Signal and Image Processing, 453 (2016).

[10] RiveraAR, CastilloJR, ChaeO. Pattern Recognition Letters, 2015, 51: 94

[11] RiveraAR, CastilloJR, ChaeO. IEEE Transactions on Image Processing, 2013, 22: 1740

[12] HolderR P, TapamoJ R. EURASIP Journal on Image & Video Processing, 2017, 2017: 42

[13] ChaoWL, DingJJ, LiuJZ. Signal Processing, 2015, 117: 1

[14] SunY, YuJ. Facial Expression Recognition by Fusing Gabor and Local Binary Pattern Features, MultiMedia Modeling, 2017,