A perceptual quality metric for 3D triangle meshes based on spatial pooling

Abstract

In computer graphics, various processing operations are applied to 3D triangle meshes and these processes of ten involve distortions, which affect the visual quality of surface geometry. In this context, perceptual quality assessment of 3D triangle meshes has become a crucial issue. In this paper, we propose a new objective quality metric for assessing the visual difference between a reference mesh and a corresponding distorted mesh. Our analysis indicates that the overall quality of a distorted mesh is sensitive to the distortion distribution. The proposed metric is based on a spatial pooling strategy and statistical descriptors of the distortion distribution. We generate a perceptual distortion map for vertices in the reference mesh while taking into account the visual masking effect of the human visual system. The proposed metric extracts statistical descriptors from the distortion map as the feature vector to represent the overall mesh quality. With the feature vector as input, we adopt a support vector regression model to predict the mesh quality score.We validate the performance of our method with three publicly available databases, and the comparison with state-of-the-art metrics demonstrates the superiority of our method. Experimental results show that our proposed method achieves a high correlation between objective assessment and subjective scores.

Keywords

mesh visual quality assessment / spatial pooling / statistical descriptors / support vector regression / visual masking

References

[1] Lavoué G, Gelasca E D, Dupont F, Baskurt A, Ebrahimi T. Perceptually driven 3D distance metrics with application to watermarking. In: Proceedings of SPIE Electronic Imaging. 2006

[2] Lavoué G. A multiscale metric for 3D mesh visual quality assessment. Computer Graphics Forum, 2011, 30(5): 1427–1437

[3] Váša L, Rus J. Dihedral angle mesh error: a fast perception correlated distortion measure for fixed connectivity triangle meshes. Computer Graphics Forum, 2012, 31(5): 1715–1724

[4] Wang K, Torkhani F, Montanvert A. A fast roughness-based approach to the assessment of 3D mesh visual quality. Computer & Graphics, 2012, 36(7): 808–818

[5] Torkhani F, Wang K, Chassery J M. A curvature-tensor-based perceptual quality metric for 3D triangular meshes. Machine Graphics Vision, 2014, 23(1): 59–82

[6] Dong L, Fang Y M, Lin W S, Seah H S. Perceptual quality assessment for 3D triangle mesh based on curvature. IEEE Transactions on Multimedia, 2015, 17(12): 2171–2184

[7] Wang Z, Bovik A C, Sheikh H R. Simoncelli E P. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13(4): 1–14

[8] Zhang L, Zhang D, Mou X Q, Zhang D. FSIM: a feature similarity index for image quality assessment. IEEE Transactions on Image Processing, 2011, 20(8): 2378–2386

[9] Xue W F, Zhang L, Mou X Q, Bovik A C. Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Transactions on Image Processing, 2014, 23(2): 684–695

[10] Li Q H, Fang Y M, Xu J T. A novel spatial pooling strategy for image quality assessment. Journal of Computer Science and Technology, 2016, 31(2): 225–234

[11] Lavoué G, Mantiuk R. Quality assessment in computer graphics. In: Deng C W, Ma L, Lin W S, et al, eds. Visual Signal Quality Assessment. Springer International Publishing, 2015, 243–286

[12] Gastaldo P, Zunino R, Redi J. Supporting visual quality assessment with machine learning. EURASIP Journal on Image and Video Processing, 2013, 2013(1): 1–15

[13] Narwaria M, Lin W S. Objective image quality assessment based on support vector regression. IEEE Transactions on Neural Networks, 2010, 21(3): 515–519

[14] Narwaria M, Lin W S. SVD-based quality metric for image and video using machine learning. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2012, 42(2): 347–364

[15] Hines A, Kendrick P, Barri A, Narwaria M, Redi J A. Robustness and prediction accuracy of machine learning for objective visual quality assessment. In: Proceedings of the 22nd European Signal Processing Conference (EUSIPCO). 2014, 2130–2134

[16] Gastaldo P, Redi J A. Machine learning solutions for objective visual quality assessment. In: Proceedings of the 6th International Workshop on Video Processing and Quality Metrics for Consumer Electronics. 2012

[17] Xu L, Lin W S, Kuo C C J. Visual Quality Assessment by Machine Learning. Springer Singapore, 2015

[18] Lavoué G, Cheng I, Basu A. Perceptual quality metrics for 3D meshes: towards an optimal multi-attribute computational model, In: Proceedings of IEEE International Conference on Systems, Man, and Cybernetics. 2013, 3271–3276

[19] Wang Z, Bovik A C. Modern image quality assessment. Synthesis Lectures on Image, Video, and Multimedia Processing, 2006, 2(1): 1–156

[20] Wang Z, Bovik A C. Reduced- and no-reference image quality assessment. IEEE Signal Processing Magazine, 2011, 28(6): 29–40

[21] Lavoué G, Corsini M. A comparison of perceptually-based metrics for objective evaluation of geometry processing. IEEE Transactions on Multimedia, 2010, 12(7): 636–649

[22] Corsini M, Larabi M C, Lavoué G, Petrik O, Vasa L, Wang K. Perceptual metrics for static and dynamic triangle meshes. Computer Graphics Forum, 2013, 32(1): 101–125

[23] Rogowitz B E, Rushmeier H E. Are image quality metrics adequate to evaluate the quality of geometric objects?. In: Proceedings of Human Vision and Electronic Imaging. 2001, 340–348

[24] Karni Z, Gotsman C. Spectral compression of mesh geometry. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. 2000, 279–286

[25] Sorkine O, Daniel C O, Toledo S. High-pass quantization for mesh encoding. In: Proceedings of Symposium on Geometry Processing. 2003, 42–51

[26] Corsini M, Gelasca D E, Ebrahimi T, Barni M. Watermarked 3-D mesh quality assessment. IEEE Transactions on Multimedia, 2007, 9(2): 247–256

[27] Bian Z, Hu S M, Martin R R. Evaluation for small visual difference between conforming meshes on strain field. Journal of Computer Science and Technology, 2009, 24(1): 65–75

[28] Tian D, Alregib G. FQM: a fast quality measure for efficient transmission of textured 3D models. In: Proceedings of the 12th Annual ACM International Conference on Multimedia. 2004, 684–691

[29] Pan Y, Cheng I, Basu A. Quality metric for approximating subjective evaluation of 3-D objects. IEEE Transactions on Multimedia, 2005, 7(2): 269–279

[30] Chang C C, Lin C J. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2011, 2(3):27

[31] Lavoué G. A local roughness measure for 3D meshes and its application to visual masking. ACM Transactions on Applied Perception, 2009, 5(4): 23

[32] Engeldrum P G. Psychometric Scaling: A Toolkit for Imaging Systems Development. Winchester: Imcotek Press, 2000

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag GmbH Germany, part of Springer Nature