Improved Gabor transform and group sparse representation for ancient mural inpainting

Abstract

Sparse representation has been highly successful in various tasks related to image processing and computer vision. For ancient mural image inpainting, traditional group sparse representation models usually lead to structure blur and line discontinuity due to the construction of similarity group solely based on the Euclidean distance and the randomness of dictionary initialization. To address the aforementioned issues, an improved curvature Gabor transform and group sparse representation (CGabor-GSR) model for ancient Dunhuang mural inpainting is proposed. To begin with, mutual information is introduced to weight the Euclidean distance, and then the weighted Euclidean distance acts as a new standard of similarity group. Subsequently, to mitigate the randomness of dictionary initialization, a curvature Gabor wavelet transform is proposed to extract the features and initialize the feature dictionary with dimension reduction based on principal component analysis (PCA). Ultimately, singular value decomposition (SVD) and split Bregman iteration (SBI) can be used to resolve the CGabor-GSR model to reconstruct the mural images. Experimental results on Dunhuang mural inpainting demonstrate tha the proposed CGabor-GSR achieves a better performance than compared algorithms in both objective and visual evaluation.

Keywords

digital image processing / mural inpainting / curvature Gabor wavelet transform / group sparse representation / mutual information

References

[1] ZHANG Y J, LIU T T, CATTANI C, et al. Diffusion-based image inpainting forensics via weighted least squares filtering enhancement. Multimedia Tools and Applications, 2021, 80(20): 30725-30739.

[2] RATHISH KUMAR B V, HALIM A. A linear fourth-order PDE-based gray-scale image inpainting model. Computational and Applied Mathematics, 2019, 38(1): 6.

[3] ABDULLA A A, AHMED M W. An improved image quality algorithm for exemplar-based image inpainting. Multimedia Tools and Applications, 2021, 80(9): 13143-13156.

[4] YANG S Y, LIANG H T, WANG Y, et al. Image inpainting based on multi-patch match with adaptive size. Applied Sciences, 2020, 10(14): 4921.

[5] WAN W, LIU J. Nonlocal patches based Gaussian mixture model for image inpainting. Applied Mathematical Modelling, 2020, 87: 317-331.

[6] LI Z D, CHENG J X, LIU J W. MRF image inpainting algorithm based on structure offsets statistics and multi-direction features. Acta Electronica Sinica, 2020, 48(5): 985-989.

[7] ZHAO D, DU H Q, MEI W B. Hybrid weighted l₁-total variation constrained reconstruction for MR image. Chinese Journal of Electronics, 2014, 23(4): 747-752.

[8] ZHANG L, KANG B S, LIU B T, et al. Image inpainting based on exemplar and sparse representation. International Journal of Signal Processing, Image Processing and Pattern Recognition, 2016, 9(9): 177-188.

[9] MO J C, ZHOU Y C. The research of image inpainting algorithm using self-adaptive group structure and sparse representation. Cluster Computing, 2019, 22(3): 7593-7601.

[10] WANG B, HU L L, CAO J J, et al. Image inpainting method based on sparse optimization in wavelet domain. Acta Electronica Sinica, 2016, 44(3): 600-606.

[11] BERTALMIO M, SAPIRO G, CASELLES V, et al. Image inpainting//The 27th Annual Conference on Computer Graphics and Interactive Techniques, July 1, 2000, New Orleans, LA, USA. New York: ACM Press, 2000: 417-424.

[12] SHEN J H, CHAN T F. Mathematical models for local nontexture inpaintings. SIAM Journal on Applied Mathematics, 2002, 62(3): 1019-1043.

[13] CHAN T F, SHEN J H. Nontexture inpainting by curvature-driven diffusions. Journal of Visual Communication and Image Representation, 2001, 12(4): 436-449.

[14] ZHANG L, KANG B, LIU B, et al. A new inpainting method for object removal based on patch local feature and sparse representation. International Journal of Innovative Computing Information and Control, 2016,12(1):113-124.

[15] WANG M H, YAN B, NGAN K N. An efficient framework for image/video inpainting. Image Communication, 2013, 28(7): 753-762.

[16] CRIMINISI A, PEREZ P, TOYAMA K. Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing, 2004, 13(9): 1200-1212.

[17] BITTENS S, PLONKA G. Real sparse fast DCT for vectors with short support. Linear Algebra and Its Applications, 2019, 582: 359-390.

[18] WANG H C, TAO C H, CHEN S C, et al. High-precision seismic data reconstruction with multi-domain sparsity constraints based on curvelet and high-resolution Radon transforms. Journal of Applied Geophysics, 2019, 162: 128-137.

[19] AHARON M, ELAD M, BRUCKSTEIN A. K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 2006, 54(11): 4311-4322.

[20] QIN Y. A new family of model-based impulsive wavelets and their sparse representation for rolling bearing fault diagnosis. IEEE Transactions on Industrial Electronics, 2018,65(3): 2716-2726.

[21] ZHANG J, ZHAO D B, GAO W. Group-based sparse representation for image restoration. IEEE Transactions on Image Processing, 2014, 23(8): 3336-3351.

[22] ZHA Z Y, YUAN X, WEN B H, et al. Image restoration using joint patch-group-based sparse representation. IEEE Transactions on Image Processing, 2020, 29: 7735-7750.

[23] KONG Y F, ZHOU C Y, ZHANG C Y, et al. Multi-color channels based group sparse model for image restoration. Algorithms, 2022, 15(6): 176.

[24] WANG H, LI L, LI Q, et al. A mural inpainting method combining global consistency and local continuity.Journal of Hunan University (Natural Sciences). 2022, 49(6): 135-145.

[25] GUO K H, LABATE D, RODRIGUEZ AYLLON J P. Image inpainting using sparse multiscale representations: Image recovery performance guarantees. Applied and Computational Harmonic Analysis, 2020, 49(2): 343-380.

[26] DONOHO D L. For most large underdetermined systems of equations, the minimal 1-norm near-solution approximates the sparsest near-solution. Communications on Pure and Applied Mathematics, 2006, 59(7): 907-934.

[27] CANDES E J, TAO T. Decoding by linear programming. IEEE Transactions on Information Theory, 2005, 51(12): 4203-4215.

[28] DONG W S, ZHANG L, SHI G M, et al. Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Transactions on Image Processing, 2011, 20(7): 1838-1857.

[29] LIAN Q S, SHI B S, CHEN S Z. Research advances on dictionary learning models, algorithms and applications. Acta Automatica Sinica, 2015, 41(2): 240-260.

[30] WEN Y, XU C, LU Y, et al. Gabor feature-based LogDemons with inertial constraint for nonrigid image registration. IEEE Transactions on Image Processing, 2020, 29: 8238-8250.

[31] LIU J, JING X J, SUN S L, et al. Local Gabor dominant direction pattern for face recognition. Chinese Journal of Electronics, 2015, 24(2): 245-250.

[32] LEE T S. Image representation using 2D Gabor wavelets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1996, 18(10): 959-971.

[33] GOLDSTEIN T, OSHER S. The split Bregman method for L1-regularized problems. SIAM Journal on Imaging Sciences, 2009, 2(2): 323-343.

[34] ZHANG J, ZHAO D B, XIONG R Q, et al. Image restoration using joint statistical modeling in a space-transform domain. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(6): 915-928.

[35] HE B S, LIU H, WANG Z R, et al. A strictly contractive peaceman-rachford splitting method for convex programming. SIAM Journal on Optimization, 2014, 24(3): 1011-1040.