Anisotropic fourth-order diffusion regularization for multiframe super-resolution reconstruction

Abstract

A novel regularization-based approach is presented for super-resolution reconstruction in order to achieve good tradeoff between noise removal and edge preservation. The method is developed by using L1 norm as data fidelity term and anisotropic fourth-order diffusion model as a regularization item to constrain the smoothness of the reconstructed images. To evaluate and prove the performance of the proposed method, series of experiments and comparisons with some existing methods including bi-cubic interpolation method and bilateral total variation method are carried out. Numerical results on synthetic data show that the PSNR improvement of the proposed method is approximately 1.0906 dB on average compared to bilateral total variation method, and the results on real videos indicate that the proposed algorithm is also effective in terms of removing visual artifacts and preserving edges in restored images.

Keywords

super-resolution / anisotropic fourth-order diffusion / bilateral total variation / regularization

References

[1] VegaM, MateosJ, MolinaR, KatsaggelosA. K. Super-resolution of multispectral images [J]. The Computer Journal, 2009, 52(1): 153-167

[2] ZhangL P, ZhangH Y, ShenH F, LiP X. A super-resolution reconstruction algorithm for surveillance images [J]. Signal Processing, 2010, 90(3): 848-859

[3] CarmiE, LiuS, AlonN, FiatA, FiatD. Resolution enhancement in MR [J]. Magnetic Resonance Imaging, 2006, 24(2): 133-154

[4] TsaiR Y, HuangT S. Multiple frame image restoration and registration [J]. Advances in Computer Vision and Image Processing, 1984, 1(2): 317-339

[5] ParkS C, ParkM K, KangM G. Super-resolution image reconstruction: A technical overview [J]. IEEE Signal Processing Magazine, 2003, 20(3): 21-36

[6] ProtterM, EladM, TakedaH, MilanfarP. Generalizing the nonlocal-means to super-resolution reconstruction [J]. IEEE Transactions on Image Processing, 2009, 18(1): 36-51

[7] XiongZ W, SunX Y, WuF. Robust web image/video super-resolution [J]. IEEE Transactions on Image Processing, 2010, 19(8): 2017-2028

[8] YuanQ, ZhangL, ShenH, LiP. Adaptive multiple-frame image super-resolution based on U-curve [J]. IEEE Trans Image Process, 2010, 19(12): 3157-3170

[9] DongW, ZhangL, ShiG, WuX. Image deblurring and supper-resolution by adaptive sparse domain selection and adaptive regularization [J]. IEEE Transactions on Image Processing, 2011, 207: 1838-1857

[10] NG M K, SHEN H, LAM E Y, ZHANG L. A total variation regularization based super-resolution reconstruction algorithm for digital video [J]. EURASIP Journal on Advances in Signal Processing, 2007, 74585.

[11] ChenQ, MontesinosP, SunQ, HengP, XiaD. Adaptive total variation denoising based on difference curvature [J]. Image Vis Comput, 2010, 28(3): 298-306

[12] MarquinaA, OsherS. Image super-resolution by TV-regularization and bregman iteration [J]. Journal of Scientific Computing, 2008, 37(3): 367-382

[13] YouY L, KavehM. Fourth-order partial differential equations for noise removal [J]. IEEE Transactions on Image Processing, 2000, 9(10): 1723-1730

[14] HajiaboliM R. An anisotropic fourth-order diffusion filter for image noise removal [J]. International Journal of Computer Vision, 2011, 92(2): 177-191

[15] FarsiuS, RobinsonM D, EladM, MilanfarP. Fast and robust multi-frame super-resolution [J]. IEEE Transactions on Image Processing, 2004, 13(10): 1327-1344

[16] PeronaP, MalikJ. Scale-space and edge detection using anisotropic diffusion [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(7): 629-639

[17] MDSP. Super-resolution and Demosaicing Datasets [EB/OL]. [2007-01-01]. http://users.soe.ucsc.edu/~milanfar/software/sr-tasets.html

[18] SchultzR R, MengL, StevensonR L. Subpixel motion estimation for super-resolution image sequence enhancement [J]. Journal of Visual Communication and Image Representation, 1998, 9(1): 38-50