Self-supervised image blind deblurring using deep generator prior

Yuan Li, Shasha Wang, Lei Chen

Optoelectronics Letters ›› 2022, Vol. 18 ›› Issue (3) : 187-192.

Optoelectronics Letters ›› 2022, Vol. 18 ›› Issue (3) : 187-192. DOI: 10.1007/s11801-022-1111-0
Article

Self-supervised image blind deblurring using deep generator prior

Author information +
History +

Abstract

Deep generative prior (DGP) is recently proposed for image restoration and manipulation, obtaining compelling results for recovering missing semantics. In this paper, we exploit a general solution for single image deblurring using DGP as the image prior. To this end, two aspects of this object are investigated. One is modeling the process of latent image degradation, corresponding to the estimation of blur kernels in conventional deblurring methods. In this regard, a Reblur2Deblur network is proposed and trained on large-scale datasets. In this way, the proposed structure can simulate the degradation of latent sharp images. The other is encouraging deblurring results faithful to the content of latent images, and matching the appearance of blurry observations. As the generative adversarial network (GAN)-based methods often result in mismatched reconstruction, a deblurring framework with the relaxation strategy is implemented to tackle this problem. The pre-trained GAN and pre-trained ReblurNet are allowed to be fine-tuned on the fly in a self-supervised manner. Finally, we demonstrate empirically that the proposed model can perform favorably against the state-of-the-art methods.

Cite this article

Download citation ▾
Yuan Li, Shasha Wang, Lei Chen. Self-supervised image blind deblurring using deep generator prior. Optoelectronics Letters, 2022, 18(3): 187‒192 https://doi.org/10.1007/s11801-022-1111-0

References

[1]
NahS, SonS, LeeS, et al.. NTIRE 2021 challenge on image deblurring[C], 2021, New York, IEEE: 149-165virtual
[2]
SunL, ChoS, WangJ, et al.. Edge-based blur kernel estimation using patch priors[C], 2013, New York, IEEE: 1-8
[3]
WhyteO, SivicJ, ZissermanA, et al.. Non-uniform deblurring for shaken images[J]. International journal of computer vision, 2012, 98(2):168-186
CrossRef Google scholar
[4]
ZhouY, KomodakisN. A map-estimation framework for blind deblurring using high-level edge priors[C], 2014, Berlin, Heidelberg, Springer-Verlag: 142-157
[5]
UlyanovD, VedaldiA, LempitskyV. Deep image prior[C], 2018, New York, IEEE: 9446-9454
[6]
RenD, ZhangK, WangQ, et al.. Neural blind deconvolution using deep priors[C], 2020, New York, IEEE: 3341-3350
[7]
PanX G, ZhanX H, DaiB, et al.. Exploiting deep generative prior for versatile image restoration and manipulation[C], 2020, Berlin, Heidelberg, Springer-Verlag: 262-277
[8]
LiuZ, LuoP, WangX, et al.. Deep learning face attributes in the wild[C], 2015, New York, IEEE: 3730-3738
[9]
DengJ, DongW, SocherR, et al.. Imagenet: a large-scale hierarchical image database[C], 2009, New York, IEEE: 248-255
[10]
LuB, ChenJ C, ChellappaR. Unsupervised domain-specific deblurring via disentangled representations[C], 2019, New York, IEEE: 10225-10234
[11]
DuW, ChenH, YangH. Learning invariant representation for unsupervised image restoration[C], 2020, New York, IEEE: 14483-14492
[12]
KupynO, BudzanV, MykhailychM, et al.. Deblurgan: blind motion deblurring using conditional adversarial networks[C], 2018, New York, IEEE: 8183-8192
[13]
LaiW S, HuangJ B, HuZ, et al.. A comparative study for single image blind deblurring[C], 2016, New York, IEEE: 1701-1709
[14]
KrishnanD, TayT, FergusR. Blind deconvolution using a normalized sparsity measure[C], 2011, New York, IEEE: 233-240
[15]
PanJ, SunD, PfisterH, et al.. Deblurring images via dark channel prior[J]. IEEE transactions on pattern analysis and machine intelligence, 2017, 40(10):2315-2328
CrossRef Google scholar

Accesses

Citations

Detail

Sections
Recommended

/