Single image super-resolution: a comprehensive review and recent insight

Abstract

Super-resolution (SR) is a long-standing problem in image processing and computer vision and has attracted great attention from researchers over the decades. The main concept of SR is to reconstruct images from low-resolution (LR) to high-resolution (HR).It is an ongoing process in image technology, through up-sampling, de-blurring, and de-noising. Convolution neural network (CNN) has been widely used to enhance the resolution of images in recent years. Several alternative methods use deep learning to improve the progress of image super-resolution based on CNN. Here, we review the recent findings of single image super-resolution using deep learning with an emphasis on distillation knowledge used to enhance image super-resolution., it is also to highlight the potential applications of image super-resolution in security monitoring, medical diagnosis, microscopy image processing, satellite remote sensing, communication transmission, the digital multimedia industry and video enhancement. Finally, we present the challenges and assess future trends in super-resolution based on deep learning.

Graphical abstract

Keywords

super-resolution / deep learning / single-image / interpolation-based / learning-based / reconstruction-based

Hanadi AL-Mekhlafi received the Master degree from School of Software Engineering, South China University of Technology, China. She is currently studying for PhD degree in the College of Intelligence and Computing, Tianjin University, China. Her research interests include image/video processing, computer graphics, deep learning

Shiguang Liu (Senior Member, IEEE) received the PhD degree from the State Key Laboratory of CAD and CG, Zhejiang University, China. He is currently a Professor with the College of Intelligence and Computing, Tianjin University, China. His research interests include image/video processing, computer graphics, visualization, and virtual reality

References

[1] Freedman G, Fattal R . Image and video upscaling from local self-examples. ACM Transactions on Graphics, 2011, 30( 2): 12

[2] Glasner D, Bagon S, Irani M. Super-resolution from a single image. In: Proceedings of the 12th IEEE International Conference on Computer Vision. 2009, 349−356

[3] Yang J, Lin Z, Cohen S. Fast image super-resolution based on in-place example regression. In: Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2013, 1059−1066

[4] Bevilacqua M, Roumy A, Guillemot C, Morel M L A. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of British Machine Vision Conference (BMVC). 2012, 135.1−135.10

[5] Chang H, Yeung D-Y, Xiong Y. Super-resolution through neighbor embedding. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.; vol. 1. 2004, I–I

[6] Freeman W T, Pasztor E C, Carmichael O T . Learning low-level vision. International Journal of Computer Vision, 2000, 40( 1): 25–47

[7] Jia K, Wang X, Tang X . Image transformation based on learning dictionaries across image spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35( 2): 367–380

[8] Timofte R, De Smet V, Van Gool L. Anchored neighborhood regression for fast example-based super-resolution. In: Proceedings of 2013 IEEE International Conference on Computer Vision. 2013, 1920−1927

[9] Yang J, Wang Z, Lin Z, Cohen S, Huang T . Coupled dictionary training for image super-resolution. IEEE Transactions on Image Processing, 2012, 21( 8): 3467–3478

[10] Yang J, Wright J, Huang T, Ma Y. Image super-resolution as sparse representation of raw image patches. In: Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition. 2008, 1−8

[11] Yang J, Wright J, Huang T S, Ma Y . Image super-resolution via sparse representation. IEEE Transactions on Image Processing, 2010, 19( 11): 2861–2873

[12] Zeyde R, Elad M, Protter M. On single image scale-up using sparse-representations. In: Proceedings of the 7th International Conference on Curves and Surfaces. 2010, 711−730

[13] Yang W, Zhang X, Tian Y, Wang W, Xue J H, Liao Q . Deep learning for single image super-resolution: a brief review. IEEE Transactions on Multimedia, 2019, 21( 12): 3106–3121

[14] Zhou L, Feng S. A review of deep learning for single image super-resolution. In: Proceedings of International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS). 2019, 139–142

[15] Ha V K, Ren J, Xu X, Zhao S, Xie G, Vargas V M. Deep learning based single image super-resolution: A survey. In: Proceedings of the 9th International Conference on Brain Inspired Cognitive Systems. 2018, 106−119

[16] Zhang H, Wang P, Zhang C, Jiang Z . A comparable study of CNN-based single image super-resolution for space-based imaging sensors. Sensors, 2019, 19( 14): 3234

[17] Dong C, Loy C C, He K, Tang X . Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38( 2): 295–307

[18] Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 1646−1654

[19] Dong C, Loy C C, Tang X. Accelerating the super-resolution convolutional neural network. In: Proceedings of the 14th European Conference on Computer Vision. 2016, 391–407

[20] Kim J, Lee J K, Lee K M. Deeply-recursive convolutional network for image super-resolution. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 1637−1645

[21] Li X, Wu Y, Zhang W, Wang R, Hou F . Deep learning methods in real-time image super-resolution: a survey. Journal of Real-Time Image Processing, 2020, 17( 6): 1885–1909

[22] Wang Z, Chen J, Hoi S C H . Deep learning for image super-resolution: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43( 10): 3365–3387

[23] Bashir S M A, Wang Y, Khan M, Niu Y . A comprehensive review of deep learning-based single image super-resolution. PeerJ Computer Science, 2021, 7: e621

[24] Liu A, Liu Y, Gu J, Qiao Y, Dong C . Blind image super-resolution: A survey and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 1–9

[25] Zhu H, Xie C, Fei Y, Tao H . Attention mechanisms in CNN-based single image super-resolution: a brief review and a new perspective. Electronics, 2021, 10( 10): 1187

[26] Tian J, Ma K K . A survey on super-resolution imaging. Signal, Image and Video Processing, 2011, 5( 3): 329–342

[27] Shah A J, Gupta S B. Image super resolution-a survey. In: Proceedings of the 1st International Conference on Emerging Technology Trends in Electronics, Communication & Networking. 2012, 1−6

[28] Ghesu F C, Köhler T, Haase S, Hornegger J. Guided image super-resolution: a new technique for photogeometric super-resolution in hybrid 3-D range imaging. In: Jiang X, Hornegger J, Koch R, eds. Pattern Recognition. Cham: Springer, 2014, 227−238

[29] Moitra S . Single-image super-resolution techniques: a review. International Journal for Science and Advance Research in Technology, 2017, 3( 4): 271–283

[30] Huang D, Liu H . A short survey of image super resolution algorithms. Journal of Computer Science Technology Updates, 2015, 2( 2): 19–29

[31] Schultz R R, Stevenson R L . A Bayesian approach to image expansion for improved definition. IEEE Transactions on Image Processing, 1994, 3( 3): 233–242

[32] Wang Y, Wan W, Wang R, Zhou X. An improved interpolation algorithm using nearest neighbor from VTK. In: Proceedings of 2010 International Conference on Audio, Language and Image Processing. 2010, 1062−1065

[33] Titus J, Geroge S . A comparison study on different interpolation methods based on satellite images. International Journal of Engineering Research & Technology, 2013, 2( 6): 82–85

[34] Parsania P, Virparia D . A review: Image interpolation techniques for image scaling. International Journal of Innovative Research in Computer and Communication Engineering, 2014, 2( 12): 7409–7414

[35] Li X, Orchard M T . New edge-directed interpolation. IEEE Transactions on Image Processing, 2001, 10( 10): 1521–1527

[36] Gavade A B, Sane P. Super resolution image reconstruction by using bicubic interpolation. In: Proceedings of National Conference on Advanced Technologies in Electrical and Electronic Systems. 2014, 1

[37] Irani M, Peleg S . Improving resolution by image registration. CVGIP: Graphical Models and Image Processing, 1991, 53( 3): 231–239

[38] Nayak R, Patra D . Enhanced iterative back-projection based super-resolution reconstruction of digital images. Arabian Journal for Science and Engineering, 2018, 43( 12): 7521–7547

[39] Stark H, Oskoui P . High-resolution image recovery from image-plane arrays, using convex projections. Journal of the Optical Society of America A, 1989, 6( 11): 1715–1726

[40] Fan C, Wu C, Li G, Ma J . Projections onto convex sets super-resolution reconstruction based on point spread function estimation of low-resolution remote sensing images. Sensors, 2017, 17( 2): 362

[41] Schultz R R, Stevenson R L. Improved definition video frame enhancement. In: Proceedings of 1995 International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 1995, 2169−2172

[42] Schultz R R, Stevenson R L . Extraction of high-resolution frames from video sequences. IEEE Transactions on Image Processing, 1996, 5( 6): 996–1011

[43] Besag J . On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society: Series B: (Methodological), 1986, 48( 3): 259–279

[44] Homem M R P, Martins A L D, Mascarenhas N D A. Super-resolution image reconstruction using the discontinuity adaptive ICM. 1994. Poster, https://www.dca.fee.unicamp.br/~ting/misc/anais-poster-2007/posters/33629.pdf

[45] Timofte R, De Smet V, Van Gool L. A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Proceedings of the 12th Asian Conference on Computer Vision. 2014, 111−126

[46] Wen Y, Sheng B, Li P, Lin W, Feng D D . Deep color guided coarse-to-fine convolutional network cascade for depth image super-resolution. IEEE Transactions on Image Processing, 2019, 28( 2): 994–1006

[47] Tai Y, Yang J, Liu X. Image super-resolution via deep recursive residual network. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017, 2790−2798

[48] Hui Z, Gao X, Yang Y, Wang X. Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the 27th ACM International Conference on Multimedia. 2019, 2024−2032

[49] Ahn N, Kang B, Sohn K A. Fast, accurate, and lightweight super-resolution with cascading residual network. In: Proceedings of the 15th European Conference on Computer Vision. 2018, 256−272

[50] Zhu F, Zhao Q. Efficient single image super-resolution via hybrid residual feature learning with compact back-projection network. In: Proceedings of 2019 IEEE/CVF International Conference on Computer Vision Workshop. 2019, 2453−2460

[51] Li J, Fang F, Mei K, Zhang G. Multi-scale residual network for image super-resolution. In: Proceedings of the 15th European Conference on Computer Vision (ECCV). 2018, 517−532

[52] Liu J, Tang J, Wu G. Residual feature distillation network for lightweight image super-resolution. In: Proceedings of European Conference on Computer Vision. 2020, 41−55

[53] Li W, Li J, Li J, Huang Z, Zhou D . A lightweight multi-scale channel attention network for image super-resolution. Neurocomputing, 2021, 456: 327–337

[54] Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y. Image super-resolution using very deep residual channel attention networks. In: Proceedings of 15th European Conference on Computer Vision (ECCV). 2018, 294−310

[55] Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 7132−7141

[56] Cheng X, Li X, Yang J, Tai Y. SESR: Single image super resolution with recursive squeeze and excitation networks. In: Proceedings of the 24th International Conference on Pattern Recognition (ICPR). 2018, 147−152

[57] Roy A G, Navab N, Wachinger C. Concurrent spatial and channel ‘squeeze & excitation’ in fully convolutional networks. In: Proceedings of 21st International Conference on Medical Image Computing and Computer-Assisted Intervention. 2018, 421−429

[58] Dai T, Cai J, Zhang Y, Xia S T, Zhang L. Second-order attention network for single image super-resolution. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019, 11057−11066

[59] Choi J S, Kim M. A deep convolutional neural network with selection units for super-resolution. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 2017, 1150−1156

[60] Anwar S, Barnes N . Densely residual Laplacian super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44( 3): 1192–1204

[61] Zhang Y, Li K, Li K, Zhong B, Fu Y. Residual non-local attention networks for image restoration. 2019, arXiv preprint arXiv: 1903.10082

[62] Hu Y, Li J, Huang Y, Gao X . Channel-wise and spatial feature modulation network for single image super-resolution. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30( 11): 3911–3927

[63] Kim J H, Choi J H, Cheon M, Lee J S. Ram: Residual attention module for single image super-resolution. 2018, arXiv preprint arXiv: 1811.12043v1

[64] Liu J, Zhang W, Tang Y, Tang J, Wu G. Residual feature aggregation network for image super-resolution. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 2356−2365

[65] Zheng Z, Jiao Y, Fang G. Upsampling attention network for single image super-resolution. In: Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. 2021, 399−406

[66] Lim B, Son S, Kim H, Nah S, Lee K M. Enhanced deep residual networks for single image super-resolution. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 2017, 1132−1140

[67] Zhang K, Zuo W, Zhang L. Learning a single convolutional super-resolution network for multiple degradations. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 3262−3271

[68] Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y. Residual dense network for image super-resolution. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 2472−2481

[69] Tong T, Li G, Liu X, Gao Q. Image super-resolution using dense skip connections. In: Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV). 2017, 4809–4817

[70] Wang W, Li X, Yang J, Lu T. Mixed link networks. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence. 2018, 2819−2825

[71] Shi W, Caballero J, Huszár F, Totz J, Aitken A P, Bishop R, Rueckert D, Wang Z. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016, 1874−1883

[72] Haris M, Shakhnarovich G, Ukita N. Deep back-projection networks for super-resolution. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 1664−1673

[73] Dun Y, Da Z, Yang S, Xue Y, Qian X . Kernel-attended residual network for single image super-resolution. Knowledge-Based Systems, 2021, 213: 106663

[74] Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, Shi W. Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017, 105−114

[75] Shocher A, Cohen N, Irani M. Zero-shot super-resolution using deep internal learning. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2018, 3118−3126

[76] Wang X, Yu K, Wu S, Gu J, Liu Y, Dong C, Qiao Y, Loy CC. ESRGAN: Enhanced super-resolution generative adversarial networks. In: Proceedings of European Conference on Computer Vision. 2018, 63−79

[77] Jolicoeur-Martineau A. The relativistic discriminator: a key element missing from standard GAN. In: Proceedings of the 7th International Conference on Learning Representations. 2019

[78] Szegedy C, Ioffe S, Vanhoucke V, Alemi A A. Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence. 2017, 4278−4284

[79] Zhang W, Liu Y, Dong C, Qiao Y. RankSRGAN: Generative adversarial networks with ranker for image super-resolution. In: Proceedings of 2019 IEEE/CVF International Conference on Computer Vision. 2019, 3096−3105

[80] Maeda S. Unpaired image super-resolution using pseudo-supervision. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 288−297

[81] Bell-Kligler S, Shocher A, Irani M. Blind super-resolution kernel estimation using an internal-GAN. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019, 26

[82] Gu J, Lu H, Zuo W, Dong C. Blind super-resolution with iterative kernel correction. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019, 1604−1613

[83] Michaeli T, Irani M. Nonparametric blind super-resolution. In: Proceedings of IEEE International Conference on Computer Vision. 2013, 945−952

[84] Ren D, Zhang K, Wang Q, Hu Q, Zuo W. Neural blind deconvolution using deep priors. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 3338−3347

[85] Zhang K, Gool L V, Timofte R. Deep unfolding network for image super-resolution. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 3214−3223

[86] Liang J, Zhang K, Gu S, Gool L V, Timofte R. Flow-based kernel prior with application to blind super-resolution. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 10596−10605

[87] Luo Z, Huang Y, Li S, Wang L, Tan T. Unfolding the alternating optimization for blind super resolution. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020

[88] Wang L, Wang Y, Dong X, Xu Q, Yang J, An W, Guo Y. Unsupervised degradation representation learning for blind super-resolution. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 10576−10585

[89] Gandelsman Y, Shocher A, Irani M. “Double-DIP”: Unsupervised image decomposition via coupled deep-image-Priors. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 11018−11027

[90] Cornillère V, Djelouah A, Wang Y . Sorkine-Hornung O, Schroers C. Blind image super-resolution with spatially variant degradations. ACM Transactions on Graphics, 2019, 38( 6): 166

[91] He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016, 770–778

[92] Gou J, Yu B, Maybank S J, Tao D . Knowledge distillation: a survey. International Journal of Computer Vision, 2021, 129( 6): 1789–1819

[93] Gao Q, Zhao Y, Li G, Tong T. Image super-resolution using knowledge distillation. In: Proceedings of the 14th Asian Conference on Computer Vision (ACCV). 2018, 527−541

[94] He Z, Dai T, Lu J, Jiang Y, Xia S T. Fakd: feature-affinity based knowledge distillation for efficient image super-resolution. In: Proceedings of 2020 IEEE International Conference on Image Processing (ICIP). 2020, 518−522

[95] Lee W, Lee J, Kim D, Ham B. Learning with privileged information for efficient image super-resolution. In: Proceedings of the 16th European Conference on Computer Vision. 2020, 465−482

[96] Zhang L, Wang P, Shen C, Liu L, Wei W, Zhang Y, Van Den Hengel A . Adaptive importance learning for improving lightweight image super-resolution network. International Journal of Computer Vision, 2020, 128( 2): 479–499

[97] Hui Z, Wang X, Gao X. Fast and accurate single image super-resolution via information distillation network. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 723−731

[98] Zhang Y, Chen H, Chen X, Deng Y, Xu C, Wang Y. Data-free knowledge distillation for image super-resolution. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 7848–7857

[99] Jiang K, Wang Z, Yi P, Jiang J, Xiao J, Yao Y . Deep distillation recursive network for remote sensing imagery super-resolution. Remote Sensing, 2018, 10( 11): 1700

[100] Lu T, Yang W, Wan Y. Super-resolution for surveillance video via adaptive block-matching registration. In: Proceedings of 2015 International Conference on Artificial Intelligence and Industrial Engineering. 2015, 1−3

[101] Shao J, Chao F, Luo M, Lin J . A super-resolution reconstruction algorithm for surveillance video. Journal of Forensic Science and Medicine, 2017, 3( 1): 26

[102] Ghazali N N A N, Zamani N A, Abdullah S N H S, Jameson J. Super resolution combination methods for CCTV forensic interpretation. In: Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA). 2012, 853−858

[103] Yu H, Liu D, Shi H, Yu H, Wang Z, Wang X, Cross B, Bramler M, Huang T S. Computed tomography super-resolution using convolutional neural networks. In: Proceedings of 2017 IEEE International Conference on Image Processing (ICIP). 2017, 3944−3948

[104] Greenspan H, Oz G, Kiryati N, Peled S . MRI inter-slice reconstruction using super-resolution. Magnetic Resonance Imaging, 2002, 20( 5): 437–446

[105] Yu J, Lavery L, Kim K . Super-resolution ultrasound imaging method for microvasculature in vivo with a high temporal accuracy. Scientific Reports, 2018, 8( 1): 13918

[106] Isaac J S, Kulkarni R. Super resolution techniques for medical image processing. In: Proceedings of 2015 International Conference on Technologies for Sustainable Development (ICTSD). 2015, 1−6

[107] Park S C, Park M K, Kang M G . Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine, 2003, 20( 3): 21–36

[108] Kouame D, Ploquin M. Super-resolution in medical imaging: An illustrative approach through ultrasound. In: Proceedings of 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro. 2009, 249−252

[109] He S, Tian Y, Feng S, Wu Y, Shen X, Chen K, He Y, Sun Q, Li X, Xu J, Wen Z L, Qu J Y . In vivo single-cell lineage tracing in zebrafish using high-resolution infrared laser-mediated gene induction microscopy. eLife, 2020, 9: e52024

[110] Jones M G, Khodaverdian A, Quinn J J, Chan M M, Hussmann J A, Wang R, Xu C, Weissman J S, Yosef N . Inference of single-cell phylogenies from lineage tracing data using Cassiopeia. Genome Biology, 2020, 21: 92

[111] Andresen V, Pollok K, Rinnenthal J L, Oehme L, Günther R, Spiecker H, Radbruch H, Gerhard J, Sporbert A, Cseresnyes Z, Hauser A E, Niesner R . High-resolution intravital microscopy. PLoS One, 2012, 7( 12): e50915

[112] Small A, Stahlheber S . Fluorophore localization algorithms for super-resolution microscopy. Nature Methods, 2014, 11( 3): 267–279

[113] Orrit M . Celebrating optical nanoscopy. Nature Photonics, 2014, 8( 12): 887

[114] Singh A, Sidhu J S . Super resolution applications in modern digital image processing. International Journal of Computer Applications, 2016, 150( 2): 6–8

[115] UI Hoque M R, Burks R, Kwan C, Li J. Deep learning for remote sensing image super-resolution. In: Proceedings of the 10th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON). 2019, 286–292

[116] Zhu H, Tang X, Xie J, Song W, Mo F, Gao X . Spatio-temporal super-resolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement. Sensors, 2018, 18( 2): 498

[117] Guo J, Gong X, Wang W, Que X, Liu J . SASRT: semantic-aware super-resolution transmission for adaptive video streaming over wireless multimedia sensor networks. Sensors, 2019, 19( 14): 3121

[118] Mithra K, Vishvaksenan K S. Security and resolution enhanced transmission of medical image through IDMA aided coded STTD system. In: Proceedings of 2017 International Conference on Communication and Signal Processing (ICCSP). 2017, 2061−2065

[119] Hayat K . Multimedia super-resolution via deep learning: a survey. Digital Signal Processing, 2018, 81: 198–217

[120] Bishop C M, Blake A, Marthi B. Super-resolution enhancement of video. In: Proceedings of the 9th International Workshop on Artificial Intelligence and Statistics. 2003, 25–32

[121] Del Gallego N P, Ilao J . Multiple-image super-resolution on mobile devices: an image warping approach. EURASIP Journal on Image and Video Processing, 2017, 2017( 1): 8

[122] Hassaballah M, Hosny K M. Recent Advances in Computer Vision: Theories and Applications. Cham: Springer, 2018

[123] Liu D, Soran B, Petrie G, Shapiro L. A review of computer vision segmentation algorithms. 2012Lecture notes 53, 2012.

[124] Liu F, Wang J, Zhu S, Gleicher M, Gong Y . Visual-quality optimizing super resolution. Computer Graphics Forum, 2009, 28( 1): 127–140

[125] Hirst D, Rilliard A, Aubergé V. Comparison of subjective evaluation and an objective evaluation metric for prosody in text-to-speech synthesis. In: Proceedings of the 3rd ESCA/COCOSDA Workshop on Speech Synthesis. 1998, 1−4

[126] A. R. Reibman and T. Schaper, “Subjective performance evaluation for super-resolution image enhancement,” in Second Int. Wkshp on Video Proc. and Qual. Metrics (VPQM’06), 2006 https://ece.uwaterloo.ca/~z70wang/publications/ICIP12b.pdf

[127] Opozda S, Sochan A. The survey of subjective and objective method for quality assessment of 2D and 3D images. Theoretical and Applied Informatics, 2014, 26(1−2): 39−67

[128] Th. Alpert and J.-P. Evain, “Subjective quality evaluation - the SSCQE and DSCQE methodologies,” EBU technical review, Spring, See tech. ebu. ch/docs/techreview/trev_271-evain. pdf website, 1997, 12−20

[129] Int. Telecommun. Union, Methodology for the Subjective Assessment of the Quality of Television Pictures ITU-R Recommendation BT.500-9, Tech. Rep., See itu. int/rec/R-REC-BT. 500-11-200206-S/en website, 2002

[130] Wang Z, Bovik A C, Sheikh H R, Simoncelli E P . Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13( 4): 600–612

[131] Yan B, Bare B, Ma C, Li K, Tan W . Deep objective quality assessment driven single image super-resolution. IEEE Transactions on Multimedia, 2019, 21( 11): 2957–2971

[132] Sheikh H R, Bovik A C, De Veciana G . An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Transactions on Image Processing, 2005, 14( 12): 2117–2128

[133] Sheikh H R, Bovik A C. A visual information fidelity approach to video quality assessment. In: The first international workshop on video processing and quality metrics for consumer electronics; vol. 7. 2005, 2117–2128

[134] Yeganeh H, Rostami M, Wang Z. Objective quality assessment for image super-resolution: a natural scene statistics approach. In: Proceedings of the 19th IEEE International Conference on Image Processing. 2012, 1481−1484

[135] Wang X, Jiang G, Yu M. Reduced reference image quality assessment based on Contourlet domain and natural image statistics. In: Proceedings of the 5th International Conference on Image and Graphics. 2009, 45−50

[136] Al Madeed N, Awan Z, Al Madeed S. Image quality assessment-a survey of recent approaches. In: Proceedings of the 8th International Conference on Computer Science, Engineering and Applications. 2018, 143−156

[137] Keshk H M, Abdel-Aziem M M, Ali A S, Assal M A. Performance evaluation of quality measurement for super-resolution satellite images. In: Proceedings of 2014 Science and Information Conference. 2014, 364−371

[138] Zhu X, Cheng Y, Peng J, Wang R, Le M, Liu X . Super-resolved image perceptual quality improvement via multifeature discriminators. Journal of Electronic Imaging, 2020, 29( 1): 013017

[139] Blau Y, Michaeli T. The perception-distortion tradeoff. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 6228−6237

[140] Mittal A, Soundararajan R, Bovik A C . Making a "completely blind" image quality analyzer. IEEE Signal Processing Letters, 2012, 20( 3): 209–212

[141] Ma C, Yang C Y, Yang X, Yang M H . Learning a no-reference quality metric for single-image super-resolution. Computer Vision and Image Understanding, 2017, 158: 1–16

[142] Blau Y, Mechrez R, Timofte R, Michaeli T, Zelnik-Manor L. The 2018 PIRM challenge on perceptual image super-resolution. In: Proceedings of European Conference on Computer Vision. 2018, 334−355

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (Grant No. 62072328).

RIGHTS & PERMISSIONS

2024 Higher Education Press