WaterPairs: a paired dataset for underwater image enhancement and underwater object detection

Abstract

Due to its importance in marine engineering and aquatic robotics, underwater image enhancement works as a preprocessing step to improve the performance of high-level vision tasks such as underwater object detection and recognition. Although several studies exhibit that underwater image enhancement algorithms can boost the detection accuracy of detectors, no work has focused on studying the relationship between these two tasks. This is mainly because current underwater datasets lack either bounding box annotations or high-quality reference images, based on which detection accuracy or image quality assessment metrics are calculated. To examine how underwater image enhancement methods affect underwater object detection tasks, we provide a large-scale underwater object detection dataset with both bounding box annotations and high-quality reference images, namely, the WaterPairs dataset. The WaterPairs dataset offers a platform for researchers to comprehensively study the influence of underwater image enhancement algorithms on underwater object detection tasks. We will release our dataset at https://github.com/IanDragon/WaterPairs once this paper is accepted.

Keywords

Underwater datasets / Underwater object detection / Underwater image enhancement / Reference image generation

References

[1] Ancuti C, Ancuti CO, Haber T, Bekaert P (2012) Enhancing underwater images and videos by fusion. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, pp 81–88

[2] Bazeille S, Quidu I, Jaulin L, Malkasse JP (2006) Automatic underwater image pre-processing. In: CMM’06, Brest, pp 1–8

[3] Bogue R. Underwater robots: a review of technologies and applications. Ind Robot Int J, 2015, 42(3): 186-191,

[4] Clark CM, Forney C, Manii E, et al.. Tracking and following a tagged leopard shark with an autonomous underwater vehicle. J Field Robot, 2013, 30(3): 309-322,

[5] Drews P, Nascimento E, Moraes F, Botelho S, Campos M (2013) Transmission estimation in underwater single images. In: 2013 IEEE International Conference on Computer Vision Workshops, Sydney, pp 825–830

[6] Fabbri C, Islam MJ, Sattar J (2018) Enhancing underwater imagery using generative adversarial networks. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, pp 7159–7165

[7] Foresti GL, Gentili S. A vision based system for object detection in underwater images. Int J Pattern Recogn Artif Intell, 2000, 14(02): 167-188,

[8] Fu XY, Fan ZW, Ling M, Huang Y, Ding XH (2017) Two-step approach for single underwater image enhancement. In: 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Xiamen, pp 789–794

[9] Fu X, Zhuang P, Huang Y, Liao YH, Zhang XP, Ding XH (2014) A retinex-based enhancing approach for single underwater image. In: 2014 IEEE International Conference on Image Processing (ICIP), Paris, pp 4572–4576

[10] Galdran A, Pardo D, Picón A, Alvarez-Gila A. Automatic Red-Channel underwater image restoration. Vis Commun Image Represent, 2015, 26: 132-145,

[11] He K, Sun J, Tang X. Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell, 2010, 33(12): 2341-2353,

[12] Jian MW, Qi Q, Dong JY, Yin YL, Zhang WY, Lam KM (2017) The OUC-vision large-scale underwater image database. In: 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, pp 1297–1302

[13] Li C, Anwar S, Porikli F. Underwater scene prior inspired deep underwater image and video enhancement. Pattern Recognit, 2020, 98: 107038,

[14] Li C, Guo C, Ren W, et al.. An underwater image enhancement benchmark dataset and beyond. IEEE Trans Image Process, 2019, 29: 4376-4389,

[15] Li CY, Guo JC, Cong RM, et al.. Underwater image enhancement by dehazing with minimum information loss and histogram distribution prior. IEEE Trans Image Process, 2016, 25(12): 5664-5677,

[16] Li C, Guo J, Guo C, et al.. A hybrid method for underwater image correction. Pattern Recogn Lett, 2017, 94: 62-67,

[17] Li J, Skinner KA, Eustice RM, et al.. Watergan: Unsupervised generative network to enable real-time color correction of monocular underwater images. IEEE Robot Autom Lett, 2017, 3(1): 387-394

[18] Li T, Rong S, Cao X, et al.. Underwater image enhancement framework and its application on an autonomous underwater vehicle platform. Optical Engineering, 2020, 59(8): 083102,

[19] Li TY, Rong SH, Chen L, Zhou HY, He B (2022a) Underwater motion deblurring based on cascaded attention mechanism. IEEE J Ocean Eng. https://doi.org/10.1109/JOE.2022.3192047

[20] Li TY, Rong SH, He B, Chen L (2022b) Underwater image deblurring framework using a generative adversarial network. In: OCEANS 2022, Chennai, pp 1–4

[21] Li T, Rong S, Zhao W, et al.. Underwater image enhancement using adaptive color restoration and dehazing. Opt Express, 2022, 30(4): 6216-6235,

[22] Liu R, Fan X, Zhu M, et al.. Real-world underwater enhancement: Challenges, benchmarks, and solutions under natural light. IEEE Trans Circ Syst Video Technol, 2020, 30(12): 4861-4875,

[23] Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY et al (2016) SSD: single shot multibox detector. In: 14th European Conference on Computer Vision (ECCV), Amsterdam, pp 21–37

[24] Mohammadi P, Ebrahimi-Moghadam A, Shirani S (2014) Subjective and objective quality assessment of image: a survey. Preprint at arXiv:1406.7799

[25] Panetta K, Gao C, Agaian S. Human-visual-system-inspired underwater image quality measures. IEEE J Ocean Eng, 2015, 41(3): 541-551,

[26] Peng YT, Cao K, Cosman PC. Generalization of the dark channel prior for single image restoration. IEEE Trans Image Process, 2018, 27(6): 2856-2868,

[27] Peng YT, Cosman PC. Underwater image restoration based on image blurriness and light absorption. IEEE Trans Image Process, 2017, 26(4): 1579-1594,

[28] Pronin E. Perception and misperception of bias in human judgment. Trends Cogn Sci, 2007, 11(1): 37-43,

[29] Schettini R, Corchs S. Underwater image processing: state of the art of restoration and image enhancement methods. EURASIP J Adv Signal Process, 2010, 2010: 1-14,

[30] Seshadrinathan K, Soundararajan R, Bovik AC, et al.. Study of subjective and objective quality assessment of video. IEEE Trans Image Process, 2010, 19(6): 1427-1441,

[31] Singh G, Jaggi N, Vasamsetti S, Sardana HK, Kumar S, Mittal N (2015) Underwater image/video enhancement using wavelet based color correction (WBCC) method. In: 2015 IEEE Underwater Technology (UT), Chennai, pp 1–5

[32] Wang S, Ma K, Yeganeh H, et al.. A patch-structure representation method for quality assessment of contrast changed images. IEEE Signal Process Lett, 2015, 22(12): 2387-2390,

[33] Wang Z, Bovik AC, Sheikh HR, et al.. Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process, 2004, 13(4): 600-612,

[34] Xu J, Wang M, Qiao L. Dynamical sliding mode control for the trajectory tracking of underactuated unmanned underwater vehicles. Ocean Eng, 2015, 105: 54-63,

[35] Yang M, Sowmya A. An underwater color image quality evaluation metric. IEEE Trans Image Process, 2015, 24(12): 6062-6071,

[36] Zhang WD, Zhou L, Zhuang PX, Li GH, Pan XP, Zhao WY et al (2023) Underwater image enhancement via weighted wavelet visual perception fusion. IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/TCSVT.2023.3299314

[37] Zhang W, Zhuang P, Sun HH, et al.. Underwater image enhancement via minimal color loss and locally adaptive contrast enhancement. IEEE Trans Image Process, 2022, 31: 3997-4010,

[38] Zhu JY, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: 2017 IEEE International Conference on Computer Vision (ICCV), Venice, pp 2242–2251

[39] Zhuang P, Wu J, Porikli F, et al.. Underwater image enhancement with hyper-laplacian reflectance priors. IEEE Trans Image Process, 2022, 31: 5442-5455,