Progressive Colour Equalisation and Detail Refinement for Underwater Image Enhancement

Abstract

Underwater image enhancement remains a critical challenge in computational vision due to complex distortions caused by wavelength-dependent light absorption and scattering. This paper introduces CEDFNet, a novel two-stage framework that leverages advanced computational intelligence techniques for robust and high-fidelity underwater image restoration. The first stage integrates a Colour Equalisation Transformer (CET) to perform global colour correction by modelling long-range dependencies and mitigating dominant hue distortions. The second stage combines a Residual Texture Modulation Adaptor (RTMA) with an Enhanced Bilateral Enhancement Decoder (EBED) to refine structural details and enhance local contrast through context-aware and adaptive feature learning. Extensive evaluations on benchmark datasets including UIEBD, LSUI, and Colour-Checker7 validate the superiority of CEDFNet over existing state-of-the-art approaches. Quantitatively, CEDFNet achieves significant improvements across multiple perceptual and fidelity metrics such as PSNR, SSIM, FID, and LPIPS. Comprehensive ablation studies further confirm the complementary roles of CET, RTMA, and EBED, whereas parameter sensitivity analyses highlight the framework's robust and stable behaviour. By integrating transformer-based global correction with task-adaptive local enhancement, CEDFNet advances the frontier of underwater image restoration in the domain of computational intelligence. It generalises well across diverse imaging conditions and offers a lightweight and end-to-end solution suitable for real-world deployment in marine robotics, inspection, and visual perception systems.

Keywords

detail refinement / transformer-based color correction / underwater image enhancement

Acknowledgements

This work is partially supported by the National Natural Science Foundation of China (NSFC) under Grant 62306180 and the Shenzhen Science and Technology Program under Grant JCYJ20250604181503004.

Conflicts of Interest

The authors declare no conflicts of interest.

Data Availability Statement

The datasets used in this study are publicly available and can be accessed from standard underwater image enhancement benchmarks, including UIEB, EUVP, and U45. Detailed links and usage instructions are provided in the supplementary material. No proprietary or newly collected data were used in this work.

References

[1] S. Anwar and C. Li, “Diving Deeper into Underwater Image Enhancement: A Survey,” Signal Processing: Image Communication 89 (2020): 115978, https://doi.org/10.1016/j.image.2020.115978.

[2] D. Akkaynak, T. Treibitz, T. Shlesinger, Y. Loya, R. Tamir, and D. Iluz, “What is the Space of Attenuation Coefficients in Underwater Computer Vision?,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2017), 4931-4940.

[3] J. McMahon and E. Plaku, “Autonomous Data Collection With Timed Communication Constraints for Unmanned Underwater Vehicles,” IEEE Robotics and Automation Letters 6, no. 2 (2021): 1832-1839, https://doi.org/10.1109/lra.2021.3060709.

[4] J. Zhou, Z. He, K.-M. Lam, et al., Amsp-Uod: When Vortex Convolution and Stochastic Perturbation Meet Underwater Object Detection,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 7, (2024), 7659-7667, https://doi.org/10.1609/aaai.v38i7.28599.

[5] T. Kong and W. P. Rey, “Self-Supervised Low-Light Image Enhancement Based on Retinex and Histogram Equalization Prior,” in Proceedings of the International Conference on Image Processing, Machine Learning and Pattern Recognition, (2024), 143-147.

[6] X. Bing, W. Ren, Y. Tang, G. G. Yen, and Q. Sun, “Domain Adaptation For In-Air to Underwater Image Enhancement via Deep Learning,” IEEE Transactions on Emerging Topics in Computational Intelligence 8, no. 1 (2023): 1015-1029, https://doi.org/10.1109/tetci.2023.3322424.

[7] D. Zhang, J. Zhou, C. Guo, W. Zhang, and C. Li, “Synergistic Multiscale Detail Refinement via Intrinsic Supervision for Underwater Image Enhancement,” Proceedings of the AAAI Conference on Artificial Intelligence 38, no. 7 (2024): 7033-7041, https://doi.org/10.1609/aaai.v38i7.28530.

[8] S. Huang, K. Wang, H. Liu, J. Chen, and Y. Li, “Contrastive Semi-Supervised Learning for Underwater Image Restoration via Reliable Bank,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2023), 18145-18155.

[9] X. Cong, J. Gui, and J. Hou, “Underwater Organism Color Fine-Tuning via Decomposition and Guidance,” Proceedings of the AAAI Conference on Artificial Intelligence 38, no. 2 (2024): 1389-1398, https://doi.org/10.1609/aaai.v38i2.27903.

[10] Q. Jiang, Y. Kang, Z. Wang, W. Ren, and C. Li, “Perception-Driven Deep Underwater Image Enhancement Without Paired Supervision,” IEEE Transactions on Multimedia (2023).

[11] Z. Shen, H. Xu, T. Luo, Y. Song, and Z. He, “Udaformer: Underwater Image Enhancement Based on Dual Attention Transformer,” Computers & Graphics 111 (2023): 77-88, https://doi.org/10.1016/j.cag.2023.01.009.

[12] Z. Huang, J. Li, Z. Hua, and L. Fan, “Underwater Image Enhancement via Adaptive Group Attention-Based Multiscale Cascade Transformer,” IEEE Transactions on Instrumentation and Measurement 71 (2022): 1-18, https://doi.org/10.1109/tim.2022.3189630.

[13] Y. Xiao, Q. Yuan, K. Jiang, J. He, X. Jin, and L. Zhang, “Ediffsr: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution,” IEEE Transactions on Geoscience and Remote Sensing 62 (2023): 1-14, https://doi.org/10.1109/tgrs.2023.3341437.

[14] Y. Xiao, Q. Yuan, K. Jiang, J. He, C.-W. Lin, and L. Zhang, “Ttst: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution,” IEEE Transactions on Image Processing 33 (2024): 738-752, https://doi.org/10.1109/tip.2023.3349004.

[15] K. Jiang, Q. Wang, Z. An, Z. Wang, C. Zhang, and C.-W. Lin, “Mutual Retinex: Combining Transformer and Cnn for Image Enhancement,” IEEE Transactions on Emerging Topics in Computational Intelligence 8, no. 3 (2024): 2240-2252, https://doi.org/10.1109/tetci.2024.3369321.

[16] C. Zhao, W. Cai, C. Dong, and C. Hu, “Wavelet-Based Fourier Information Interaction With Frequency Diffusion Adjustment for Underwater Image Restoration,” arXiv preprint arXiv:2311.16845 (2023).

[17] M. Guan, H. Xu, G. Jiang, et al., Diffwater: Underwater Image Enhancement Based on Conditional Denoising Diffusion Probabilistic Model,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (2023).

[18] C. Li, C. Guo, W. Ren, et al., An Underwater Image Enhancement Benchmark Dataset and Beyond,” IEEE Transactions on Image Processing 29 (2019): 4376-4389, https://doi.org/10.1109/tip.2019.2955241.

[19] L. Peng, C. Zhu, and L. Bian, “U-Shape Transformer for Underwater Image Enhancement,” IEEE Transactions on Image Processing (2023).

[20] M. S. Hitam, E. A. Awalludin, W. N. J. H. W. Yussof, and Z. Bachok, “Mixture Contrast Limited Adaptive Histogram Equalization for Underwater Image Enhancement,” in 2013 International Conference on Computer Applications Technology (ICCAT) (IEEE, 2013), 1-5.

[21] K. Iqbal, M. Odetayo, A. James, R. A. Salam, and A. Z. H. Talib, “Enhancing the Low Quality Images Using Unsupervised Colour Correction Method,” in 2010 IEEE International Conference on Systems, Man and Cybernetics (IEEE, 2010), 1703-1709.

[22] K. He, J. Sun, and X. Tang, “Single Image Haze Removal Using Dark Channel Prior,” IEEE Transactions on Pattern Analysis and Machine Intelligence 33, no. 12 (2010): 2341-2353, https://doi.org/10.1109/TPAMI.2010.168.

[23] C. Ancuti, C. O. Ancuti, T. Haber, and P. Bekaert, “Enhancing Underwater Images and Videos by Fusion,” in 2012 IEEE Conference on Computer Vision and Pattern Recognition (IEEE, 2012), 81-88.

[24] A. S. A. Ghani and N. A. M. Isa, “Underwater Image Quality Enhancement Through Integrated Color Model With Rayleigh Distribution,” Applied Soft Computing 27 (2015): 219-230, https://doi.org/10.1016/j.asoc.2014.11.020.

[25] S. G. Narasimhan and S. K. Nayar, “Vision and the Atmosphere,” International Journal of Computer Vision 48, no. 3 (2002): 233-254, https://doi.org/10.1023/a:1016328200723.

[26] Z. Li, S. Pu, M. Ji, F. Zeng, and B. Li, “Visible and Near-Infrared Image Fusion Based on Information Complementarity,” CAAI Transactions on Intelligence Technology 10, no. 1 (2025): 193-206, https://doi.org/10.1049/cit2.12378.

[27] Z. Fu, W. Wang, Y. Huang, X. Ding, and K.-K. Ma, “Uncertainty Inspired Underwater Image Enhancement,” in European Conference on Computer Vision (Springer, 2022), 465-482.

[28] C. Li, S. Anwar, and F. Porikli, “Underwater Scene Prior Inspired Deep Underwater Image and Video Enhancement,” Pattern Recognition 98 (2020): 107038, https://doi.org/10.1016/j.patcog.2019.107038.

[29] J. Li, K. A. Skinner, R. M. Eustice, and M. Johnson-Roberson, “Watergan: Unsupervised Generative Network to Enable Real-Time Color Correction of Monocular Underwater Images,” IEEE Robotics and Automation Letters 3, no. 1 (2017): 387-394, https://doi.org/10.1109/LRA.2017.2730363.

[30] Y. Liu, Q. Jiang, X. Wang, T. Luo, and J. Zhou, “Underwater Image Enhancement With Cascaded Contrastive Learning,” IEEE Transactions on Multimedia (2024).

[31] A. Vaswani, N. Shazeer, N. Parmar, et al., Attention is all You Need,” Advances in Neural Information Processing Systems 30 (2017), https://dl.acm.org/doi/10.5555/3295222.3295349.

[32] B. Wang, H. Xu, G. Jiang, et al., Uie-Convformer: Underwater Image Enhancement Based on Convolution and Feature Fusion Transformer,” IEEE Transactions on Emerging Topics in Computational Intelligence (2024).

[33] R. Khan, P. Mishra, N. Mehta, et al., Spectroformer: Multi-Domain Query Cascaded Transformer Network for Underwater Image Enhancement,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, (2024), 1454-1463.

[34] M. Raghu, W. Zhao, B. Liu, et al., Dynamicvit: Efficient Vision Transformers With Dynamic Sparse Attention,” arXiv preprint arXiv:2106.02034 (2021).

[35] Z. Liu, Y. Lin, Y. Cao, et al., Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, (2021), 10012-10022.

[36] K. Jiang, R. Wang, Y. Xiao, J. Jiang, X. Xu, and T. Lu, “Image Enhancement via Associated Perturbation Removal and Texture Reconstruction Learning,” IEEE/CAA Journal of Automatica Sinica 11, no. 11 (2024): 2253-2269, https://doi.org/10.1109/jas.2024.124521.

[37] J. Ho, A. Jain, and P. Abbeel, “Denoising Diffusion Probabilistic Models,” Advances in Neural Information Processing Systems 33 (2020): 6840-6851, https://dl.acm.org/doi/10.5555/2073876.2073934.

[38] C. Saharia, W. Chan, S. Saxena, et al., Photorealistic Text-to-Image Diffusion Models With Deep Language Understanding,” Advances in Neural Information Processing Systems 35 (2022): 36479-36494, https://doi.org/10.48550/arXiv.2205.11487.

[39] J. Song, C. Meng, and S. Ermon, “Denoising Diffusion Implicit Models,” arXiv preprint arXiv:2010.02502 (2020).

[40] T. Salimans, P. Dhariwal, “Improved Denoising Diffusion Probabilistic Models,” arXiv preprint arXiv:2206.01293 (2022).

[41] L. Zhang, A. Rao, and M. Agrawala, “Adding Conditional Control to Text-To-Image Diffusion Models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, (2023), 3836-3847.

[42] X. Chen, Z. Li, T. Wang , “Diffusion Convolutional Networks for Image Generation,” arXiv preprint arXiv:2303.00001 (2023).

[43] Y. Liu, A. Blattmann, D. Lorenz, “Convolutional Diffusion Models for Efficient Image Synthesis,” arXiv preprint arXiv:2304.00001 (2023).

[44] Y.-T. Peng, K. Cao, and P. C. Cosman, “Generalization of the Dark Channel Prior for Single Image Restoration,” IEEE Transactions on Image Processing 27, no. 6 (2018): 2856-2868, https://doi.org/10.1109/tip.2018.2813092.

[45] W.-S. Lai, J.-B. Huang, N. Ahuja, and M.-H. Yang, “Fast and Accurate Image Super-Resolution With Deep Laplacian Pyramid Networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence 41, no. 11 (2018): 2599-2613, https://doi.org/10.1109/tpami.2018.2865304.

[46] Z. Fu, X. Lin, W. Wang, Y. Huang, and X. Ding, “Underwater Image Enhancement via Learning Water Type Desensitized Representations,” in ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2022), 2764-2768.

[47] Y. Tang, H. Kawasaki, and T. Iwaguchi, “Underwater Image Enhancement by Transformer-Based Diffusion Model With Non-Uniform Sampling for Skip Strategy,” in Proceedings of the 31st ACM International Conference on Multimedia, (2023), 5419-5427.

[48] C. Zhao, W. Cai, C. Dong, and C. Hu, “Wavelet-Based Fourier Information Interaction With Frequency Diffusion Adjustment for Underwater Image Restoration,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2024), 8281-8291.

[49] L. Chang, Y. Wang, L. Deng, B. Du, and C. Xu, “Waterdiffusion: Learning a Prior-Involved Unrolling Diffusion for Joint Underwater Saliency Detection and Visual Restoration,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 2, (2025), 1998-2006, https://doi.org/10.1609/aaai.v39i2.32196.

[50] L. Peng and L. Bian, “Adaptive Dual-Domain Learning for Underwater Image Enhancement,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 6, (2025), 6461-6469, https://doi.org/10.1609/aaai.v39i6.32692.

[51] R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The Unreasonable Effectiveness of Deep Features as a Perceptual Metric,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2018), 586-595.

[52] M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “Gans Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium,” Advances in Neural Information Processing Systems 30 (2017), https://doi.org/10.48550/arXiv.1706.08500.

[53] Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity,” IEEE Transactions on Image Processing 13, no. 4 (2004): 600-612, https://doi.org/10.1109/tip.2003.819861.

[54] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the Inception Architecture for Computer Vision,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (2016), 2818-2826.

[55] G. Sharma, W. Wu, and E. N. Dalal, “The Ciede2000 Color-Difference Formula: Implementation Notes, Supplementary Test Data, and Mathematical Observations,” in Color Research & Application, (Colour Group (Great Britain), Canadian Society for Color, Color Science Association of Japan, Dutch Society for the Study of Color, The Swedish Colour Centre Foundation, Colour Society of Australia, Centre Français de la Couleur, 2005), vol. 30, no. 1, 21-30, https://doi.org/10.1002/col.20070.