Low-light image enhancement for UAVs guided by a light weighted map

Abstract

The unmanned aerial vehicle (UAV) images captured under low-light conditions are often suffering from noise and uneven illumination. To address these issues, we propose a low-light image enhancement algorithm for UAV images, which is inspired by the Retinex theory and guided by a light weighted map. Firstly, we propose a new network for reflectance component processing to suppress the noise in images. Secondly, we construct an illumination enhancement module that uses a light weighted map to guide the enhancement process. Finally, the processed reflectance and illumination components are recombined to obtain the enhancement results. Experimental results show that our method can suppress the noise in images while enhancing image brightness, and prevent over enhancement in bright regions. Code and data are available at https://gitee.com/baixiaotong2/uav-images.git.

References

[1] IbrahimH, KongN S P. Brightness preserving dynamic histogram equalization for image contrast enhancement. IEEE transactions on consumer electronics, 2007, 53(4): 1752-1758 J]

[2] ChengH D. A simple and effective histogram equalization approach to image enhancement. Digital signal processing, 2004, 14(2): 158-170 J]

[3] LandE H. The Retinex theory of color vision. Scientific American, 1977, 237(6): 108-129 J]

[4] JobsonD J, RahmanZ, WoodellG A. A multiscale Retinex for bridging the gap between color images and the human observation of scenes. IEEE transactions on image processing, 1997, 6(7): 965-976 J]

[5] GuoX J, LiY, LingH B. LIME: low-light image enhancement via illumination map estimation. IEEE transactions on image processing, 2016, 26(2): 982-993 J]

[6] CHEN W, WANG W J, YANG W H. Deep Retinex decomposition for low-light enhancement[EB/OL]. (2018-08-14) [2023-12-26]. https://arxiv.org/abs/1808.04560.

[7] ZhangY H, ZhangJ W, GuoX J. Kindling the darkness: a practical low-light image enhancer. Proceedings of 2019 ACM International Conference on Multimedia, October 21–25, 2019, Nice, France, 2019, New York, ACM: 1632-1640[C]

[8] HaiJ, XuanZ, YangR. R2RNet: low-light image enhancement via real-low to real-normal network. Journal of visual communication and image representation, 2023, 90: 103712 J]

[9] MaQ, WangY, ZengT Y. Retinex-based variational framework for low-light image enhancement and denoising. IEEE transactions on multimedia, 2022, 25: 5580-5588 J]

[10] MaL, MaT Y, LiuR S. Toward fast, flexible, and robust low-light image enhancement. Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19–23, 2022, New Orleans, USA, 2022, New York, IEEE: 5637-5646[C]

[11] WuW H, WengJ, ZhangP P. URetinex-Net: Retinex-based deep unfolding network for low-light image enhancement. Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 19–23, 2022, New Orleans, USA, 2022, New York, IEEE: 5901-5910[C]

[12] YangS Z, WuY M, LiZ H. Implicit neural representation for cooperative low-light image enhancement. Proceedings of 2023 IEEE/CVF Conference on Computer Vision, October 1–6, 2023, Paris, France, 2023, New York, IEEE: 12918-12927[C]

[13] FeiB, LyuZ Y, PanL, et al.. Generative diffusion prior for unified image restoration and enhancement. Proceedings of 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18–22, 2023, Vancouver, Canada, 2023, New York, IEEE: 9935-9946[C]

[14] YangL X, ZhangR Y, LiL D, et al.. SimAm: a simple, parameter-free attention module for convolutional neural networks. Proceedings of 2021 International Conference on Machine Learning, July 18–24, 2021, online, 2021, New York, IEEE: 11863-11874[C]

[15] HeK M, ZhangX Y, RenS Q. Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, June 2–July 1, 2016, Las Vegas, USA, 2016, New York, IEEE: 770-778[C]

[16] WangW J, WeiC, YangW H, et al.. GLADNet: low-light enhancement network with global awareness. Proceeding of the 2018 IEEE International Conference on Automatic Face & Gesture Recognition, May 15–19, 2018, Xiamen, China, 2018, New York, IEEE: 751-755[C]

[17] ZhangY H, GuoX J, MaJ Y, et al.. Beyond brightening low-light images. International journal of computer vision, 2021, 129: 1013-1037 J]

[18] LiC Y, GuoC L, ChenC L, et al.. Learning to enhance low-light image via zero-reference deep curve estimation. IEEE transactions on pattern analysis and machine intelligence, 2021, 44(8): 4225-4238[J]

[19] JiangY F, GongX Y, LiuD. EnlightenGAN: deep light enhancement without paired supervision. IEEE transactions on image processing, 2021, 30: 2340-2349 J]

[20] WangS H, ZhengJ, HuH M, et al.. Naturalness preserved enhancement algorithm for non-uniform illumination images. IEEE transactions on image processing, 2013, 22(9): 3538-3548 J]

[21] MaK D, ZengK, WangZ, et al.. Perceptual quality assessment for multi-exposure image fusion. IEEE transactions on image processing, 2015, 24(11): 3345-3356 J]

[22] YangW H, WangS Q, FangY M, et al.. From fidelity to perceptual quality: a semi-supervised approach for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 13–19, 2020, Seattle, USA, 2020, New York, IEEE: 3063-3072[C]

[23] GuoC L, LiC Y, GuoJ C, et al.. Zero-reference deep curve estimation for low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 13–19, 2020, Seattle, USA, 2020, New York, IEEE: 1780-1789[C]

[24] ZhuX H, SuW J, LuL W, et al.. Deformable DETR: deformable transformers for end-to-end object detection. Proceedings of 2021 International Conference on Learning Representation, May 3–7, 2021, online, 202011-16[C]

[25] GE Z, LIU S T, WANG F, et al. YOLOX: exceeding yolo series in 2021[EB/OL]. (2021-07-18) [2023-12-26]. https://arxiv.org/abs/2107.08430.

[26] LohY P, ChanC S. Getting to know low-light images with the exclusively dark dataset. Computer vision and image understanding, 2019, 178: 30-42 J]

RIGHTS & PERMISSIONS

Tianjin University of Technology