FPCNet-based change detection for remote sensing images

Abstract

The objective of this study is to address semantic misalignment and insufficient accuracy in edge detail and discrimination detection, which are common issues in deep learning-based change detection methods relying on encoding and decoding frameworks. In response to this, we propose a model called FlowDual-PixelClsObjectMec (FPCNet), which innovatively incorporates dual flow alignment technology in the decoding stage to rectify semantic discrepancies through streamlined feature correction fusion. Furthermore, the model employs an object-level similarity measurement coupled with pixel-level classification in the PixelClsObjectMec (PCOM) module during the final discrimination stage, significantly enhancing edge detail detection and overall accuracy. Experimental evaluations on the change detection dataset (CDD)and building CDD demonstrate superior performance, with F1 scores of 95.1% and 92.8%, respectively. Our findings indicate that the FPCNet outperforms the existing algorithms in stability, robustness, and other key metrics.

Keywords

remote sensing image change detection / semantic misalignment / dual flow alignment / deep supervised discrimination

References

[1] CHEN J, CHEN X H, CUI X H, et al. Change vector analysis in posterior probability space: a new method for land cover change detection. IEEE Geoscience and Remote Sensing Letters, 2011, 8(2): 317-321.

[2] LI Z Y, LIU T F, SHI C, et al. Novel land cover change detection method based on k-means clustering and adaptive majority voting using bitemporal remote sensing images. IEEE Access, 2019, 7: 34425-34437.

[3] QIN R J, HUANG X, GRUEN A, et al. Object-based 3-D building change detection on multitemporal stereo images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(5): 2125-2137.

[4] CAYE DAUDT R, LE SAUX B, BOULCH A. Fully convolutional Siamese networks for change detection//2018 25th IEEE International Conference on Image Processing, October 7-10, 2018, Athens, Greece. New York: IEEE, 2018: 4063-4067.

[5] YIN Y H,ZHANG Y P, ZHAO T B,et al.Sea ice change detection algorithm based on multi-scale reconstruction and constrained clustering.Journal of Test and Measurement Technology, 2023, 37(3):1 99-207.

[6] CHEN P, LI C, ZHANG B, et al. A region-based feature fusion network for VHR image change detection. Remote Sensing, 2022, 14(21): 5577.

[7] FANG S, LI K Y, SHAO J Y, et al. SNUNet-CD: a densely connected Siamese network for change detection of VHR images. IEEE Geoscience and Remote Sensing Letters, 2021, 19: 8007805.

[8] ZHOU Z W, RAHMAN SIDDIQUEE M M, TAJBAKHSH N, et al. UNet++: A nested U-Net architecture for medical image segmentation//Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support. Cham: Springer International Publishing, 2018: 3-11.

[9] CHEN H, SHI Z W. A spatial-temporal attention-based method and a new dataset for remote sensing image change detection. Remote Sensing, 2020, 12(10): 1662.

[10] CHEN J, YUAN Z Y, PENG J, et al. DASNet: dual attentive fully convolutional Siamese networks for change detection in high-resolution satellite images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2020, 14: 1194-1206.

[11] FU W F. Research on remote sensing image change detection algorithm based on deep learning. Chengdu: University of Electronic Science and Technology, 2021.

[12] GU L, XU S Q, ZHU L Q. Remote sensing image building change detection based on FlowS-Unet. Journal of Automation, 2020, 46(6): 1291-1300.

[13] WANG H, SONG H X,ZHANG Z. Two-stream face image restoration algorithm based on texture and structure. Journal of Test and Measurement Technology, 2024, 38(3): 274-280.

[14] JI S P, TIAN S Q, ZHANG C. Urban land cover classification and change detection using full null convolutional neuron network. Journal of Wuhan University (Information Science Edition), 2020, 45(2): 233-241.

[15] BAO T F. High-resolution remote sensing image change detection based on convolutional neural network. Shanghai: Shanghai Jiaotong University, 2020.

[16] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition//2016 IEEE Conference on Computer Vision and Pattern Recognition, June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 2016: 770-778.

[17] FANG S, LI K Y, LI Z. Changer: feature interaction is what you need for change detection. 2022: 2209.08290.

[18] LI X T, YOU A S, ZHU Z, et al. Semantic flow for fast and accurate scene parsing//European Conference on Computer Vision, October 23–28, 2020, Glasgow, Scotland, UK.. Cham: Springer International Publishing, 2020: 775-793.

[19] ZHANG C, CHEN X P, HAN G Q, et al. Spatial transformer network on skeleton-based gait recognition. 2022: 2204.03873.

[20] PENG C, ZHANG X Y, YU G, et al. Large kernel matters: improve semantic segmentation by global convolutional network//2017 IEEE Conference on Computer Vision and Pattern Recognition, July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2017: 1743-1751.

[21] ZHAO H S, SHI J P, QI X J, et al. Pyramid scene parsing network//2017 IEEE Conference on Computer Vision and Pattern Recognition, July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2017: 6230-6239.

[22] LU C, GUAN S. Research on the change detection method of urban high-resolution remote sensing images based on deep learning. Computer Application Research,2020, 37(S1): 320-323.

[23] JI S P, WEI S Q, LU M. Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(1): 574-586.

[24] ZHANG H Y, LIN M H, YANG G Y, et al. ESCNet: an end-to-end superpixel-enhanced change detection network for very-high-resolution remote sensing images. IEEE Transactions on Neural Networks and Learning Systems, 2023, 34(1): 28-42.