Fine-grained similarity-based multi-label hash retrieval for remote sensing images

Abstract

The existing multi-label hash retrieval methods fail to adequately capture the fine-grained distinctions between image pairs during similarity evaluations. To address this limitation, we propose a novel fine-grained similarity evaluation method for multi-label image pairs, upon which we develop a fine-grained similarity-based multi-label remote sensing image hash retrieval (FMHR) framework. Specifically, the developed evaluation method establishes hierarchical criteria that systematically account for both common and distinct labels between image pairs. FMHR leverages the proposed evaluation framework to extract multi-dimensional discriminative features from remote sensing images. The experimental results on three public multi-label remote sensing datasets demonstrate that the FMHR approach outperforms other methods in terms of retrieval quality and ranking accuracy.

Keywords

A

References

[1] Zhou W, Guan H, Li Z, et al. . Remote sensing image retrieval in the past decade: achievements, challenges, and future directions. IEEE journal of selected topics in applied earth observations and remote sensing, 2023, 16: 1447-1473 J]

[2] Wu N, Jin W, Fu R. Human communication-inspired semantic-view collaborative network for multispectral remote sensing image retrieval. IEEE journal of selected topics in applied earth observations and remote sensing, 2024, 17: 11230-11245 J]

[3] Cui C, Huo H, Fang T. Deep hashing with multi-central ranking loss for multi-label image retrieval. IEEE signal processing letters, 2023, 30: 135-139 J]

[4] Huang M, Dong L, Dong W, et al. . Supervised contrastive learning based on fusion of global and local features for remote sensing image retrieval. IEEE transactions on geoscience and remote sensing, 2023, 61: 1-13[J]

[5] Song W, Li S, Benediktsson J A. Deep hashing learning for visual and semantic retrieval of remote sensing images. IEEE transactions on geoscience and remote sensing, 2020, 59(11): 9661-9672 J]

[6] Jin W, Cai Z, Pan Y, et al. . ICIHRN: an interpretable multi-label hash retrieval method for satellite cloud images. IEEE journal of selected topics in applied earth observations and remote sensing, 2024, 17: 8662-8672 J]

[7] Sumbul G, Ravanbakhsh M, Demir B. Informative and representative triplet selection for multilabel remote sensing image retrieval. IEEE transactions on geoscience and remote sensing, 2021, 60: 1-11[J]

[8] Ye F, Wu K, Zhang R, et al. . Multi-scale feature fusion based on PVTv2 for deep hash remote sensing image retrieval. Remote sensing, 2023, 15(19): 4729 J]

[9] Liu B, Liu S, Liu W. A semantically guided deep supervised hashing model for multi-label remote sensing image retrieval. Remote sensing, 2025, 175838 J]

[10] Imbriaco R, Sebastian C, Bondarev E, et al. . Toward multilabel image retrieval for remote sensing. IEEE transactions on geoscience and remote sensing, 2021, 60: 1-14 J]

[11] Zhang Z, Zou Q, Lin Y, et al. . Improved deep hashing with soft pairwise similarity for multi-label image retrieval. IEEE transactions on multimedia, 2019, 22(2): 540-553 J]

[12] Shao Z, Zhou W, Deng X, et al. . Multilabel remote sensing image retrieval based on fully convolutional network. IEEE journal of selected topics in applied earth observations and remote sensing, 2020, 13318-328 J]

[13] Hua Y, Mou L, Zhu X. Recurrently exploring class-wise attention in a hybrid convolutional and bidirectional LSTM network for multi-label aerial image classification. ISPRS journal of photogrammetry and remote sensing, 2019, 149: 188-199 J]

[14] Chaudhuri B, Demir B, Chaudhuri S, et al. . Multilabel remote sensing image retrieval using a semi-supervised graph-theoretic method. IEEE transactions on geoscience and remote sensing, 2017, 56(2): 1144-1158 J]

[15] Hua Y, Mou L, Zhu X. Relation network for multilabel aerial image classification. IEEE transactions on geoscience and remote sensing, 2020, 58(7): 4558-4572 J]

[16] Wang J, Kumar S, Chang S F. Semi-supervised hashing for scalable image retrieval. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 13–18, 2010, San Francisco, CA, USA. 2010, New York, IEEE34243431[C]

[17] Su S, Zhang C, Han K, et al. . Greedy hash: towards fast optimization for accurate hash coding in CNN. Advances in neural information processing systems, 2018, 31: 1-10[J]

[18] Yuan L, Wang T, Zhang X, et al. . Central similarity quantization for efficient image and video retrieval. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 14–19, 2020, Seattle, WA, USA. 2020, New York, IEEE30833092[C]

[19] Zheng X, Zhang Y, Lu X. Deep balanced discrete hashing for image retrieval. Neurocomputing, 2020, 403: 224-236 J]

[20] Cheng Q, Huang H, Ye L, et al. . A semantic-preserving deep hashing model for multi-label remote sensing image retrieval. Remote sensing, 2021, 13(24): 4965 J]

[21] Dai Y, Song W, Li Y, et al. . Feature disentangling and reciprocal learning with label-guided similarity for multi-label image retrieval. Neurocomputing, 2022, 511353-365 J]

RIGHTS & PERMISSIONS

Tianjin University of Technology