With the development of unmanned aerial vehicle and satellite technology, the application of tiny object detection in remote sensing images is becoming increasingly widespread. Although significant progress has been made in the accuracy and speed of object detection in recent years, performance declines sharply when general object detectors are applied to tiny objects; one of the main reasons is unsuitable label assignment strategy. Traditional label assignment strategies often rely on fixed thresholds, leading to mismatches between the number of positive samples and object areas. Additionally, most improved methods require setting one or more hyperparameters. In this paper, we propose a dynamic adaptive label assignment strategy (DALA) comprising three modules. First, we calculate the similarity distance to comprehensively evaluate the matching degree between anchors and each ground truth. Then, we use the ratio-based label assignment strategy to select an appropriate number of positive samples for each object. Finally, we introduce dynamic weighting loss during training to ensure the model pays more attention to tiny objects. Our three modules automatically adapt to different datasets and detectors without any manual hyperparameter settings. Extensive experiments on four widely used datasets demonstrate the excellent performance of our proposed method. Our code will be released soon.
Funding
The authors have nothing to report.
Conflicts of Interest
Xin Xu is an editorial board member for the journal, and was not involved in peer review process or the decision to publish this article. The authors declare that they have no conflict of interest.
Data Availability Statement
The authors have nothing to report.
| [1] |
Q. Wang, Z. Li, S. Zhang, N. Chi, and Q. Dai, “A Versatile Wavelet Enhanced CNN Transformer for Improved Fluorescence Microscopy Image Restoration,” Neural Networks 170 (2024): 227-241, https://doi.org/10.1016/j.neunet.2023.11.039.
|
| [2] |
H. Chen, Z. Liu, C. Alippi, B. Huang, and D. Liu, “Explainable Intelligent Fault Diagnosis for Nonlinear Dynamic Systems: From Unsupervised to Supervised Learning,” IEEE Transactions on Neural Networks and Learning Systems 35, no. 5 (2024): 6166-6179, https://doi.org/10.1109/TNNLS.2022.3201511.
|
| [3] |
W. Li, M. Liu, H. Liu, et al., GraphMLP: A Graph MLP Like Architecture for 3D Human Pose Estimation,” Pattern Recognition 158 (2025): 110925, https://doi.org/10.1016/j.patcog.2024.110925.
|
| [4] |
H. Gao, X. Zheng, Q. Liu, et al. , “A Spatial Temporal Predictive Transformer Network for Level 3 Autonomous Vehicle Decision Making,” IEEE Transactions on Neural Networks and Learning Systems 36, no. 7 (2024): 1-15, https://doi.org/10.1109/TNNLS.2024.3487838.
|
| [5] |
H. Sun, Q. Li, J. Yu, et al., Deep Feature Reconstruction Learning for Open Set Classification of Remote Sensing Imagery,” IEEE Geoscience and Remote Sensing Letters 20 (2023): 1-5, https://doi.org/10.1109/LGRS.2023.3295871.
|
| [6] |
T. Hafs, H. Zehir, A. Hafs, H. Brahmia, and A. Nait Ali, “Enhancing Recognition in Multimodal Biometric Systems: Score Normalization and Fusion of Online Signatures and Fingerprints,” Romanian Journal of Information Science and Technology 27, no. 1 (2024): 37-49, https://doi.org/10.59277/ROMJIST.2024.1.03.
|
| [7] |
J. Ning, “Neural Network based Pattern Recognition in the Framework of Edge Computing,” Romanian Journal of Information Science and Technology 27, no. 1 (2024): 106-119, https://doi.org/10.59277/ROMJIST.2024.1.08.
|
| [8] |
T. Y. Lin, M. Maire, S. Belongie, et al., Microsoft COCO: Common Objects in Context,” in Computer Vision - ECCV 2014, eds. D. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars (International Publishing, 2014), 740-755.
|
| [9] |
J. Redmon and A. Farhadi, “YOLOv3: An Incremental Improvement,” arXiv, Version 1 (2018), https://doi.org/10.48550/ARXIV.1804.02767.
|
| [10] |
C. Y. Wang, I. H. Yeh, and H. Y. Mark Liao, “YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information,” Computer Vision - ECCV 2024 (2025): 1-21, https://doi.org/10.1007/978-3-031-72751-1_1.
|
| [11] |
H. Sima, M. Wang, L. Liu, Y. Zhang, and J. Sun, “MSO DETR: Metric Space Optimization for Few Shot Object Detection,” CAAI Transactions on Intelligence Technology 9, no. 6 (2024): 1515-1533, https://doi.org/10.1049/cit2.12342.
|
| [12] |
M. Long, S. Cong, H. Shanshan, W. Zoujian, W. Xuhao, and W. Yanxi, “SDDNet: Infrared Small and Dim Target Detection Network,” CAAI Transactions on Intelligence Technology 8, no. 4 (2023): 1226-1236, https://doi.org/10.1049/cit2.12165.
|
| [13] |
H. A. Shah, F. Saeed, M. Diyan, N. A. Almujally, and J. M. Kang, “ECG TransCovNet: A Hybrid Transformer Model for Accurate Arrhythmia Detection Using Electrocardiogram Signals,” CAAI Transactions on Intelligence Technology (2024): cit2.12293, https://doi.org/10.1049/cit2.12293.
|
| [14] |
Y. Yang, Y. Liu, T. Bao, W. Wang, N. Niu, and Y. Yin, “DeepOCL: A Deep Neural Network for Object Constraint Language Generation From Unrestricted Nature Language,” CAAI Transactions on Intelligence Technology 9, no. 1 (2024): 250-263, https://doi.org/10.1049/cit2.12207.
|
| [15] |
G. H. Ahmadi, A. Azadbar, R. Alizadehsani, and J. M. Gorriz, “GAN MD: A Myocarditis Detection Using Multi Channel Convolutional Neural Networks and Generative Adversarial Network based Data Augmentation,” CAAI Transactions on Intelligence Technology 9, no. 4 (2024): 866-878, https://doi.org/10.1049/cit2.12307.
|
| [16] |
M. Kisantal, Z. Wojna, J. Murawski, J. Naruniec, and K. Cho, “Augmentation for Small Object Detection,” 9th International Conference on Advances in Computing and Information Technology (ACITY 2019) (2019): 119-133, https://doi.org/10.5121/csit.2019.91713.
|
| [17] |
C. Chen, Y. Zhang, Q. Lv, et al., RRNet: A Hybrid Detector for Object Detection in Drone Captured Images,” in 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), (2019), https://doi.org/10.1109/iccvw.2019.00018.
|
| [18] |
X. Ying, C. Xiao, W. An, et al., Visible Thermal Tiny Object Detection: A Benchmark Dataset and Baselines,” IEEE Transactions on Pattern Analysis and Machine Intelligence 47, no. 7 (2025): 6088-6096, https://doi.org/10.1109/TPAMI.2025.3544621.
|
| [19] |
Y. Hu, X. Chen, S. Wang, et al., Deformable Cross Attention Transformer for Weakly Aligned RGB-T Pedestrian Detection,” IEEE Transactions on Multimedia 27 (2025): 1-12, https://doi.org/10.1109/TMM.2025.3543056.
|
| [20] |
C. Xu, J. Wang, W. Yang, and L. Yu, “Dot Distance for Tiny Object Detection in Aerial Images,” 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2021): 1192-1201, https://doi.org/10.1109/cvprw53098.2021.00130.
|
| [21] |
J. Wang, C. Xu, W. Yang, and L. Yu, “A Normalized Gaussian Wasserstein Distance for Tiny Object Detection,” arXiv, Version 1 (2018), https://doi.org/10.48550/ARXIV.2110.13389.
|
| [22] |
C. Xu, J. Wang, W. Yang, H. Yu, L. Yu, and G. S. Xia, “RFLA: Gaussian Receptive Field Based Label Assignment for Tiny Object Detection,” Computer Vision - ECCV 2022 (2022): 526-543, https://doi.org/10.1007/978-3-031-20077-9_31.
|
| [23] |
Z. Zhou and Y. Zhu, “KLDet: Detecting Tiny Objects in Remote Sensing Images via Kullback-Leibler Divergence,” IEEE Transactions on Geoscience and Remote Sensing 62 (2024): 1-16, https://doi.org/10.1109/TGRS.2024.3382099.
|
| [24] |
G. Cheng, X. Yuan, X. Yao, et al., Towards Large Scale Small Object Detection: Survey and Benchmarks,” IEEE Transactions on Pattern Analysis and Machine Intelligence 45, no. 11 (2023): 13467-13488, https://doi.org/10.1109/TPAMI.2023.3290594.
|
| [25] |
C. Xu, J. Wang, W. Yang, H. Yu, L. Yu, and G. S. Xia, “Detecting Tiny Objects in Aerial Images: A Normalized Wasserstein Distance and a New Benchmark,” ISPRS Journal of Photogrammetry and Remote Sensing 190 (2022): 79-93, https://doi.org/10.1016/j.isprsjprs.2022.06.002.
|
| [26] |
P. Zhu, L. Wen, D. Du, et al., Detection and Tracking Meet Drones Challenge,” IEEE Transactions on Pattern Analysis and Machine Intelligence 44, no. 11 (2022): 7380-7399, https://doi.org/10.1109/TPAMI.2021.3119563.
|
| [27] |
S. Ren, K. He, R. Girshick, and J. Sun, “Faster R CNN: Towards Real Time Object Detection With Region Proposal Networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence 39, no. 6 (2017): 1137-1149, https://doi.org/10.1109/TPAMI.2016.2577031.
|
| [28] |
Z. Tian, C. Shen, H. Chen, and T. He, “FCOS: Fully Convolutional One Stage Object Detection,” in 2019 IEEE/CVF International Conference on Computer Vision (ICCV), (2019), https://doi.org/10.1109/iccv.2019.00972.
|
| [29] |
S. Shi, Q. Fang, X. Xu, and T. Zhao, “Similarity Distance Based Label Assignment for Tiny Object Detection,” 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2024): 13711-13718, https://doi.org/10.1109/iros58592.2024.10801448.
|
| [30] |
Y. Chen, X. Yuan, J. Wang, et al., YOLO MS: Rethinking Multi Scale Representation Learning for Real Time Object Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence 47, no. 6 (2025): 4240-4252, https://doi.org/10.1109/TPAMI.2025.3538473.
|
| [31] |
Y. Feng, J. Huang, S. Du, et al., Hyper YOLO: When Visual Object Detection Meets Hypergraph Computation,” IEEE Transactions on Pattern Analysis and Machine Intelligence 47, no. 4 (2025): 2388-2401, https://doi.org/10.1109/TPAMI.2024.3524377.
|
| [32] |
Z. Yang, Q. Guan, Z. Yu, et al., MHAF YOLO: Multi Branch Heterogeneous Auxiliary Fusion YOLO for Accurate Object Detection,” arXiv, Version 2 (2025), https://doi.org/10.48550/ARXIV.2502.04656.
|
| [33] |
S. Qiao, L. C. Chen, and A. Yuille, “DetectoRS: Detecting Objects With Recursive Feature Pyramid and Switchable Atrous Convolution,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2021), 10213-10224, https://doi.org/10.1109/cvpr46437.2021.01008.
|
| [34] |
J. Wang, W. Yang, H. Guo, R. Zhang, and G. S. Xia, “Tiny Object Detection in Aerial Images,” 2020 25th International Conference on Pattern Recognition (ICPR) (2021): 3791-3798, https://doi.org/10.1109/icpr48806.2021.9413340.
|
| [35] |
C. Xiao, Q. Yin, X. Ying, et al., DSFNet: Dynamic and Static Fusion Network for Moving Object Detection in Satellite Videos,” IEEE Geoscience and Remote Sensing Letters 19 (2022): 1-5, https://doi.org/10.1109/LGRS.2021.3124222.
|
| [36] |
D. Liu, J. Zhang, Y. Qi, Y. Wu, and Y. Zhang, “Tiny Object Detection in Remote Sensing Images Based on Object Reconstruction and Multiple Receptive Field Adaptive Feature Enhancement,” IEEE Transactions on Geoscience and Remote Sensing 62 (2024): 1-13, https://doi.org/10.1109/TGRS.2024.3381774.
|
| [37] |
D. Liu, J. Zhang, Y. Qi, Y. Wu, and Y. Zhang, “A Tiny Object Detection Method Based on Explicit Semantic Guidance for Remote Sensing Images,” IEEE Geoscience and Remote Sensing Letters 21 (2024): 1-5, https://doi.org/10.1109/LGRS.2024.3374418.
|
| [38] |
G. Guo, P. Chen, X. Yu, Z. Han, Q. Ye, and S. Gao, “Save the Tiny, Save the All: Hierarchical Activation Network for Tiny Object Detection,” IEEE Transactions on Circuits and Systems for Video Technology 34, no. 1 (2024): 221-234, https://doi.org/10.1109/TCSVT.2023.3284161.
|
| [39] |
Z. Ge, S. Liu, Z. Li, O. Yoshie, and J. Sun, “OTA: Optimal Transport Assignment for Object Detection,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2021), 303-312, https://doi.org/10.1109/cvpr46437.2021.00037.
|
| [40] |
X. Li, W. Wang, L. Wu, et al., Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection,” arXiv, Version 1 (2020), https://doi.org/10.48550/ARXIV.2006.04388.
|
| [41] |
H. Zhang, Y. Wang, F. Dayoub, and N. Sunderhauf, “VarifocalNet: An IoU Aware Dense Object Detector,” in 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2021), 8514-8523, https://doi.org/10.1109/cvpr46437.2021.00841.
|
| [42] |
C. Feng, Y. Zhong, Y. Gao, M. R. Scott, and W. Huang, “TOOD: Task Aligned One Stage Object Detection,” in IEEE Computer Society (Los Alamitos, 2021), 3490-3499.
|
| [43] |
K. Yang, H. Zhang, D. Zhou, L. Dong, and J. Ma, “IASA: An IoU Aware Tracker With Adaptive Sample Assignment,” Neural Networks 161 (2023): 267-280, https://doi.org/10.1016/j.neunet.2023.01.038.
|
| [44] |
S. Zhang, C. Chi, Y. Yao, Z. Lei, and S. Z. Li , Bridging the Gap Between Anchor Based and Anchor Free Detection via Adaptive Training Sample Selection, (2020).
|
| [45] |
T. Zhang, X. Zhang, X. Zhu, et al., Multistage Enhancement Network for Tiny Object Detection in Remote Sensing Images,” IEEE Transactions on Geoscience and Remote Sensing 62 (2024): 1-12, https://doi.org/10.1109/TGRS.2024.3363614.
|
| [46] |
Y. Yu, X. Yang, J. Li, and X. Gao, “Object Detection for Aerial Images With Feature Enhancement and Soft Label Assignment,” IEEE Transactions on Geoscience and Remote Sensing 60 (2022): 1-16, https://doi.org/10.1109/TGRS.2022.3177255.
|
| [47] |
F. Zhang, S. Zhou, Y. Wang, X. Wang, and Y. Hou, “Label Assignment Matters: A Gaussian Assignment Strategy for Tiny Object Detection,” IEEE Transactions on Geoscience and Remote Sensing 62 (2024): 1-12, https://doi.org/10.1109/TGRS.2024.3430071.
|
| [48] |
Z. Cai and N. Vasconcelos, “Cascade R CNN: Delving Into High Quality Object Detection,” 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (2018): 6154-6162, https://doi.org/10.1109/cvpr.2018.00644.
|
| [49] |
T. Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollar, “Focal Loss for Dense Object Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence 42, no. 2 (2020): 318-327, https://doi.org/10.1109/tpami.2018.2858826.
|
| [50] |
K. Chen, J. Wang, J. Pang, et al., MMDetection: Open MMLab Detection Toolbox and Benchmark,” arXiv, Version 1 (2019), https://doi.org/10.48550/ARXIV.1906.07155.
|
| [51] |
A. Paszke, S. Gross, F. Massa, et al. , PyTorch: An Imperative Style, High Performance Deep Learning Library, (2019).
|
| [52] |
K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016): 770-778, https://doi.org/10.1109/cvpr.2016.90.
|
| [53] |
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification With Deep Convolutional Neural Networks,” Communications of the ACM 60, no. 6 (2017): 84-90, https://doi.org/10.1145/3065386.
|
| [54] |
C. Jin, A. Zheng, Z. Wu, and C. Tong, “Deep Interactive Query Design and Progressive Search for end to end Detection of Tiny Object in Aerial Images,” International Journal of Machine Learning and Cybernetics 16, no. 9 (2025): 1-17, https://doi.org/10.1007/s13042-025-02582-4.
|
| [55] |
C. Y. Wang, A. Bochkovskiy, and H. Y. M. Liao, “YOLOv7: Trainable Bag of Freebies Sets New State of the Art for Real Time Object Detectors,” 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2023): 7464-7475, https://doi.org/10.1109/cvpr52729.2023.00721.
|
| [56] |
A. Wang, H. Chen, L. Liu, J. Han, Z. Lin, et al., YOLOv10: Real Time End to End Object Detection,” in Advances in Neural Information Processing Systems, eds. A. Globerson, L. Mackey, and D. Belgrave, Vol. 37 (Curran Associates Inc., 2024), 107984-108011, https://doi.org/10.52202/079017-3429.
|
| [57] |
Y. Zhao, W. Lv, S. Xu, et al., DETRs Beat YOLOs on Real time Object Detection,” 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024): 16965-16974, https://doi.org/10.1109/cvpr52733.2024.01605.
|
| [58] |
X. Cai, Q. Lai, Y. Wang, W. Wang, Z. Sun, and Y. Yao , “Poly Kernel Inception Network for,” Remote Sensing Detection (2024): 27706-27716.
|
| [59] |
X. Hou, M. Liu, S. Zhang, P. Wei, and B. Chen, “Salience DETR: Enhancing Detection Transformer With Hierarchical Salience Filtering Refinement,” 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024): 17574-17583, https://doi.org/10.1109/cvpr52733.2024.01664.
|
| [60] |
B. Cao, H. Yao, P. Zhu, and Q. Hu, “Visible and Clear: Finding Tiny Objects in Difference Map,” in Computer Vision - ECCV 2024, eds. A. Leonardis, E. Ricci, S. Roth, O. Russakovsky, T. Sattler, and G. Varol (Springer Nature, 2025), 1-18.
|
| [61] |
K. Liu, Z. Fu, S. Jin, et al., ESOD: Efficient Small Object Detection on High Resolution Images,” IEEE Transactions on Image Processing 34 (2025): 183-195, https://doi.org/10.1109/TIP.2024.3501853.
|
| [62] |
J. Bian, M. Feng, W. Dong, et al., Feature Information Driven Position Gaussian Distribution Estimation for Tiny Object Detection,” 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2025): 30376-30386, https://doi.org/10.1109/cvpr52734.2025.02828.
|
| [63] |
Y. Li, Y. Chen, N. Wang, and Z. Zhang, “Scale Aware Trident Networks for Object Detection,” 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (2019): 6053-6062, https://doi.org/10.1109/iccv.2019.00615.
|
| [64] |
K. Kim and H. S. Lee, “Probabilistic Anchor Assignment With IoU Prediction for Object Detection,” Computer Vision - ECCV 2020 (2020): 355-371, https://doi.org/10.1007/978-3-030-58595-2_22.
|
| [65] |
F. Yu, D. Wang, E. Shelhamer, and T. Darrell, “Deep Layer Aggregation,” 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (2018), https://doi.org/10.1109/cvpr.2018.00255.
|
| [66] |
E. Xie, W. Wang, Z. Yu, A. Anandkumar, J. M. Alvarez, and P. Luo, “SegFormer: Simple and Efficient Design for Semantic Segmentation With Transformers,” arXiv, Version 3 (2021), https://doi.org/10.48550/ARXIV.2105.15203.
|
| [67] |
Z. Liu, Y. Lin, Y. Cao, et al., Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), (2021), 9992-10002, https://doi.org/10.1109/iccv48922.2021.00986.
|
| [68] |
J. Redmon , Darknet: Open Source Neural Networks in C, (2013-2016), https://pjreddie.com/darknet/.
|
| [69] |
W. Liu, D. Anguelov, D. Erhan, et al., SSD: Single Shot MultiBox Detector,” Computer Vision - ECCV 2016 (2016): 21-37, https://doi.org/10.1007/978-3-319-46448-0_2.
|
| [70] |
K. Simonyan and A. Zisserman , Very Deep Convolutional Networks for Large Scale Image Recognition, (2015).
|
| [71] |
Z. Yang, S. Liu, H. Hu, L. Wang, and S. Lin, “RepPoints: Point Set Representation for Object Detection,” 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (2019): 9656-9665, https://doi.org/10.1109/iccv.2019.00975.
|
| [72] |
T. Kong, F. Sun, H. Liu, Y. Jiang, L. Li, and J. Shi, “FoveaBox: Beyount Anchor Based Object Detection,” IEEE Transactions on Image Processing 29 (2020): 7389-7398, https://doi.org/10.1109/TIP.2020.3002345.
|
| [73] |
X. Lu, B. Li, Y. Yue, Q. Li, J. Yan, and R. Grid, “Grid R CNN,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019), 7355-7364, https://doi.org/10.1109/cvpr.2019.00754.
|
| [74] |
I. Radosavovic, R. P. Kosaraju, R. Girshick, K. He, and P. Dollar , Designing Network Design Spaces, (2020).
|
| [75] |
S. H. Gao, M. M. Cheng, K. Zhao, X. Y. Zhang, M. H. Yang, and P. Torr, “Res2Net: A New Multi Scale Backbone Architecture,” IEEE Transactions on Pattern Analysis and Machine Intelligence 43, no. 2 (2021): 652-662, https://doi.org/10.1109/TPAMI.2019.2938758.
|
PDF
(4113KB)
