A Lightweight Hybrid Network for Medical Image Segmentation With Adaptive Feature Selection

Zhouwei Lin , Yudong Xia , Pingping Wu , Han Lin , Qingsong Xu , Zheng Fan , Juan Tu , Jun Wu

CAAI Transactions on Intelligence Technology ›› 2026, Vol. 11 ›› Issue (4) : 1047 -1061.

PDF (2362KB)
CAAI Transactions on Intelligence Technology ›› 2026, Vol. 11 ›› Issue (4) :1047 -1061. DOI: 10.1049/cit2.70168
ORIGINAL RESEARCH
research-article
A Lightweight Hybrid Network for Medical Image Segmentation With Adaptive Feature Selection
Author information +
History +
PDF (2362KB)

Abstract

Accurate medical image segmentation with low model complexity remains difficult because lesions are often small in scale and boundary cues are easily corrupted by noise. Although recent segmentation methods have achieved strong performance, many of them rely on increasingly complex architectures with high computational costs, limiting their applicability in resource-constrained settings. To alleviate this issue, we propose PLNet, a lightweight hybrid segmentation framework for medical image analysis. The network improves representation learning by integrating fine-grained local-structure perception with long-range contextual modelling, thereby enhancing the representation of complex medical images. In addition, a feature selection mechanism is employed to emphasise informative feature responses and suppress redundant activations while preserving discriminative representations. Extensive experiments on multiple datasets demonstrate that PLNet achieves competitive IoU and Dice scores with relatively low model complexity. Overall, these results highlight the potential of PLNet as an effective lightweight framework that balances segmentation performance and computational complexity.

Keywords

biomedical engineering / deep learning / machine learning / medical imaging / segmentation / vision recognition

Cite this article

Download citation ▾
Zhouwei Lin, Yudong Xia, Pingping Wu, Han Lin, Qingsong Xu, Zheng Fan, Juan Tu, Jun Wu. A Lightweight Hybrid Network for Medical Image Segmentation With Adaptive Feature Selection. CAAI Transactions on Intelligence Technology, 2026, 11 (4) : 1047-1061 DOI:10.1049/cit2.70168

登录浏览全文

4963

注册一个新账户 忘记密码

References

[1]

Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, “ Unet++: A Nested U-Net Architecture for Medical Image Segmentation,” in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, (Springer, 2018), 3-11, https://doi.org/10.1007/978-3-030-00889-5_1.

[2]

A. Hatamizadeh, Y. Tang, V. Nath, et al., “ UNETR: Transformers for 3D Medical Image Segmentation,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), (IEEE, 2022), 574-584, https://doi.org/10.1109/WACV51458.2022.00181.

[3]

A. Kurz, K. Hauser, H. A. Mehrtens, et al., “ Uncertainty Estimation in Medical Image Classification: Systematic Review,” JMIR Medical Informatics 10, no. 8 (2022): e36427, https://doi.org/10.2196/36427.

[4]

C. Yin, H. Su, Y. Xie, et al., “ Estimating in Vivo Power Deposition Density in Thermotherapies Based on Ultrasound Thermal Strain Imaging,” Journal of the Acoustical Society of America 157, no. 1 (2025): 606-617, https://doi.org/10.1121/10.0034880.

[5]

O. Ronneberger, P. Fischer, and T. Brox, “ U-Net: Convolutional Networks for Biomedical Image Segmentation,” in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015, Lecture Notes in Computer Science, Vol. 9351 (Springer, 2015), 234-241, https://doi.org/10.1007/978-3-319-24574-4_28.

[6]

F. Isensee, P. F. Jaeger, S. A. A. Kohl, J. Petersen, K. H. Maier-Hein, “ nnU-Net: A Self-Configuring Method for Deep Learning-Based Biomedical Image Segmentation,” Nature Methods 18, no. 2 (2021): 203-211, https://doi.org/10.1038/s41592-020-01008-z.

[7]

F. Milletari, N. Navab, and S.-A. Ahmadi, “ V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation,” in 2016 Fourth International Conference on 3D Vision (3DV) (IEEE, 2016), 565-571, https://doi.org/10.1109/3DV.2016.79.

[8]

Z. Gu, J. Cheng, H. Fu, et al., “ Ce-Net: Context Encoder Network for 2d Medical Image Segmentation,” IEEE Transactions on Medical Imaging 38, no. 10 (2019): 2289-2297, https://doi.org/10.1109/tmi.2019.2903562.

[9]

A. Dosovitskiy, L. Beyer, A. Kolesnikov, et al., “ An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale,” in Proceedings of the 9th International Conference on Learning Representations (ICLR) (OpenReview.net, 2021).

[10]

H. Cao, Y. Wang, J. Chen, et al., “ Swin-Unet: Unet-Like Pure Transformer for Medical Image Segmentation,” in Computer Vision - ECCV 2022 Workshops (Springer Nature Switzerland, 2022), 205-218.

[11]

X. Liu, P. Gao, T. Yu, F. Wang, and R.-Y. Yuan, “ Cswin-Unet: Transformer U-Net With Cross-Shaped Windows for Medical Image Segmentation,” Information Fusion 113 (2025): 102634, https://doi.org/10.1016/j.inffus.2024.102634.

[12]

J. Chen, J. Mei, X. Li, et al., “ Transunet: Rethinking the U-Net Architecture Design for Medical Image Segmentation Through the Lens of Transformers,” Medical Image Analysis 97 (2024): 103280, https://doi.org/10.1016/j.media.2024.103280.

[13]

G. Xu, X. Wu, X. Zhang, and X. He, “ Levit-Unet: Make Faster Encoders With Transformer for Medical Image Segmentation,” in Pattern Recognition and Computer Vision-PRCV 2023, 14432 (Springer Nature Singapore, 2023), 42-53, https://doi.org/10.1007/978-981-99-8543-2_4.

[14]

A. Gu, K. Goel, and C. Ré, “ Efficiently Modeling Long Sequences With Structured State Spaces,” in International Conference on Learning Representations, (2022).

[15]

Y. Liu, Y. Tian, Y. Zhao, et al., “ VMamba: Visual State Space Model,” in Advances in Neural Information Processing Systems 37 (NeurIPS 2024) (Neural Information Processing Systems Foundation, Inc., 2024), 103031-103063, https://doi.org/10.52202/079017-3273.

[16]

J. Ma, F. Li, and B. Wang, “ U-Mamba: Enhancing Long-Range Dependency for Biomedical Image Segmentation,” arXiv preprint arXiv:2401.04722, 2024, https://doi.org/10.48550/arXiv.2401.04722.

[17]

Z. Xing, T. Ye, Y. Yang, G. Liu, and L. Zhu, “ Segmamba: Long-Range Sequential Modeling Mamba for 3d Medical Image Segmentation,” in Medical Image Computing and Computer Assisted Intervention-MICCAI 2024, 15008 (Springer Nature Switzerland, 2024), 578-588, https://doi.org/10.1007/978-3-031-72111-3_54.

[18]

J. Liu, H. Yang, H.-Y. Zhou, et al., “ Swin-UMamba: Mamba-Based Unet With Imagenet-Based Pretraining,” in Medical Image Computing and Computer Assisted Intervention-MICCAI 2024, 15009 (Springer Nature Switzerland, 2024), 615-625, https://doi.org/10.1007/978-3-031-72114-4_59.

[19]

O. Siméoni, H. V. Vo, M. Seitzer, et al., “ DINOv3,” Transactions on Machine Learning Research (2026).

[20]

J. Ma, Y. He, F. Li, L. Han, C. You, and B. Wang, “ Segment Anything in Medical Images,” Nature Communications 15, no. 1 (2024): 654, https://doi.org/10.1038/s41467-024-44824-z.

[21]

T. Chen, L. Zhu, C. Ding, et al., “ Sam-Adapter: Adapting Segment Anything in Underperformed Scenes,” in Proceedings of the 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) (IEEE, 2023), 3359-3367, https://doi.org/10.1109/ICCVW60793.2023.00361.

[22]

T. Chen, A. Lu, L. Zhu, et al., “ SAM2-Adapter: Evaluating & Adapting Segment Anything 2 in Downstream Tasks: Camouflage, Shadow, Medical Image Segmentation, and More,” in ICLR 2025 Workshop on Foundation Models in the Wild (OpenReview.net, 2025).

[23]

G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, “ Densely Connected Convolutional Networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2017), 2261-2269, https://doi.org/10.1109/CVPR.2017.243.

[24]

H. Huang, L. Lin, R. Tong, et al., “ UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation,” in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2020), 1055-1059, https://doi.org/10.1109/ICASSP40776.2020.9053405.

[25]

Y. Peng, D. Z. Chen, and M. Sonka, “ U-Net V2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation,” in 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI) (IEEE, 2025), 1-5, https://doi.org/10.1109/ISBI60581.2025.10980742.

[26]

Z. Luo, X. Zhu, L. Zhang, and B. Sun, “ Rethinking U-Net: Task-Adaptive Mixture of Skip Connections for Enhanced Medical Image Segmentation,” in Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39, no. 6 (AAAI Press, 2025), 5874-5882, https://doi.org/10.1609/aaai.v39i6.32627.

[27]

Z. Tang, Y. Fu, M. Li, H. Liang, Y. Tang, and J. Wen, “ MPR-Net: Medicinal Plant Recognition Network With Dual-Branch Attention Fusion,” Pattern Recognition 171 (2026): 112185, https://doi.org/10.1016/j.patcog.2025.112185.

[28]

C. Li, X. Liu, W. Li, et al., “ U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation,” in Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39, no. 5 (AAAI Press, 2025), 4652-4660, https://doi.org/10.1609/aaai.v39i5.32491.

[29]

H. Wang, Z. Zhao, Q. Liu, and S. Wang, “ ResU-KAN: A Medical Image Segmentation Model Integrating Residual Convolutional Attention and Atrous Spatial Pyramid Pooling,” Applied Intelligence 55, no. 7 (2025): 568, https://doi.org/10.1007/s10489-025-06467-5.

[30]

H. Touvron, M. Cord, M. Douze, F. Massa, A. Sablayrolles, and H. Jégou, “ Training Data-Efficient Image Transformers & Distillation Through Attention,” in Proceedings of the 38th International Conference on Machine Learning (ICML), Proceedings of Machine Learning Research, Vol. 139 (PMLR, 2021), 10347-10357.

[31]

S. Wang, G. Li, M. Gao, et al., “ GH-UNet: Group-Wise Hybrid Convolution-vit for Robust Medical Image Segmentation,” npj Digital Medicine 8, no. 1 (2025): 426, https://doi.org/10.1038/s41746-025-01829-2.

[32]

O. N. Manzari, J. M. Kaleybar, H. Saadat, and S. Maleki, “ BEFUnet: A Hybrid CNN-Transformer Architecture for Precise Medical Image Segmentation,” arXiv preprint arXiv:2402.08793, 2024, https://doi.org/10.48550/arXiv.2402.08793.

[33]

J. Wen, J. Long, X. Lu, C. Liu, X. Fang, and Y. Xu, “ Partial Multiview Incomplete Multilabel Learning via Uncertainty-Driven Reliable Dynamic Fusion,” IEEE Transactions on Pattern Analysis and Machine Intelligence (2025).

[34]

A. Gu and T. Dao, “ Mamba: Linear-Time Sequence Modeling With Selective State Spaces,” in First Conference on Language Modeling (COLM) (OpenReview.net, 2024).

[35]

W. Chen, Z. Jiang, Z. Wang, K. Cui, and X. Qian, “ Collaborative Global-Local Networks for Memory-Efficient Segmentation of Ultra-High Resolution Images,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2019), 8924-8933, https://doi.org/10.1109/CVPR.2019.00913.

[36]

H. K. Cheng, J. Chung, Y.-W. Tai, and C.-K. Tang, “ CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinement,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2020), 8887-8896, https://doi.org/10.1109/CVPR42600.2020.00891.

[37]

B. Chen, X. Zou, Y. Zhang, et al., “ Leformer: A Hybrid CNN-Transformer Architecture for Accurate Lake Extraction From Remote Sensing Imagery,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, (2024), 1-5.

[38]

H. Cheng, X. Liu, J. Zhang, et al., “ GLMKD: Joint Global and Local Mutual Knowledge Distillation for Weakly Supervised Lesion Segmentation in Histopathology Images,” Expert Systems With Applications 279 (2025): 127425, https://doi.org/10.1016/j.eswa.2025.127425.

[39]

W. Zhao, L. Zhang, Y. Zhao, X. Bai, Z. Xu, and Y. Li, “ GLAD-Net: Global-Local Adaptive Fusion and Cross-Stage Distillation for Cross-Level Multi-Scale Medical Image Segmentation,” in Proceedings of the 21st International Conference on Intelligent Computing (ICIC 2025) (2025), 2083-2097, Poster Volume II.

[40]

F. Chollet, “ Xception: Deep Learning With Depthwise Separable Convolutions,” in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2017), 1800-1807, https://doi.org/10.1109/CVPR.2017.195.

[41]

S. Mehta, M. Rastegari, A. Caspi, L. Shapiro, and H. Hajishirzi, “ ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation,” in Computer Vision-ECCV 2018, Lecture Notes in Computer Science, Vol. 11214 (Springer, 2018), 561-580, https://doi.org/10.1007/978-3-030-01249-6_34.

[42]

S. Woo, J. Park, J.-Y. Lee, and I. S. Kweon, “ CBAM: Convolutional Block Attention Module,” in Computer Vision-ECCV 2018, Lecture Notes in Computer Science, Vol. 11211 (Springer, 2018), 3-19, https://doi.org/10.1007/978-3-030-01234-2_1.

[43]

W. Wang, E. Xie, X. Li, et al., “ Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction Without Convolutions,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (IEEE, 2021), 568-578, https://doi.org/10.1109/ICCV48922.2021.00061.

[44]

E. Xie, W. Wang, Z. Yu, A. Anandkumar, J. M. Alvarez, and P. Luo, “ SegFormer: Simple and Efficient Design for Semantic Segmentation With Transformers,” Advances in Neural Information Processing Systems 34 (Neural Information Processing Systems Foundation, Inc., 2021), 12077-12090.

[45]

W. Yu, M. Luo, P. Zhou, et al., “ MetaFormer Is Actually What You Need for Vision,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2022), 10819-10829, https://doi.org/10.1109/CVPR52688.2022.01055.

[46]

Z. Liu, Y. Lin, Y. Cao, et al., “ Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (IEEE, 2021), 10012-10022, https://doi.org/10.1109/ICCV48922.2021.00986.

[47]

N. C. F. Codella, D. Gutman, M. E. Celebi, et al., “ Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC),” in 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) (IEEE, 2018), 168-172, https://doi.org/10.1109/ISBI.2018.8363547.

[48]

N. C. F. Codella, V. Rotemberg, P. Tschandl, et al., “ Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC),” (2019), https://doi.org/10.48550/arXiv.1902.03368.

[49]

P. Tschandl, C. Rosendahl, and H. Kittler, “ The HAM10000 Dataset: A Large Collection of Multi-Source Dermatoscopic Images of Common Pigmented Skin Lesions,” Scientific Data 5, no. 1 (2018): 180161, https://doi.org/10.1038/sdata.2018.161.

[50]

W. Al-Dhabyani, M. Gomaa, H. Khaled, and A. Fahmy, “ Dataset of Breast Ultrasound Images,” Data in Brief 28 (2020): 104863, https://doi.org/10.1016/j.dib.2019.104863.

[51]

J. Bernal, F. J. Sánchez, G. Fernández-Esparrach, D. Gil, C. Rodríguez, and F. Vilariño, “ WM-DOVA Maps for Accurate Polyp Highlighting in Colonoscopy: Validation vs. Saliency Maps From Physicians,” Computerized Medical Imaging and Graphics 43 (2015): 99-111, https://doi.org/10.1016/j.compmedimag.2015.02.007.

[52]

D. Jha, P. H. Smedsrud, M. A. Riegler, et al., “ Kvasir-SEG: A Segmented Polyp Dataset,” in MultiMedia Modeling: 26th International Conference, MMM 2020, Daejeon, South Korea, January 5-8, 2020, Proceedings, Part II 26 (Springer, 2020), 451-462.

[53]

O. Oktay, J. Schlemper, L. Le Folgoc, et al., “ Attention U-Net: Learning Where to Look for the Pancreas,” arXiv preprint arXiv:1804.03999, 2018, https://doi.org/10.48550/arXiv.1804.03999.

[54]

F. Tang, L. Wang, C. Ning, M. Xian, and J. Ding, “ CMU-Net: A Strong ConvMixer-Based Medical Ultrasound Image Segmentation Network,” in 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI) (IEEE, 2023), 1-5, https://doi.org/10.1109/ISBI53787.2023.10230609.

[55]

F. Tang, J. Ding, Q. Quan, L. Wang, C. Ning, and S. K. Zhou, “ CMUNeXt: An Efficient Medical Image Segmentation Network Based on Large Kernel and Skip Fusion,” in 2024 IEEE International Symposium on Biomedical Imaging (ISBI) (IEEE, 2024), 1-5, https://doi.org/10.1109/ISBI56570.2024.10635609.

[56]

A. He, K. Wang, T. Li, C. Du, S. Xia, and H. Fu, “ H2former: An Efficient Hierarchical Hybrid Transformer for Medical Image Segmentation,” IEEE Transactions on Medical Imaging 42, no. 9 (2023): 2763-2775, https://doi.org/10.1109/tmi.2023.3264513.

PDF (2362KB)

0

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉