Tunnel SAM adapter: Adapting segment anything model for tunnel water leakage inspection

Abstract

Water leakage inspection in the tunnels is a critical engineering job that has attracted increasing concerns. Leakage area detection via manual inspection techniques is time-consuming and might produce unreliable findings, so that automated techniques should be created to increase reliability and efficiency. Pre-trained foundational segmentation models for large datasets have attracted great interests recently. This paper pro-poses a novel SAM-based network for accurate automated water leakage inspection. The contributions of this paper include the efficient adaptation of the SAM (Segment Anything Model) for shield tunnel water leakage segmentation and the demonstration of the application effect by data experiments. Tunnel SAM Adapter has satisfactory performance, achieving 76.2 % mIoU and 77.5 % Dice. Experimental results demonstrate that our approach has advantages over peer studies and guarantees the integrity and safety of these vital assets while streamlining tunnel maintenance.

Keywords

Water leakage segmentation / Segment anything model / SAM-Adapter / Smart engineering

References

[[1]] C. Li, W. Chen, R. Deng, Q. Han, Overview of tunnel detection technology, in: International Conference on Maintenance Engineering, Springer, 2020, pp. 81-90.

[[2]] B.-G. He, L. Wang, X.-T. Feng, R.-L. Zhen, Failure modes of jointed granite subjected to weak dynamic disturbance under true-triaxial compression, Rock Mech. Rock Eng. (2023) 1-19.

[[3]] B.-G. He, Q. Tong, X.-T. Feng, Q. Jiang, H. Li, Y. Li, Z. Li, Brittle failure modes of underground powerhouses: an insight based on true triaxial compression tests, Bull. Eng. Geol. Environ. 82 (4) (2023) 153.

[[4]] C. Li, M. Wang, X. Gao, B. Yang, Research on on-site monitoring and measurement technology of tunnel, in: IOP Conference Series: Earth and Environmental Science, 455, IOP Publishing, 2020 012154.

[[5]] B.-G. He, B. Lin, H.-P. Li, S.-Q. Zhu, Suggested method of utilizing soil arching for optimizing the design of strutted excavations, Tunn. Undergr. Space Technol. 143 (2024) 105450.

[[6]] W. Wang, X. Yu, B. Fang, Y. Zhao, Y. Chen, W. Wei, J. Chen, Cross-modality LGE-CMR segmentation using image-to-image translation based data augmentation, IEEE ACM Trans. Comput. Biol. Bioinf 20 (4) (2023) 2367-2375.

[[7]] J. Chen, Z. Guo, X. Xu, L.-b. Zhang, Y. Teng, Y. Chen, M. Woźniak, W. Wang, A robust deep learning framework based on spectrograms for heart sound classification, IEEE ACM Trans. Comput. Biol. Bioinf.

[[8]] J. Chen, S. Sun, L.-b. Zhang, B. Yang, W. Wang, Compressed sensing framework for heart sound acquisition in internet of medical things, IEEE Trans. Ind. Inf. 18 (3)(2022) 2000-2009.

[[9]] J. Chen, W. Wang, B. Fang, Y. Liu, K. Yu, V.C.M. Leung, X. Hu, Digital twin empowered wireless healthcare monitoring for smart home, IEEE J. Sel. Area. Commun. 41 (11) (2023) 3662-3676.

[[10]] H.-w. Huang, Q.-t. Li, D.-m. Zhang, Deep learning based image recognition for crack and leakage defects of metro shield tunnel, Tunn. Undergr. Space Technol. 77(2018) 166-176.

[[11]] J. Long, E. Shelhamer, T. Darrell, Fully convolutional networks for semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 3431-3440.

[[12]] L. Xiong, D. Zhang, Y. Zhang, Water leakage image recognition of shield tunnel via learning deep feature representation, J. Vis. Commun. Image Represent. 71 (2020) 102708.

[[13]] S.J. Feng, Y. Feng, X.L. Zhang, Y.H. Chen, Deep learning with visual explanations for leakage defect segmentation of metro shield tunnel, Tunn. Undergr. Space Technol. 136 (2023) 105107.

[[14]] O. Ronneberger, P. Fischer, T. Brox, U-net, Convolutional networks for biomedical image segmentation, in: International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer, 2015, pp. 234-241.

[[15]] Z. Zhou, M.M. Rahman Siddiquee, N. Tajbakhsh, J. Liang, Unetþþ: a nested u-net architecture for medical image segmentation, in:Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings, 4, Springer, 2018, pp. 3-11.

[[16]] A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y. Lo, et al., Segment anything, arXiv preprint arXiv: 2304.02643.

[[17]] T. Chen, L. Zhu, C. Ding, R. Cao, S. Zhang, Y. Wang, Z. Li, L. Sun, P. Mao, Y. Zang, Sam fails to segment anything?-sam-adapter: adapting sam in underperformed scenes: camouflage, shadow, and more, arXiv preprint arXiv:2304.09148.

[[18]] W. Ji, J. Li, Q. Bi, W. Li, L. Cheng, Segment anything is not always perfect: an investigation of sam on different real-world applications, arXiv preprint arXiv: 2304.05750.

[[19]] J. Wu, R. Fu, H. Fang, Y. Liu, Z. Wang, Y. Xu, Y. Jin, T. Arbel, medical sam adapter: adapting segment anything model for medical image segmentation, arXiv preprint arXiv:2304.12620.

[[20]] S. Liu, J. Chen, B.-G. He, T. Chen, G. Jeon, W. Wang, Adapting segment anything model for shield tunnel water leakage segmentation, in: Proceedings of the 2023 Workshop on Advanced Multimedia Computing for Smart Manufacturing and Engineering, 2023, pp. 13-18.

[[21]] X. Zhu, Y. Zheng, L. Qi, N. Wang, S. Ni, Research on recognition algorithm of tunnel leakage based on image processing, Tech. rep. (2020). SAE Technical Paper.

[[22]] Z. Zhou, J. Zhang, C. Gong, Automatic detection method of tunnel lining multi-defects via an enhanced you only look once network, Comput. Aided Civ. Infrastruct. Eng. 37 (6) (2022) 762-780.

[[23]] X. Xu, C. Li, X. Lan, X. Fan, X. Lv, X. Ye, T. Wu, A lightweight and robust framework for circulating genetically abnormal cells (cacs) identification using 4-color fluorescence in situ hybridization (fish) image and deep refined learning, J. Digit. Imag. (2023) 1-14.

[[24]] D. Li, Q. Xie, X. Gong, Z. Yu, J. Xu, Y. Sun, J. Wang, Automatic defect detection of metro tunnel surfaces using a vision-based inspection system, Adv. Eng. Inf. 47 (2021) 101206.

[[25]] R. Girshick, Fast r-cnn, in: Proceedings of the IEEE international conference on computer vision, 2015, pp. 1440-1448.

[[26]] L. Han, J. Chen, H. Li, G. Liu, B. Leng, A. Ahmed, Z. Zhang, Multispectral water leakage detection based on a one-stage anchor-free modality fusion network for metro tunnels, Autom. ConStruct. 140 (2022) 104345.

[[27]] T.-Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, S. Belongie, Feature pyramid networks for object detection, in:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 2117-2125.

[[28]] A. Bochkovskiy, C.-Y. Wang, H.-Y. M. Liao, Yolov4: optimal speed and accuracy of object detection, arXiv preprint arXiv:2004.10934.

[[29]] M. Tan, Q. Le, Efficientnet, Rethinking model scaling for convolutional neural networks, in:International Conference on Machine Learning, PMLR, 2019,pp.6105-6114.

[[30]] X. Xu, C. Li, X. Fan, X. Lan, X. Lu, X. Ye, T. Wu, Attention Mask R-CNN with edge refinement algorithm for identifying circulating genetically abnormal cells, Cytometry 103 (3) (2023) 227-239.

[[31]] Y. Xu, D. Li, Q. Xie, Q. Wu, J. Wang, Automatic defect detection and segmentation of tunnel surface using modified Mask R-CNN, Measurement 178 (2021) 109316.

[[32]] Y. Wu, M. Hu, G. Xu, X. Zhou, Z. Li, Detecting leakage water of shield tunnel segments based on mask r-cnn, in: 2019 IEEE International Conference on Architecture, Construction, Environment and Hydraulics (ICACEH), IEEE, 2019, pp. 25-28.

[[33]] K. He, G. Gkioxari, P. Dollár, R. Girshick, Mask r-cnn, in:Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2961-2969.

[[34]] S. Liu, L. Qi, H. Qin, J. Shi, J. Jia, Path aggregation network for instance segmentation, in:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 8759-8768.

[[35]] Y. Xue, P. Shi, F. Jia, H. Huang, 3D reconstruction and automatic leakage defect quantification of metro tunnel based on sfm-deep learning method, Undergr. Space 7 (3) (2022) 311-323.

[[36]] X. Cheng, X. Hu, K. Tan, L. Wang, L. Yang, Automatic detection of shield tunnel leakages based on terrestrial mobile lidar intensity images using deep learning, IEEE Access 9 (2021) 55300-55310.

[[37]] K. Simonyan, A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv preprint arXiv:1409.1556.

[[38]] L. Tan, X. Hu, T. Tang, D. Yuan, A lightweight metro tunnel water leakage identification algorithm via machine vision, Eng. Fail. Anal. 150 (2023) 107327.

[[39]] G.-P. Ji, D.-P. Fan, P. Xu, M.-M. Cheng, B. Zhou, L. Van Gool, SAM struggles in concealed scenes-empirical study on “segment anything”, arXiv preprint arXiv: 2304.06022.

[[40]] L. Tang, H. Xiao, B. Li, Can sam segment anything? when sam meets camouflaged object detection, arXiv preprint arXiv:2304.04709.

[[41]] J. Ma, B. Wang, Segment anything in medical images, arXiv preprint arXiv: 2304.12306.

[[42]] Z. Chen, Y. Duan, W. Wang, J. He, T. Lu, J. Dai, Y. Qiao, Vision transformer adapter for dense predictions, arXiv preprint arXiv:2205.08534.

[[43]] A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al., An image is worth 16x16 words: transformers for image recognition at scale, arXiv preprint arXiv:2010.11929.

[[44]] L.-C. Chen, G. Papandreou, F. Schroff, H. Adam, Rethinking atrous convolution for semantic image segmentation, arXiv preprint arXiv:1706.05587.

[[45]] D. Hendrycks, K. Gimpel, Gaussian Error Linear Units (Gelus), arXiv preprint arXiv: 1606.08415.

[[46]] Y. Xue, X. Cai, M. Shadabfar, H. Shao, S. Zhang, Deep learning-based automatic recognition of water leakage area in shield tunnel lining, Tunn. Undergr. Space Technol. 104 (2020) 103524.

[[47]] K. He, X. Chen, S. Xie, Y. Li, P. Dollár, R. Girshick, Masked autoencoders are scalable vision learners, in:Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 16000-16009.

[[48]] X. Zhao, W. Ding, Y. An, Y. Du, T. Yu, M. Li, M. Tang, J. Wang, Fast segment anything, arXiv preprint arXiv:2306.12156.

[[49]] X. Qin, Z. Zhang, C. Huang, M. Dehghan, O.R. Zaiane, M. Jagersand, U2-net: going deeper with nested u-structure for salient object detection, Pattern Recogn. 106 (2020) 107404.