Deep learning based water leakage detection for shield tunnel lining

Abstract

Shield tunnel lining is prone to water leakage, which may further bring about corrosion and structural damage to the walls, potentially leading to dangerous accidents. To avoid tedious and inefficient manual inspection, many projects use artificial intelligence (AI) to detect cracks and water leakage. A novel method for water leakage inspection in shield tunnel lining that utilizes deep learning is introduced in this paper. Our proposal includes a ConvNeXt-S backbone, deconvolutional-feature pyramid network (D-FPN), spatial attention module (SPAM). and a detection head. It can extract representative features of leaking areas to aid inspection processes. To further improve the model’s robustness, we innovatively use an inversed low-light enhancement method to convert normally illuminated images to low light ones and introduce them into the training samples. Validation experiments are performed, achieving the average precision (AP) score of 56.8%, which outperforms previous work by a margin of 5.7%. Visualization illustrations also support our method’s practical effectiveness.

Graphical abstract

Keywords

water leakage detection / deep learning / deconvolutional-feature pyramid / spatial attention

References

[1] Li C, Wang M, Gao X, Yang B. Research on on-site monitoring and measurement technology of tunnel. IOP Conference Series: Earth and Environmental Science, 2020, 455(1): 012154

[2] Ma D, Fang H, Wang N, Zhang C, Dong J, Hu H. Automatic detection and counting system for pavement cracks based on PCGAN and YOLO-MF. IEEE Transactions on Intelligent Transportation Systems, 2022, 23(11): 22166–22178

[3] Zhou Q, Qu Z, Li Y X, Ju F R. Tunnel crack detection with linear seam based on mixed attention and multiscale feature fusion. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 1–11

[4] Meng S, Kuang S, Ma Z, Wu Y. MtlrNet: An effective deep multitask learning architecture for rail crack detection. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 1–10

[5] Ali R, Chuah J H, Talip M S A, Mokhtar N, Shoaib M A. Structural crack detection using deep convolutional neural networks. Automation in Construction, 2022, 133: 103989

[6] Chen J, Sun S, Zhang L B, Yang B, Wang W. Compressed sensing framework for heart sound acquisition in internet of medical things. IEEE Transactions on Industrial Informatics, 2022, 18(3): 2000–2009

[7] WangWYu XFangBZhaoD YChenY WeiWChenJ. Cross-modality LGE-CMR segmentation using image-to-image translation based data augmentation. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2022

[8] ChenJGuo ZXuXZhangL BTengY ChenYWoniak MWangW. A robust deep learning framework based on spectrograms for heart sound classification. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2023

[9] Xue Y, Cai X, Shadabfar M, Shao H, Zhang S. Deep learning based automatic recognition of water leakage area in shield tunnel lining. Tunnelling and Underground Space Technology, 2020, 104: 103524

[10] DingHLiu SCaiSXiaY. Big data analysis of structural defects and traffic accidents in existing highway tunnels. In: Proceedings of the 3rd International Conference on Information Technology in Geo-Engineering. Cham: Springer Cham, 2019, 189–195

[11] LiCChenW DengRHan Q. Overview of tunnel detection technology. In: Proceedings of International Conference on Maintenance Engineering. Cham: Springer Cham, 2021, 81–90

[12] Kawata H, Matsumoto Y, Hachiga A, Okuaki S. Development of expert system (TIMES-1) for tunnel inspection and diagnosis. Railway Technical Research Institute, Quarterly Reports, 1989, 30(3): 143–148

[13] Yu S N, Jang J H, Han C S. Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel. Automation in Construction, 2007, 16(3): 255–261

[14] HuCZhuH LiX. Detection of tunnel water leakage based on image processing. Information Technology in Geo-Engineering, 2010, 254–262

[15] Yokoyama S, Matsumoto T. Development of an automatic detector of cracks in concrete using machine learning. Procedia Engineering, 2017, 171: 1250–1255

[16] Protopapadakis E, Voulodimos A, Doulamis A, Doulamis N, Stathaki T. Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing. Applied Intelligence, 2019, 49(7): 2793–2806

[17] Lewis J, Cha Y J, Kim J. Dual encoder–decoder-based deep polyp segmentation network for colonoscopy images. Scientific Reports, 2023, 13(1): 1183

[18] GirshickR. Fast R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision. New York: IEEE, 2015, 1440–1448

[19] Ren S, He K, Girshick R, Sun J. Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137–1149

[20] CaiZVasconcelos N. Cascade R-CNN: Delving into high quality object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2018, 6154–6162

[21] QiaoSChen L CYuilleA. Detectors: Detecting objects with recursive feature pyramid and switchable atrous convolution. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2021, 10213–10224

[22] LiuWAnguelovD ErhanDSzegedy CReedSFuC YBergA C. SSD: Single shot multibox detector. In: Proceedings of Computer Vision–ECCV 2016: 14th European Conference. Cham: Springer Cham, 2016, 21–37

[23] RedmonJDivvala SGirshickRFarhadiA. You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2016, 779–788

[24] RedmonJFarhadi A. Yolov3: An incremental improvement. 2018, arXiv: 1804.02767

[25] GeZLiuS WangFLi ZSunJ. Yolox: Exceeding Yolo series in 2021. 2021, arXiv: 2107.08430

[26] WangC YBochkovskiy ALiaoH Y M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. 2022, arXiv: 2207.02696

[27] LinT YGoyal PGirshickRHeKDollár P. Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision. Proceedings of the IEEE International Conference on Computer Vision, 2017, 2980–2988

[28] Cha Y J, Choi W, Suh G, Mahmoudkhani S, Büyüköztürk O. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(9): 731–747

[29] Xia B, Cao J, Zhang X, Peng Y. Automatic concrete sleeper crack detection using a one-stage detector. International Journal of Intelligent Robotics and Applications, 2020, 4(3): 319–327

[30] Xue Y, Shi P, Jia F, Huang H. 3D reconstruction and automatic leakage defect quantification of metro tunnel based on SfM-deep learning method. Underground Space, 2022, 7(3): 311–323

[31] Guo J, Markoni H, Lee J D. BARNet: Boundary aware refinement network for crack detection. IEEE Transactions on Intelligent Transportation Systems, 2022, 23(7): 7343–7358

[32] LiuZMaoH WuC YFeichtenhofer CDarrellTXieS. A convnet for the 2020s. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2022, 11976–11986

[33] LinT YDollár PGirshickRHeKHariharan BBelongieS. Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2017, 2117–2125

[34] DaiJQiH XiongYLi YZhangGHuHWeiY. Deformable convolutional networks. In: Proceedings of the IEEE International Conference on Computer Vision. New York: IEEE, 2017, 764–773

[35] GuoCLiC GuoJLoyC C HouJKwongS CongR. Zero-reference deep curve estimation for low-light image enhancement. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2020, 1780–1789

[36] LoshchilovIHutter F. Decoupled weight decay regularization. 2017, arXiv: 1711.05101

[37] LinT YMaire MBelongieSHaysJPeronaP RamananDDollár PZitnickC L. Microsoft COCO: Common objects in context. In: Proceedings of the European Conference on Computer Vision. Cham: Springer Cham, 2014, 740–755

[38] ZophBCubuk E DGhiasiGLinT YShlensJ LeQ V. Learning data augmentation strategies for object detection. In: Proceedings of Computer Vision–ECCV 2020: 16th European Conference. Cham: Springer Cham, 2020, 566–583

[39] LiXWangW HuXLiJ TangJYang J. Generalized focal loss v2: Learning reliable localization quality estimation for dense object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2021, 11632–11641

[40] Liang T, Chu X, Liu Y, Wang Y, Tang Z, Chu W, Chen J, Ling H. CBNet: A composite backbone network architecture for object detection. IEEE Transactions on Image Processing, 2022, 31: 6893–6906

[41] DoulamisNDoulamis A. Semi-supervised deep learning for object tracking and classification. In: Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP). New York: IEEE, 2014, 848–852

[42] BaurCAlbarqouni SNavabN. Semi-supervised deep learning for fully convolutional networks. In: Proceedings of the Medical Image Computing and Computer Assisted Intervention MICCAI 2017: 20th International Conference. Cham: Springer Cham, 2017, 311–319

[43] ChenYZhu XGongS. Semi-supervised deep learning with memory. In: Proceedings of the European Conference on Computer Vision (ECCV). Cham: Springer Cham, 2018, 268–283

[44] Choi W, Cha Y J. SDDNet: Real-time crack segmentation. IEEE Transactions on Industrial Electronics, 2020, 67(9): 8016–8025

[45] Kang D H, Cha Y J. Efficient attention-based deep encoder and decoder for automatic crack segmentation. Structural Health Monitoring, 2022, 21(5): 2190–2205

[46] BochkovskiyAWangC YLiaoH Y M. Yolov4: Optimal speed and accuracy of object detection. 2020, arXiv: 2004.10934

RIGHTS & PERMISSIONS

Higher Education Press