Automated Pipe Defect Identification in Underwater Robot Imagery with Deep Learning

Abstract

Underwater pipeline inspection plays a vital role in the proactive maintenance and management of critical marine infrastructure and subaquatic systems. However, the inspection of underwater pipelines presents a challenge due to factors such as light scattering, absorption, restricted visibility, and ambient noise. The advancement of deep learning has introduced powerful techniques for processing large amounts of unstructured and imperfect data collected from underwater environments. This study evaluated the efficacy of the You Only Look Once (YOLO) algorithm, a real-time object detection and localization model based on convolutional neural networks, in identifying and classifying various types of pipeline defects in underwater settings. YOLOv8, the latest evolution in the YOLO family, integrates advanced capabilities, such as anchor-free detection, a cross-stage partial network backbone for efficient feature extraction, and a feature pyramid network+ path aggregation network neck for robust multi-scale object detection, which make it particularly well-suited for complex underwater environments. Due to the lack of suitable open-access datasets for underwater pipeline defects, a custom dataset was captured using a remotely operated vehicle in a controlled environment. This application has the following assets available for use. Extensive experimentation demonstrated that YOLOv8 X-Large consistently outperformed other models in terms of pipe defect detection and classification and achieved a strong balance between precision and recall in identifying pipeline cracks, rust, corners, defective welds, flanges, tapes, and holes. This research establishes the baseline performance of YOLOv8 for underwater defect detection and showcases its potential to enhance the reliability and efficiency of pipeline inspection tasks in challenging underwater environments.

Keywords

YOLO8 / Underwater robot / Object detection / Underwater pipelines / Remotely operated vehicle / Deep learning

References

[1] Aboah A, Wang B, Bagci U, Adu-Gyamfi Y. Real-time multiclass helmet violation detection using few-shot data sampling technique and YOLOv8. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, Piscataway, IEEE53495357

[2] Adarsh P, Rathi P, Kumar M. YOLO v3-Tiny: Object detection and recognition using one stage improved model. Proceedings of the 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), 2020, Piscataway, IEEE687694

[3] Al Muksit A, Hasan F, Emon MFHB, Haque MR, Anwary AR, Shatabda S. YOLO-fish: A robust fish detection model to detect fish in realistic underwater environment. Ecological Informatics, 2022, 72: 101847

[4] Asyraf MS, Isa IS, Marzuki MIF, Sulaiman SN, Hung CC. CNN-based YOLO v3 comparison for underwater object detection. Journal of Electrical and Electronic Systems Research, 2021, 18: 30-37

[5] Avsar E, Feekings JP, Krag LA. Estimating catch rates in real time: Development of a deep learning based Nephrops (Nephrops norvegicus) counter for demersal trawl fisheries. Frontiers in Marine Science, 2023, 10: 1129852

[6] Burguera A, Bonin-Font F. Advances in autonomous underwater robotics based on machine learning. Journal of Marine Science and Engineering, 2022, 10(10): 1481

[7] Cao C, Yu Y, Xie Y, Sun C. An efficient approach for gastric polyps detection based on improved SSD. Proceedings of the 2021 China Automation Congress (CAC), 2021, Piscataway, IEEE852-857

[8] Chen Y, Li Q, Lu D, Kou L, Ke W, Bai Y, Wang Z. A novel underwater image enhancement using optimal composite backbone network. Biomimetics, 2023, 8(3275

[9] Cheng C. Real-time mask detection based on SSDMobileNetV2. In Proceedings of the 2022 IEEE 5th International Conference on Automation, Electronics and Electrical Engineering (AUTEEE), 2022, Piscataway, IEEE761-767

[10] Chi Y, Zhang C. Underwater image enhancement methods using biovision and type-II fuzzy set. Journal of Marine Science and Engineering, 2024, 12(11): 2080

[11] Du P, Song X. Lightweight target detection: An improved YOLOv8 for small target defect detection on printed circuit boards. Proceedings of the 2024 International Conference on Generative Artificial Intelligence and Information Security (GAIIS), 2024, New York, ACM 329-334

[12] Fayaz S, Parah SA, Qureshi GJ. Underwater object detection: Architectures and algorithms—A comprehensive review. Multimedia Tools and Applications, 2022, 81(1520871-20916

[13] Fu C, Liu R, Fan X, Chen P, Fu H, Yuan W, Zhu M, Luo Z. Rethinking general underwater object detection: Datasets, challenges, and solutions. Neurocomputing, 2023, 517: 243-256

[14] Gao Y, Liu W, Chui H-C, Chen X. Large span sizes and irregular shapes target detection methods using variable convolutionimproved YOLOv8. Sensors, 2024, 24(8): 2560

[15] Gašparović B, Lerga J, Mauša G, Ivašić-Kos M. Deep learning approach for objects detection in underwater pipeline images. Applied Artificial Intelligence, 2022, 36(12146853

[16] Girshick R, Donahue J, Darrell T, Malik J. Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014, Piscataway, IEEE580-587

[17] Han M, Lyu Z, Qiu T, Xu M. A review on intelligence dehazing and color restoration for underwater images. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2020, 50(5): 1820-1832

[18] He K, Zhang X, Ren S, Sun J. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(9): 1904-1916

[19] Jin ZZ, Zheng YF. Research on application of improved YOLO V3 algorithm in road target detection. Journal of Physics: Conference Series, 2020, 1654: 012060

[20] Jocher G, Chaurasia A, Stoken A, Borovec JNanoCode012. ultralytics/yolov5: v7.0-YOLOv5 SOTA realtime instance segmentation. Zenodo, 2022

[21] Karimanzira D, Renkewitz H, Shea D, Albiez J. Object detection in sonar images. Electronics, 2020, 9(7): 1180

[22] Kim JH, Kim N, Won CS. High-speed drone detection based on YOLO-V8. Proceedings of the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023, Piscataway, IEEE1-2

[23] Kim N, Kim JH, Won CS. FAFD: Fast and accurate face detector. Electronics, 2022, 11(6875

[24] Li C, Li L, Jiang H, Weng K, Geng Y, Li L, Ke Z, Li Q, Cheng M, Nie W, Li Y, Zhang B, Liang Y, Zhou L, Xu X, Chu X, Wei X, Wei X. YOLOv6: A single-stage object detection framework for industrial applications, 2022

[25] Li H, Gu Z, He D, Wang X, Huang J, Mo Y, Li P, Huang Z, Wu F. A lightweight improved YOLOv5s model and its deployment for detecting pitaya fruits in daytime and nighttime light-supplement environments. Computers and Electronics in Agriculture, 2024, 220: 108914

[26] Liu K, Sun Q, Sun D, Peng L, Yang M, Wang N. Underwater target detection based on improved YOLOv7. Journal of Marine Science and Engineering, 2023, 11(3677

[27] Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC. SSD: Single shot multiBox detector. Computer Vision — ECCV 2016: 14th European Conference, 2016, Berlin, Springer Part I21-37

[28] Meng F, Li J, Zhang Y, Qi S, Tang Y. Transforming unmanned pineapple picking with spatio-temporal convolutional neural networks. Computers and Electronics in Agriculture, 2023, 214: 108298

[29] Nguyen QH, Ly HB, Ho LS, Al-Ansari N, Le HV, Tran VQ, Prakash I, Pham BT. Influence of data splitting on performance of machine learning models in prediction of shear strength of soil. Mathematical Problems in Engineering, 20214832864

[30] Orinaitė U, Karaliūtė V, Pal M, Ragulskis M. Detecting underwater concrete cracks with machine learning: A clear vision of a murky problem. Applied Sciences, 2023, 13(127335

[31] Park CW, Eom IK (2024) Underwater image enhancement using adaptive standardization and normalization networks. Engineering Applications of Artificial Intelligence 127(Part A): 107445. https://doi.org/10.1016/j.engappai.2023.107445

[32] Pavani D, Reddy ANN, Saw N, Prasad S, Naik SM. Octacleaner: Underwater trash detection through YOLO. Proceedings of the 2023 3rd International Conference on Mobile Networks and Wireless Communications (ICMNWC), 2023, Piscataway, IEEE1-6

[33] QYSEA. FIFISH V6 plus official website, 2022

[34] Redmon J, Divvala S, Girshick R, Farhadi A. You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, Piscataway, IEEE779-788

[35] Rahman S, Rony JH, Uddin J, Samad MA. Real-time obstacle detection with YOLOv8 in a WSN using UAV aerial photography. Journal of Imaging, 2023, 9(10): 216

[36] Raza K, Hong S. Fast and accurate fish detection design with improved YOLO-v3 model and transfer learning. International Journal of Advanced Computer Science and Applications, 2020, 11(27-16

[37] Redmon J, Farhadi A. YOLOv3: An incremental improvement, 2018

[38] Ren S, He K, Girshick R, Sun J. Faster R-CNN: Towards realtime object detection with region proposal networks. Advances in Neural Information Processing Systems 28 (NeurIPS), 2015

[39] Selcuk B, Serif T. A comparison of YOLOv5 and YOLOv8 in the context of mobile UI detection. Proceedings of the International Conference on Mobile Web and Intelligent Information Systems, 2023161174

[40] Shankar R, Muthulakshmi M. Comparing YOLOv3, YOLOv5 & YOLOv7 architectures for underwater marine creatures detection. Proceedings of the 2023 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), 2023, Piscataway, IEEE 25-30

[41] Shen L, Tao H, Ni Y, Wang Y, Stojanovic V. Improved YOLOv3 model with feature map cropping for multi-scale road object detection. Measurement Science and Technology, 2023, 34(4045406

[42] Soorma MS, Chaudhary A, Sonali S, Pal S, Upadhyay DK. Underwater image processing with normalized AttUNet. 2023 International Conference on Computer, Electronics & Electrical Engineering & their Applications (IC2E3), 2023, Piscataway, IEEE 1-5

[43] Vidhya SK, Deepthi PS. A comprehensive analysis of underwater image processing based on deep learning techniques. Proceedings of the 2023 International Conference on Control, Communication and Computing (ICCC), 2023, Piscataway, IEEE 1-6

[44] Wang T, Li Y, Zhai Y, Wang W, Huang R. A sewer pipeline defect detection method based on improved YOLOv5. Processes, 2023, 118: 2508

[45] Xu S, Zhang M, Song W, Mei H, He Q, Liotta A. A systematic review and analysis of deep learning-based underwater object detection. Neurocomputing, 2023, 527: 204-232

[46] Yaseen M. What is YOLOv9: An in-depth exploration of the internal features of the next-generation object detector, 2024

[47] Zhang H, Zhang S, Wang Y, Liu Y, Yang Y, Zhou T, Bian H. Subsea pipeline leak inspection by autonomous underwater vehicle. Applied Ocean Research, 2021, 107: 102321

[48] Zhang H, Dai C, Chen C, Zhao Z, Lin M. One stage multiscale efficient network for underwater target detection. Review of Scientific Instruments, 2024, 956: 065108

[49] Zhang J, Liu X, Zhang X, Xi Z, Wang S. Automatic detection method of sewer pipe defects using deep learning techniques. Applied Sciences, 2023, 137: 4589

[50] Zhang L, Lin L, Liang X, He K. Is faster R-CNN doing well for pedestrian detection? Computer Vision—ECCV 2016: 14th European Conference. ECCV 2016. Lecture Notes in Computer Science Part II: 443-457, 2016

[51] Zhang Y, Ni Q. A novel weld-seam defect detection algorithm based on the S-YOLO model. Axioms, 2023, 127: 697

[52] Zhou H, Kong M, Yuan H, Pan Y, Wang X, Chen R, Lu W, Wang R, Yang Q. Real-time underwater object detection technology for complex underwater environments based on deep learning. Ecological Informatics, 2024, 82: 102680

[53] Zhong J, Gao C, Tian Y, Zhang M. Research on the influence of hydrodynamic analysis to dynamic modeling of underwater manipulator. Proceedings of the 2023 IEEE 6th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), 2023, 6: 982-986

[54] Zhao S, Zheng J, Sun S, Zhang L. An improved YOLO algorithm for fast and accurate underwater object detection. Symmetry, 2022, 148: 1669

RIGHTS & PERMISSIONS

Harbin Engineering University and Springer-Verlag GmbH Germany, part of Springer Nature