Research on concrete structure defect repair based on three-dimensional printing

Abstract

Quality assurance and maintenance play a crucial role in engineering construction, as they have a significant impact on project safety. One common issue in concrete structures is the presence of defects. To enhance the automation level of concrete defect repairs, this study proposes a computer vision-based robotic system, which is based on three-dimensional (3D) printing technology to repair defects. This system integrates multiple sensors such as light detection and ranging (LiDAR) and camera. LiDAR is utilized to model concrete pipelines and obtain geometric parameters regarding their appearance. Additionally, a convolutional neural network (CNN) is employed with a depth camera to locate defects in concrete structures. Furthermore, a method for coordinate transformation is presented to convert the obtained coordinates into executable ones for a robotic arm. Finally, the feasibility of this concrete defect repair method is validated through simulation and experiments.

Graphical abstract

Keywords

concrete / defect detection / 3D printing / deep learning / point cloud data

References

[1] Cao V D, Le D A. Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction, 2019, 99(1): 52–58

[2] Obiora C O, Ezeokoli F O, Belonwu C C, Okeke F N. Defects in concrete elements: A study of residential buildings of 30 years and above in Onitsha Metropolis, Anambra State, Nigeria. Journal of Building Construction and Planning Research, 2022, 10(3): 102–123

[3] KasaharaJ Y LYamashitaAAsamaH. Positive weak supervision quality increase by consolidation for acoustic defect detection in concrete structures. In: Proceedings of the 2021 IEEE/SICE International Symposium on System Integration. New York: IEEE, 2021

[4] Laxman K C, Tabassum N, Ai L, Cole C, Ziehl P. Automated crack detection and crack depth prediction for reinforced concrete structures using deep learning. Construction and Building Materials, 2023, 370: 130709

[5] Ren Y P, Huang J, Hong Z Y, Lu W, Yin J, Zou L, Shen X. Image-based concrete crack detection in tunnels using deep fully convolutional networks. Construction and Building Materials, 2020, 234: 117367

[6] Gao Y, Sun H. Influence of initial defects on crack propagation of concrete under uniaxial compression. Construction and Building Materials, 2021, 277(4): 122361

[7] Cha Y J, Choi W, Büyüköztürk O. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(5): 361–378

[8] Pan Y, Zhang G, Zhang L. A spatial-channel hierarchical deep learning network for pixel-level automated crack detection. Automation in Construction, 2020, 119: 103357

[9] Liu Y, Yao J, Lu X, Xie R, Li L. DeepCrack: A deep hierarchical feature learning architecture for crack segmentation. Neurocomputing, 2019, 338(21): 139–153

[10] Li S, Zhao X, Zhou G. Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network. Computer-Aided Civil and Infrastructure Engineering, 2019, 34(7): 616–634

[11] Bhattacharya G, Mandal B, Puhan N B. Interleaved deep artifacts-aware attention mechanism for concrete structural defect classification. IEEE Transactions on Image Processing, 2021, 30: 6957–6969

[12] McLaughlin E, Charron N, Narasimhan S. Automated defect quantification in concrete bridges using robotics and deep learning. Journal of Computing in Civil Engineering, 2020, 34(5): 04020029

[13] Chen X, Zhao C, Chen J, Zhang D, Zhu K, Su Y. A compact Robot-based defect detection device design for silicon wafer. Journal of Physics: Conference Series, 2020, 1449(1): 012111

[14] Yang L, Li B, Li W, Brand H, Jiang B, Xian J. Concrete defects inspection and 3D mapping using CityFlyer quadrotor robot. IEEE/CAA Journal of Automatica Sinica, 2020, 7(4): 991–1002

[15] Feng D M, Feng M Q. Computer vision for SHM of civil infrastructure: From dynamic response measurement to damage detection—A review. Engineering Structures, 2018, 156: 105–117

[16] Davoudi R, Miller G R, Kutz J N. Structural load estimation using machine vision and surface crack patterns for shear-critical RC beams and slabs. Journal of Computing in Civil Engineering, 2018, 32(4): 04018024

[17] NohYKooDKangY MParkDLeeD. Automatic crack detection on concrete images using segmentation via fuzzy C-means clustering. In: Proceedings of the 2017 International Conference on Applied System Innovation (ICASI). New York: IEEE, 2017

[18] DinhT HHaQ PLaH M. Computer vision-based method for concrete crack detection. In: Proceedings of the 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV). New York: IEEE, 2016

[19] ChaY JGopalD LAliR. Vision-based concrete crack detection technique using cascade features. In: Sensors and Smart Structures Technologies for Civil, Mechanical, & Aerospace Systems 2018. Bellingham, WA: SPIE, 2018

[20] Koch C, Doycheva K, Kasireddy V, Akinci B, Fieguth P. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Advanced Engineering Informatics, 2015, 29(2): 196–210

[21] Xu H, Su X, Wang Y, Cai H, Cui K, Chen X. Automatic bridge crack detection using a convolutional neural network. Applied Sciences, 2019, 9(14): 2867

[22] Hu L, Yang F. Runet: Convolutional networks for crack detection. Journal of Physics: Conference Series, 2022, 2171(1): 012052

[23] Ye W, Wei Y, Xu M, Ye L. Application of ground penetrating radar in concrete defect detection of sluice floor. E3S Web of Conferences, 2021, 276: 02023

[24] Cui X, Wang Q, Dai J, Xue Y, Duan Y. Intelligent crack detection based on attention mechanism in convolution neural network. Advances in Structural Engineering, 2021, 24(9): 1859–1868

[25] Wang W, Lu K, Wu Z, Long H, Zhang J, Chen P, Wang B. Surface defects classification of hot rolled strip based on improved convolutional neural network. ISIJ International, 2021, 61(5): 1579–1583

[26] Li Q, Luo Z, Chen H, Li C. An overview of deeply optimized convolutional neural networks and research in surface defect classification of workpieces. IEEE Access: Practical Innovations, Open Solutions, 2022, 10: 26443–26462

[27] Stephen O, Maduh U J, Sain M. A machine learning method for detection of surface defects on ceramic tiles using convolutional neural networks. Electronics, 2021, 11(1): 55

[28] Gopalakrishnan K, Khaitan S K, Choudhary A, Agrawal A. Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction and Building Materials, 2017, 157(4): 322–330

[29] Song E P, Eem S H, Jeon H. Concrete crack detection and quantification using deep learning and structured light. Construction and Building Materials, 2020, 252(5): 119096

[30] Beckman G H, Polyzois D, Cha Y J. Deep learning-based automatic volumetric damage quantification using depth camera. Automation in Construction, 2019, 99(1): 114–124

[31] Lewis J, Cha Y J, Kim J. Dual encoder–decoder-based deep polyp segmentation network for colonoscopy images. Scientific Reports, 2023, 13(1): 1183

[32] Kang D H, Cha Y J. Efficient attention-based deep encoder and decoder for automatic crack segmentation. Structural Health Monitoring, 2022, 21(5): 2190–2205

[33] Leung C K, Elvin N, Olson N, Morse T F, He Y F. A novel distributed optical crack sensor for concrete structures. Engineering Fracture Mechanics, 2000, 65(2−3): 133–148

[34] Ai D, Yang Z, Li H, Zhu H. Heating-time effect on electromechanical admittance of surface-bonded PZT sensor for concrete structural monitoring. Measurement, 2021, 184: 109992

[35] Liu H, Zhang B, Liu H, Ji Z. Analysis of long-term durability monitoring data of high-piled wharf with anode-ladder sensors embedded in concrete. Frontiers in Materials, 2021, 8: 703347

[36] Kim T K, Park J S. Performance evaluation of concrete structures using crack repair methods. Sustainability, 2021, 13(6): 3217

[37] PerryMBiondiLMcAlorumJVlachakisC. Self-sensing concrete repairs based on alkali-activated materials: Recent progress. In: Proceedings of the 2021 IEEE International Instrumentation and Measurement Technology Conference (I2MTC). New York: IEEE, 2021

[38] Martuscelli C, Soares C, Camões A, Lima N. Potential of fungi for concrete repair. Procedia Manufacturing, 2020, 46: 180–185

[39] Kumar K H, Babu N V, Lingeshwaran N. A study on repair of concrete structure using nondestructive tests. Materials Today: Proceedings, 2021, 47(15): 5439–5446

[40] Chen X, Zhang Q, Ming Y, Fu F, Rong H. A numerical study for chloride migration in concrete under electrochemical repair process. Proceedings of the Institution of Civil Engineers-Structures and Buildings, 2021, 176(7): 556–564

[41] Sun X, Miao L. Application of bio-remediation with bacillus megaterium for crack repair at low temperature. Journal of Advanced Concrete Technology, 2020, 18(5): 307–319

[42] Kan Y C, Lee M G, Lee H W. Mechanical Behavior of mode I fractured concrete repaired by polymethyl methacrylate (PMMA). Materials Science Forum, 2020, 990(5): 50–54

[43] Elhamnike S M, Abbaszadeh R, Razavinasab V, Ziaadiny H. Behavior and modeling of post-heated circular concrete specimens repaired with fiber-reinforced polymer composites. Advances in Structural Engineering, 2022, 25(3): 541–551

[44] Lenwari A, Thongchom C, Aboutaha R S. Cyclic flexural performance of fire-damaged reinforced concrete beams strengthened with carbon fiber-reinforced polymer plates. ACI Structural Journal, 2020, 117(6): 133–146

[45] Peng K D, Huang B T, Xu L Y, Hu R L, Dai J G. Flexural strengthening of reinforced concrete beams using geopolymer-bonded small-diameter CFRP bars. Engineering Structures, 2022, 256(4): 113992

[46] Kang D H, Cha Y J. Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(10): 885–902

[47] Waqas A, Kang D H, Cha Y J. Deep learning-based obstacle-avoiding autonomous UAVs with fiducial marker-based localization for structural health monitoring. Structural Health Monitoring, 2024, 23(2): 971–990

[48] Ali R, Kang D H, Suh G, Cha Y J. Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures. Automation in Construction, 2021, 130: 103831

[49] WangC YBochkovskiyALiaoH Y M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2023

[50] Xu W, Cai Y, He D, Lin J, Zhang F. Fast-Lio2: Fast direct LiDAR-inertial odometry. IEEE Transactions on Robotics, 2022, 38(4): 2053–2073

[51] Fischler M A, Bolles R C. Random sample consensus. Communications of the ACM, 1981, 24(6): 381–395

[52] LukácsGMartinRMarshallD. Faithful least-squares fitting of spheres, cylinders, cones and tori for reliable segmentation. In: Proceedings of Computer Vision—ECCV98: 5th European Conference on Computer Vision Freiburg. Berlin: Springer Berlin, 1998, 671–686

[53] MundtMMajumderSMuraliSPanetsosPRameshV. Meta-learning convolutional neural architectures for multi-target concrete defect classification with the concrete defect bridge image dataset. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New York: IEEE, 2019, 11196–11205

[54] LinT YMaireMBelongieSHaysJPeronaPRamananDDollárPZitnickC L. Microsoft COCO: Common objects in context. In: Proceedings of Computer Vision—ECCV 2014: 13th European Conference. Berlin: Springer Berlin, 2014, 740–755

[55] GB8076-2008. Concrete Admixtures. Beijing: General Administration of Quality Supervision, Inspection and Quarantine of the People’s Republic of China, 2008

[56] GSB08-1337-2018. China ISO Standard Sand. Beijing: China National Academy of Building Materials Science and Technology Co., Ltd., 2018

Acknowledgements

This research was funded by the Ministry of Science and Technology of China (No. 2021YFE0114100), the Science and Technology Commission of Shanghai Municipality (No. 21DZ1203505) and the Top Discipline Plan of Shanghai Universities-Class I.

Competing interests

The authors declare that they have no competing interests.

RIGHTS & PERMISSIONS

2024 Higher Education Press