Thickness regression for backfill grouting of shield tunnels based on GPR data and CatBoost & BO-TPE: A full-scale model test study

Abstract

Ground penetrating radar (GPR) is a vital non-destructive testing (NDT) technology that can be employed for detecting the backfill grouting of shield tunnels. To achieve intelligent analysis of GPR data and overcome the subjectivity of traditional data processing methods, the CatBoost & BO-TPE model was constructed for regressing the grouting thickness based on GPR waveforms. A full-scale model test and corresponding numerical simulations were carried out to collect GPR data at 400 and 900 MHz, with known backfill grouting thickness. The model test helps address the limitation of not knowing the grout body condition in actual field detection. The data were then used to create machine learning datasets. The method of feature selection was proposed based on the analysis of feature importance and the electromagnetic (EM) propagation law in mediums. The research shows that: (1) the CatBoost & BO-TPE model exhibited outstanding performance in both experimental and numerical data, achieving R² values of 0.9760, 0.8971, 0.8808, and 0.5437 for numerical data and test data at 400 and 900 MHz. It outperformed extreme gradient boosting (XGBoost) and random forest (RF) in terms of performance in the backfill grouting thickness regression; (2) compared with the full-waveform GPR data, the feature selection method proposed in this paper can promote the performance of the model. The selected features within the 5-30 ns of the A-scan can yield the best performance for the model; (3) compared to GPR data at 900 MHz, GPR data at 400 MHz exhibited better performance in the CatBoost & BO-TPE model. This indicates that the results of the machine learning model can provide feedback for the selection of GPR parameters; (4) the application results of the trained CatBoost & BO-TPE model in engineering are in line with the patterns observed through traditional processing methods, yet they demonstrate a more quantitative and objective nature compared to the traditional method.

Keywords

Shield tunnel / Backfill grouting / GPR / Model test / gprMax / Machine learning / CatBoost & BO-TPE / Thickness regression

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgment

This work was supported by the National Natural Science Foundation of China (Grant Nos. 52038008 and 52378408), the Science and Technology Innovation Plan of Shanghai Science and Technology Commission (Grant Nos. 20DZ1202004 and 22DZ1203004), and State Grid Shanghai Municipal Electric Power Company (Grant No. 52090W220001).

References

[1] Bergstra, J., & Bengio, Y. (2012). Random search for hyper-parameter optimization. The Journal of Machine Learning Research, 13, 281-305.

[2] Bergstra, J., Yamins, D., & Cox, D. D. (2013). Hyperopt: A python library for optimizing the hyperparameters of machine learning algorithms. In Proceedings of the 12th Python in Science Conference (SCIPY 2013) (pp. 13-19).

[3] Bhat, P. C., Prosper, H. B., Sekmen, S., & Stewart, C. (2018). Optimizing event selection with the random grid search. Computer Physics Communications, 228, 245-257.

[4] Chen, T. Q., & Guestrin, C. (2016). XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 785-794).

[5] Dhananjay, B., & Sivaraman, J. (2021). Analysis and classification of heart rate using CatBoost feature ranking model. Biomedical Signal Processing and Control, 68, 102610.

[6] Dorogush, A. V., Ershov, V., & Gulin, A. (2018). CatBoost: gradient boosting with categorical features support. preprint. https://arxiv.org/abs/1810.11363.

[7] Fekete, S., Diederichs, M., & Lato, M. (2010). Geotechnical and operational applications for 3-dimensional laser scanning in drill and blast tunnels. Tunnelling and Underground Space Technology, 25(5), 614-628.

[8] Frazier, P. I. (2018). A tutorial on Bayesian optimization. preprint. https://arxiv.org/abs/1807.02811.

[9] Giannakis, I., Giannopoulos, A., & Warren, C. (2015). A realistic FDTD numerical modeling framework of ground penetrating radar for landmine detection. In IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (pp.37-51).

[10] Giannopoulos, A. (2005). Modelling ground penetrating radar by GprMax. Construction and Building Materials, 19(10), 755-762.

[11] Hossain, M. R., Timmer, D., & Moya, H. (2021). Machine learning model optimization with hyper parameter tuning approach. In Proceedings of 2021 International Conference on Advanced Engineering, Technology and Applications (ICAETA). Istanbul, Turkey.

[12] Jiang, Q., Shi, Y. E., Yan, F., Zheng, H., Kou, Y. Y., & He, B. G. (2020). Reconstitution method for tunnel spatiotemporal deformation based on 3D laser scanning technology and corresponding instability warning. Engineering Failure Analysis, 125, 105391.

[13] Johansson, J. R., Nation, P. D., & Nori, F. (2012). QuTiP: An opensource Python framework for the dynamics of open quantum systems. Computer Physics Communications, 183(8), 1760-1772.

[14] Johansson, J. R., Nation, P. D., & Nori, F. (2012). QuTiP: An opensource Python framework for the dynamics of open quantum systems. Computer Physics Communications, 183(8), 1760-1772.

[15] Jol, H. M. (2009). Ground penetrating radar theory and applications. Elsevier.

[16] Joo, C., Park, H., Lim, J., Cho, H., & Kim, J. (2023). Machine learningbased heat deflection temperature prediction and effect analysis in polypropylene composites using catboost and shapley additive explanations. Engineering Applications of Artificial Intelligence, 126, 106873.

[17] Joy, T. T., Rana, S., Gupta, S., & Venkatesh, S. (2020). Batch Bayesian optimization using multi-scale search. Knowledge-Based Systems, 187, 104818.

[18] Kanyongo, W., & Ezugwu, A. E. (2023). Feature selection and importance of predictors of non-communicable diseases medication adherence from machine learning research perspectives. Informatics in Medicine Unlocked, 38, 101232.

[19] Ke, G. L., Meng, Q., Finley, T., Wang, T. F., Chen, W., Ma, W. D.,... Liu, T. Y. (2017). LightGBM: A highly efficient gradient boosting decision tree. In Proceedings of the 31st International Conference on Neural Information Processing Systems (pp. 3149-3157).

[20] Kodjikian, S., & Klein, H. (2019). Low-dose electron diffraction tomography (LD-EDT). Ultramicroscopy, 200, 12-19.

[21] Lai, W. W. L., Dérobert, X., & Annan, P. (2018). A review of Ground Penetrating Radar application in civil engineering: A 30-year journey from Locating and Testing to Imaging and Diagnosis. NDT & E International, 96, 58-78.

[22] Lee, K. M., Rowe, R. K., & Lo, K. Y. (1992). Subsidence owing to tunnelling. I. Estimating the gap parameter. Canadian Geotechnical Journal, 29(6), 929-940.

[23] Li, K., Xie, X. Y., Huang, C. F., Zhou, B., Duan, W. W., Lin, H. L., & Wang, C. (2023). Study on the penetration capability of GPR for the steel-fibre reinforced concrete (SFRC) segment based on numerical simulations and model test. Construction and Building Materials, 400, 132719.

[24] Li, Y. S., Liu, C. L., Yue, G. H., Gao, Q., & Du, Y. C. (2022). Deep learning-based pavement subsurface distress detection via ground penetrating radar data. Automation in Construction, 142, 104516.

[25] Liu, H. J., Chen, C., Guo, Z. Q., Xia, Y. Y., Yu, X., & Li, S. J. (2021). Overall grouting compactness detection of bridge prestressed bellows based on RF feature selection and the GA-SVM model. Construction and Building Materials, 301, 124323.

[26] Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17) (pp. 4768-4777).

[27] Micci-Barreca, D. (2001). A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problems. ACM SIGKDD Explorations Newsletter, 3(1), 27-32.

[28] Ozkaya, U., Melgani, F., Bejiga, M. B., Seyfi, L., & Donelli, M. (2020). GPR B scan image analysis with deep learning methods. Measurement, 165, 107770.

[29] Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A. V., & Gulin, A. (2018). CatBoost: Unbiased boosting with categorical features. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (pp. 6639-6649).

[30] Qin, H., Xie, X. Y., Tang, Y., & Wang, Z. Z. (2020). Experimental study on GPR detection of voids inside and behind tunnel linings. Journal of Environmental and Engineering Geophysics, 25(1), 65-74.

[31] Rasol, M., Pais, J. C., Pérez-Gracia, V., Solla, M., Fernandes, F. M., Fontul, S.,... Assadollahi, H. (2022). GPR monitoring for road transport infrastructure: A systematic review and machine learning insights. Construction and Building Materials, 324, 126686.

[32] Schofield, R., King, L., Tayal, U., Castellano, I., Stirrup, J., Pontana, F.,... Nicol, E. (2020). Image reconstruction: Part 1 - understanding filtered back projection, noise and image acquisition. Journal of Cardiovascular Computed Tomography, 14(3), 219-225.

[33] Shah, R., Lavasan, A. A., Peila, D., Todaro, C., Luciani, A., & Schanz, T. (2018). Numerical Study on Backfilling the Tail Void Using a Two- Component Grout. Journal of Materials in Civil Engineering, 30(3), 04018003.

[34] Shaju, K., Babu, S., & Thomas, B. (2023). Analysing effectiveness of grey theory-based feature selection for meteorological estimation models. Engineering Applications of Artificial Intelligence, 123, 106243.

[35] Shehadeh, A., Alshboul, O., Al Mamlook, R. E., & Hamedat, O. (2021). Machine learning models for predicting the residual value of heavy construction equipment: An evaluation of modified decision tree, LightGBM, and XGBoost regression. Automation in Construction, 129, 103827.

[36] Sandha, S. S., Aggarwal, M., Fedorov, I., & Srivastava, M. (2020). MANGO: A Python Library for Parallel Hyperparameter Tuning. In Proceedings of 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 3987-3991).

[37] Song, W. L., Zhu, Z. D., Pu, S. Y., Wan, Y., Huo, W. W., Song, S. G.,... Hu, L. L. (2020). Synthesis and characterization of eco-friendly alkaliactivated industrial solid waste-based two-component backfilling grouts for shield tunnelling. Journal of Cleaner Production, 266, 121974.

[38] Sun, H., & Feng, Y. L. (2020). Statistics on global super-large diameter tunnel boring machines. Tunnel Construction, 40(6), 925-928 (in Chinese).

[39] Todaro, C., Peila, L., Luciani, A., Carigi, A., Martinelli, D., & Boscaro, A. (2019). In Two component backfilling in shield tunneling: laboratory procedure and results of a test campaign (pp. 3210-3223). CRC Press.

[40] Todkar, S. S., Baltazart, V., Ihamouten, A., Dérobert, X., & Guilbert, D. (2021). One-class SVM based outlier detection strategy to detect thin interlayer debondings within pavement structures using Ground Penetrating Radar data. Journal of Applied Geophysics, 192, 104392.

[41] Wang, J. X., Zhu, L. Q., & Dai, H. D. (2023). An efficient state-of-health estimation method for lithium-ion batteries based on feature-importance ranking strategy and PSO-GRNN algorithm. Journal of Energy Storage, 72, 108638.

[42] Wang, S. M., He, C., Nie, L., & Zhang, G. C. (2019). Study on the longterm performance of cement-sodium silicate grout and its impact on segment lining structure in synchronous backfill grouting of shield tunnels. Tunnelling and Underground Space Technology, 92, 103015.

[43] Warren, C., Giannopoulos, A., & Giannakis, I. (2016). gprMax: Open source software to simulate electromagnetic wave propagation for Ground Penetrating Radar. Computer Physics Communications, 209, 163-170.

[44] Ying, K. C., Ye, F., Li, Y. J., Liang, X. M., Su, E. J., & Han, X. (2022). Backfill grouting diffusion law of shield tunnel considering porous media with nonuniform porosity. Tunnelling and Underground Space Technology, 127, 104607.

[45] Zeng, L., Zhang, X. B., Xie, X. Y., Zhou, B., Xu, C., & Lambot, S. (2023). Measuring annular thickness of backfill grouting behind shield tunnel lining based on GPR monitoring and data mining. Automation in Construction, 150, 104811.

[46] Zeng, L., Zhou, B., Xie, X. Y., Zhao, Y. H., Liu, H., Zhang, Y. L., & Shahrour, I. (2020). A novel real-time monitoring system for the measurement of the annular grout thickness during simultaneous backfill grouting. Tunnelling and Underground Space Technology, 105, 103567.

[47] Zhang, W. J., Qi, J. B., Zhang, G. L., Niu, R. J., Zhang, C., He, L. C., & Lyu, J. R. (2022). Full-scale experimental study on failure characteristics of the key segment in shield tunnel with super-large cross-section. Tunnelling and Underground Space Technology, 129, 104671.