Interpretable gradient boosting based ensemble learning and African vultures optimization algorithm optimization for estimating deflection induced by excavation

Abstract

Intelligent construction has become an inevitable trend in the development of the construction industry. In the excavation project, using machine learning methods for early warning can improve construction efficiency and quality and reduce the chances of damage in the excavation process. An interpretable gradient boosting based ensemble learning framework enhanced by the African Vultures Optimization Algorithm (AVOA) was proposed and evaluated in estimating the diaphragm wall deflections induced by excavation. We investigated and compared the performance of machine learning models in predicting deflections induced by excavation based on a database generated by finite element simulations. First, we exploratively analyzed these data to discover the relationship between features. We used several state-of-the-art intelligent models based on gradient boosting and several simple models for model selection. The hyperparameters for all models in evaluation are optimized using AVOA, and then the optimized models are assembled into a unified framework for fairness assessment. The comprehensive evaluation results show that the AVOA-CatBoost built in this paper performs well (RMSE=1.84, MAE=1.18, R^2=0.9993) and cross-validation (RMSE=2.65\pm 1.54, MAE=1.17\pm 0.23, R^2=0.998\pm 0.002). In the end, in order to improve the transparency and usefulness of the model, we constructed an interpretable model from both global and local perspectives.

Graphical abstract

Keywords

African vultures optimization algorithm / gradient boosting / ensemble learning / interpretable model / wall deflection prediction

References

[1] Fang L . Environmental impact assessment in the whole process of super high-rise building construction. Fresenius Environmental Bulletin, 2021, 30(6B): 7923–7932

[2] Wu J , Cai J , Liu Z , Yuan S , Bai Y , Zhou R . BI-IEnKF coupling model for effective source term estimation of natural gas leakage in urban utility tunnels. Tunnelling and Underground Space Technology, 2023, 136: 136

[3] Guo J. . and G. Liu, Experimental study on the soil–structure responses induced by tunnelling in limited space. Applied Sciences, 2023, 13(12): 7000

[4] Zhang C , Zhao Z , Guo D , Gong D , Chen Y . Optimization of spatial layouts for deep underground infrastructure in central business districts based on a multi-agent system model. Tunnelling and Underground Space Technology, 2023, 135: 135

[5] van Nguyen D , Kim D , Choo Y . Optimized extreme gradient boosting machine learning for estimating diaphragm wall deflection of 3D deep braced excavation in sand. Structures, 2022, 45: 1936–1948

[6] Roy A F V , Cheng M Y , Wu Y W . Time dependent evolutionary fuzzy support vector machine inference model for predicting diaphragm wall deflection. Neural Network World, 2014, 24(2): 193–210

[7] Demeijer O , Chen J J , Li M G , Wang J H , Xu C J . Influence of passively loaded piles on excavation-induced diaphragm wall displacements and ground settlements. International Journal of Geomechanics, 2018, 18(6): 04018052

[8] Sabzi Z , Fakher A . The performance of buildings adjacent to excavation supported by inclined struts. International Journal of Civil Engineering, 2015, 13(1B): 1–13

[9] Xiao H J , Zhou S H , Sun Y Y . Wall deflection and ground surface settlement due to excavation width and foundation pit classification. KSCE Journal of Civil Engineering, 2019, 23(4): 1537–1547

[10] Liu S , Song Z , Zhang Y , Guo D , Sun Y , Zeng T , Xie J . Risk assessment of deep excavation construction based on combined weighting and nonlinear FAHP. Frontiers in Earth Science, 2023, 11: 1204721

[11] MasudaT. A study of empirical correlation for lateral deflections of diaphragm walls in deep excavations. In: Proceedings of International Symposium on Geotechnical Aspects of Underground Construction in Soft Ground. London: A.A. Balkema, 1996, 167–172

[12] Moormann C . Analysis of wall and ground movements due to deep excavations in soft soil based on a new worldwide database. Soil and Foundation, 2004, 44(1): 87–98

[13] Wang J H , Xu Z H , Wang W D . Wall and ground movements due to deep excavations in shanghai soft soils. Journal of Geotechnical and Geoenvironmental Engineering, 2010, 136(7): 985–994

[14] Kung G T C , Juang C H , Hsiao E C , Hashash Y M . Simplified model for wall deflection and ground-surface settlement caused by braced excavation in clays. Journal of Geotechnical and Geoenvironmental Engineering, 2007, 133(6): 731–747

[15] Goh A T C , Zhang F , Zhang W , Zhang Y , Liu H . A simple estimation model for 3D braced excavation wall deflection. Computers and Geotechnics, 2017, 83: 106–113

[16] Liu B K , Wang Y , Rabczuk T , Olofsson T , Lu W . Multi-scale modeling in thermal conductivity of polyurethane incorporated with phase change materials using physics-informed neural networks. Renewable Energy, 2024, 220: 220

[17] Zhao H , Liu W , Guan H , Fu C . Analysis of diaphragm wall deflection induced by excavation based on machine learning. Mathematical Problems in Engineering, 2021, 2021(1): 6664409

[18] Zhang W G , Zhang R , Wu C , Goh A T C , Lacasse S , Liu Z , Liu H . State-of-the-art review of soft computing applications in underground excavations. Geoscience Frontiers, 2020, 11(4): 1095–1106

[19] Liu B K , Vu-Bac N , Zhuang X , Fu X , Rabczuk T . Stochastic integrated machine learning based multiscale approach for the prediction of the thermal conductivity in carbon nanotube reinforced polymeric composites. Composites Science and Technology, 2022, 224: 224

[20] Qi C C , Tang X L . Slope stability prediction using integrated metaheuristic and machine learning approaches: A comparative study. Computers & Industrial Engineering, 2018, 118: 112–122

[21] Yong W X , Zhang W , Nguyen H , Bui X N , Choi Y , Nguyen-Thoi T , Zhou J , Tran T T . Analysis and prediction of diaphragm wall deflection induced by deep braced excavations using finite element method and artificial neural network optimized by metaheuristic algorithms. Reliability Engineering & System Safety, 2022, 221: 221

[22] Shariati M , Mafipour M S , Ghahremani B , Azarhomayun F , Ahmadi M , Trung N T , Shariati A . A novel hybrid extreme learning machine-grey wolf optimizer (ELM-GWO) model to predict compressive strength of concrete with partial replacements for cement. Engineering with Computers, 2022, 38(1): 757–779

[23] Liu B , Lu W , Olofsson T , Zhuang X , Rabczuk T . Stochastic interpretable machine learning based multiscale modeling in thermal conductivity of Polymeric graphene-enhanced composites. Composite Structures, 2024, 327: 327

[24] Hassija V , Chamola V , Mahapatra A . Interpreting black-box models: A review on explainable artificial intelligence. Cognitive Computation, 2024, 16(1): 45–74

[25] TangYReedP MWagenerTvan WerkhovenK. Comparison of parameter sensitivity analysis methods for lumped watershed model. In: Proceedings of World Environmental and Water Resources Congress 2008. Honolulu: ASCE, 2008, 1–8

[26] LundbergS MLeeS I. A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 2017, 30

[27] Roweis S T , Saul L K . Nonlinear dimensionality reduction by locally linear embedding. Science, 2000, 290(5500): 2323–2326

[28] Peng H C , Long F H , Ding C . Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(8): 1226–1238

[29] Abdollahzadeh B , Gharehchopogh F S , Mirjalili S . African vultures optimization algorithm: A new nature-inspired metaheuristic algorithm for global optimization problems. Computers & Industrial Engineering, 2021, 158: 158

[30] Friedman J H . Greedy function approximation: A gradient boosting machine. Annals of Statistics, 2001, 29(5): 1189–1232

[31] KeGMengQFinleyT. Lightgbm: A highly efficient gradient boosting decision tree. In: Proceedings of Advances in Neural Information Processing Systems. Long Beach, CA: Curran Associates, Inc., 2017, 30

[32] ProkhorenkovaLGusevGVorobevA. CatBoost: Unbiased boosting with categorical features. In: Proceedings of Advances in Neural Information Processing Systems. Montreal: Curran Associates, Inc., 2018, 31

[33] DuanTAnandADingD Y. Ngboost: Natural gradient boosting for probabilistic prediction. In: Proceedings of International Conference on Machine Learning. Auckland: PMLR, 2020, 2690–2700

[34] ChenTGuestrinC. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining. San Francisco, CA: Association for Computing Machinery, 2016, 785–794

[35] Breiman L . Random forests. Machine Learning, 2001, 45(1): 5–32

[36] Suykens J A K , Vandewalle J . Least squares support vector machine classifiers. Neural Processing Letters, 1999, 9(3): 293–300

[37] Breiman L . Stacked regressions. Machine Learning, 1996, 24(1): 49–64

[38] Cawley G C , Talbot N L C . On over-fitting in model selection and subsequent selection bias in performance evaluation. Journal of Machine Learning Research, 2010, 11: 2079–2107

[39] Liu B , Vu-Bac N , Zhuang X , Lu W , Fu X , Rabczuk T . Al-DeMat: A web-based expert system platform for computationally expensive models in materials design. Advances in Engineering Software, 2023, 176: 103398

[40] Merghadi A , Abderrahmane B , Bui D T . Landslide susceptibility assessment at mila basin (Algeria): A comparative assessment of prediction capability of advanced machine learning methods. ISPRS International Journal of Geo-Information, 2018, 7(7): 268

[41] Lucay F A . Accelerating global sensitivity analysis via supervised machine learning tools: Case studies for mineral processing models. Minerals, 2022, 12(6): 750

[42] Liu B , Penaka S R , Lu W , Feng K , Rebbling A , Olofsson T . Data-driven quantitative analysis of an integrated open digital ecosystems platform for user-centric energy retrofits: A case study in northern Sweden. Technology in Society, 2023, 75: 75

[43] HickeyJ MDi StefanoP GVasileiouV. Fairness by explicability and adversarial SHAP learning. In: Proceedings of Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2020. Ghent: Springer International Publishing, 2021, 174–190

[44] Kung G T C , Hsiao E C L , Schuster M , Juang C H . A neural network approach to estimating deflection of diaphragm walls caused by excavation in clays. Computers and Geotechnics, 2007, 34(5): 385–396

Acknowledgements

This study was supported by the National Natural Science Foundation of China (Grant Nos. 42107214 and 52130905).

Competing interests

The authors declare that they have no competing interests.

RIGHTS & PERMISSIONS

2024 Higher Education Press