Prediction of bearing capacity of pile foundation using deep learning approaches

Abstract

The accurate prediction of bearing capacity is crucial in ensuring the structural integrity and safety of pile foundations. This research compares the Deep Neural Networks (DNN), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), and Bidirectional LSTM (BiLSTM) algorithms utilizing a data set of 257 dynamic pile load tests for the first time. Also, this research illustrates the multicollinearity effect on DNN, CNN, RNN, LSTM, and BiLSTM models’ performance and accuracy for the first time. A comprehensive comparative analysis is conducted, employing various statistical performance parameters, rank analysis, and error matrix to evaluate the performance of these models. The performance is further validated using external validation, and visual interpretation is provided using the regression error characteristics (REC) curve and Taylor diagram. Results from the comparative analysis reveal that the DNN (Coefficient of determination (R²)_{training (TR)} = 0.97, root mean squared error (RMSE)_TR = 0.0413; R²_{testing (TS)} = 0.9, RMSE_TS = 0.08) followed by BiLSTM (R²_TR = 0.91, RMSE_TR = 0.782; R²_TS = 0.89, RMSE_TS = 0.0862) model demonstrates the highest performance accuracy. It is noted that the BiLSTM model is better than LSTM because the BiLSTM model, which increases the amount of information for the network, is a sequence processing model made up of two LSTMs, one of which takes the input in a forward manner, and the other in a backward direction. The prediction of pile-bearing capacity is strongly influenced by ram weight (having a considerable multicollinearity level), and the effect of the considerable multicollinearity level has been determined for the model based on the recurrent neural network approach. In this study, the recurrent neural network model has the least performance and accuracy in predicting the pile-bearing capacity.

Graphical abstract

Keywords

deep learning algorithms / high-strain dynamic pile test / bearing capacity of the pile

References

[1] Rausche F, Goble G G, Likins G E. Dynamic determination of pile capacity. Journal of Geotechnical Engineering, 1985, 111(3): 367–383

[2] Heidarie Golafzani S, Jamshidi Chenari R, Eslami A. Reliability based assessment of axial pile bearing capacity: static analysis, SPT and CPT-based methods. Georisk. Assessment and Management of Risk for Engineered Systems and Geohazards, 2020, 14(3): 216–230

[3] Huynh V H, Nguyen T, Nguyen D P, Nguyen T S, Nguyen T C. A novel direct SPT method to accurately estimate ultimate axial bearing capacity of bored PHC nodular piles with 81 case studies in Vietnam. Soil and Foundation, 2022, 62(4): 101163

[4] Zein A K M, Ayoub E M. Evaluation of measured and interpreted failure loads of bored piles in alluvial soil deposits. GEOMATE Journal, 2016, 10(19): 1636–1643

[5] Krasiński A, Wiszniewski M. Static load test on instrumented pile–field data and numerical simulations. Studia Geotechnica et Mechanica, 2017, 39(3): 17–25

[6] Lastiasih Y, Sari P T K. Comparison of ultimate bearing capacity based on empirical method, interpretation of loading pile test and finite element. In: Proceedings of the IOP Conference Series: Materials Science and Engineering. IOP Publishing, 2020, 930(1): 012036

[7] WhittleA J. Assessment of an effective stress analysis for predicting the performance of driven piles in clays. In: SUT Offshore Site Investigation and Foundation Behaviour New Frontiers: Proceedings of an International Conference. London: Springer Netherlands, 1993: 607–643

[8] Bak E. Numerical modeling of pile load tests. Pollack Periodica, 2013, 8(2): 131–140

[9] He S, Lai J, Li Y, Wang K, Wang L, Zhang W. Pile group response induced by adjacent shield tunnelling in clay: Scale model test and numerical simulation. Tunnelling and Underground Space Technology, 2022, 120: 104039

[10] Józefiak K, Zbiciak A, Maślakowski M, Piotrowski T. Numerical modelling and bearing capacity analysis of pile foundation. Procedia Engineering, 2015, 111: 356–363

[11] Loganathan N, Poulos H G. Analytical prediction for tunneling-induced ground movements in clays. Journal of Geotechnical and Geoenvironmental Engineering, 1998, 124(9): 846–856

[12] Al-Atroush M E, Hefny A, Zaghloul Y, Sorour T. Behavior of a large diameter bored pile in drained and undrained conditions: comparative analysis. Geosciences, 2020, 10(7): 261–281

[13] Chaallal O, Arockiasamy M, Godat A. Field test performance of buried flexible pipes under live truck loads. Journal of Performance of Constructed Facilities, 2015, 29(5): 04014124

[14] Park D, Rilett L R. Forecasting freeway link travel times with a multilayer feedforward neural network. Computer-Aided Civil and Infrastructure Engineering, 1999, 14(5): 357–367

[15] Tran V T, Nguyen T K, Nguyen-Xuan H, Wahab M A. Vibration and buckling optimization of functionally graded porous microplates using BCMO-ANN algorithm. Thin-walled Structures, 2023, 182: 110267

[16] Dang B L, Nguyen-Xuan H, Wahab M A. An effective approach for VARANS-VOF modelling interactions of wave and perforated breakwater using gradient boosting decision tree algorithm. Ocean Engineering, 2023, 268: 113398

[17] Wang S, Wang H, Zhou Y, Liu J, Dai P, Du X, Wahab M A. Automatic laser profile recognition and fast tracking for structured light measurement using deep learning and template matching. Measurement, 2021, 169: 108362

[18] Ho L V, Trinh T T, De Roeck G, Bui-Tien T, Nguyen-Ngoc L, Wahab M A. An efficient stochastic-based coupled model for damage identification in plate structures. Engineering Failure Analysis, 2022, 131: 105866

[19] Samaniego E, Anitescu C, Goswami S, Nguyen-Thanh V M, Guo H, Hamdia K, Zhuang X, Rabczuk T. An energy approach to the solution of partial differential equations in computational mechanics via machine learning: Concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 2020, 362: 112790

[20] ZhaoJTu JShiY. An ANN Model for Predicting Level Ultimate Bearing Capacity of PHC Pipe Pile. Earth and Space 2010: Engineering, Science, Construction, and Operations in Challenging Environments, 2010, 3168–3176

[21] Kordnaeij A, Kalantary F, Kordtabar B, Mola-Abasi H. Prediction of recompression index using GMDH-type neural network based on geotechnical soil properties. Soil and Foundation, 2015, 55(6): 1335–1345

[22] Momeni E, Nazir R, Armaghani D J, Maizir H. Prediction of pile bearing capacity using a hybrid genetic algorithm-based ANN. Measurement, 2014, 57: 122–131

[23] Biswas R, Samui P, Rai B. Determination of compressive strength using relevance vector machine and emotional neural network. Asian Journal of Civil Engineering, 2019, 20(8): 1109–1118

[24] Biswas R, Rai B, Samui P, Roy S S. Estimating concrete compressive strength using MARS, LSSVM and GP. Engineering Journal, 2020, 24(2): 41–52

[25] Tu J V. Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. Journal of Clinical Epidemiology, 1996, 49(11): 1225–1231

[26] Benbouras M A, Petrişor A I, Zedira H, Ghelani L, Lefilef L. Forecasting the bearing capacity of the driven piles using advanced machine-learning techniques. Applied Sciences, 2021, 11(22): 10908

[27] PhamT ANguyen D HDuongH A T. Development of deep learning neural network for estimating pile bearing capacity. In: Proceedings of the 6th International Conference on Geotechnics, Civil Engineering and Structures. Singapore: Springer, 2022: 1815–1823

[28] Zhang P, Yin Z Y. A novel deep learning-based modelling strategy from image of particles to mechanical properties for granular materials with CNN and BiLSTM. Computer Methods in Applied Mechanics and Engineering, 2021, 382: 113858

[29] GuoHZhuangX FuXZhuY RabczukT. Physics-informed deep learning for three-dimensional transient heat transfer analysis of functionally graded materials. Computational Mechanics, 2023: 1–12

[30] Guo H, Zhuang X, Alajlan N, Rabczuk T. Physics-informed deep learning for melting heat transfer analysis with model-based transfer learning. Computers & Mathematics with Applications, 2023, 143: 303–317

[31] Guo H, Zhuang X, Chen P, Alajlan N, Rabczuk T. Stochastic deep collocation method based on neural architecture search and transfer learning for heterogeneous porous media. Engineering with Computers, 2022, 38(6): 5173–5198

[32] GuoHZhuangX RabczukT. A deep collocation method for the bending analysis of Kirchhoff plate. 2021, arXiv: 2102.02617

[33] Zhuang X, Guo H, Alajlan N, Zhu H, Rabczuk T. Deep autoencoder based energy method for the bending, vibration, and buckling analysis of Kirchhoff plates with transfer learning. European Journal of Mechanics A/Solids, 2021, 87: 104225

[34] TaherkhaniA HMeiQHanF. A deep learning model to predict the lateral capacity of monopiles. In: Proceeding of Geo-Congress 2023. Los Angel: ASCE, 220–227

[35] Cheng H, Zhang H, Liu Z, Wu Y. Prediction of undrained bearing capacity of skirted foundation in spatially variable soils based on convolutional neural network. Applied Sciences, 2023, 13(11): 6624

[36] Shahin M A. Load–settlement modeling of axially loaded steel driven piles using CPT-based recurrent neural networks. Soil and Foundation, 2014, 54(3): 515–522

[37] Shahin M A. State-of-the-art review of some artificial intelligence applications in pile foundations. Geoscience Frontiers, 2016, 7(1): 33–44

[38] Zhang W, Li H, Li Y, Liu H, Chen Y, Ding X. Application of deep learning algorithms in geotechnical engineering: a short critical review. Artificial Intelligence Review, 2021, 54(8): 1–41

[39] Gao B, Wang R, Lin C, Guo X, Liu B, Zhang W. TBM penetration rate prediction based on the long short-term memory neural network. Underground Space, 2021, 6(6): 718–731

[40] Uncuoglu E, Citakoglu H, Latifoglu L, Bayram S, Laman M, Ilkentapar M, Oner A A. Comparison of neural network, Gaussian regression, support vector machine, long short-term memory, multi-gene genetic programming, and M5 Trees methods for solving civil engineering problems. Applied Soft Computing, 2022, 129: 109623

[41] Tao Y, Sun H, Cai Y. Predictions of deep excavation responses considering model uncertainty: Integrating BiLSTM neural networks with Bayesian updating. International Journal of Geomechanics, 2022, 22(1): 04021250

[42] Zhang P, Yang Y, Yin Z Y. BiLSTM-based soil–structure interface modeling. International Journal of Geomechanics, 2021, 21(7): 04021096

[43] Chen C, Wu B, Jia P, Wang Z. A Novel Hybrid Deep Neural Network Prediction Model for Shield Tunneling Machine Thrust. IEEE Access: Practical Innovations, Open Solutions, 2022, 10: 123858–123873

[44] Wang H, Zhang L, Luo H, He J, Cheung R W M. AI-powered landslide susceptibility assessment in Hong Kong. Engineering Geology, 2021, 288: 106103

[45] Kumar M, Kumar V, Rajagopal B G, Samui P, Burman A. State of art soft computing-based simulation models for bearing capacity of pile foundation: a comparative study of hybrid ANNs and conventional models. Modeling Earth Systems and Environment, 2023, 9(2): 2533–2551

[46] Kumar M, Biswas R, Kumar D R, Pradeep T, Samui P. Metaheuristic models for the prediction of bearing capacity of pile foundation. Geomechanics and Engineering, 2022, 31(2): 129–147

[47] Armaghani D J, Harandizadeh H, Momeni E, Maizir H, Zhou J. An optimized system of GMDH-ANFIS predictive model by ICA for estimating pile bearing capacity. Artificial Intelligence Review, 2022, 55(3): 1–38

[48] Momeni E, Dowlatshahi M B, Omidinasab F, Maizir H, Armaghani D J. Gaussian process regression technique to estimate the pile bearing capacity. Arabian Journal for Science and Engineering, 2020, 45(10): 8255–8267

[49] Momeni E, Nazir R, Armaghani D J, Maizir H. Application of artificial neural network for predicting shaft and tip resistances of concrete piles. Earth Sciences Research Journal, 2015, 19(1): 85–93

[50] Shahin M A. Intelligent computing for modeling axial capacity of pile foundations. Canadian Geotechnical Journal, 2010, 47(2): 230–243

[51] Kiefa M A. General regression neural networks for driven piles in cohesionless soils. Journal of Geotechnical and Geoenvironmental Engineering, 1998, 124(12): 1177–1185

[52] Khatti J, Grover K S. Prediction of compaction parameters for fine-grained soil: Critical comparison of the deep learning and standalone models. Journal of Rock Mechanics and Geotechnical Engineering, 2023, 15(11): 3010–3038

[53] Khatti J, Grover K S. Prediction of UCS of fine-grained soil based on machine learning part 1: multivariable regression analysis, gaussian process regression, and gene expression programming. Multiscale and Multidisciplinary Modeling. Experiments and Design, 2023, 6(2): 199–222

[54] KhattiJSamadi HGroverK S. Estimation of Settlement of Pile Group in Clay Using Soft Computing Techniques. Geotechnical and Geological Engineering, 2023: 1−32

[55] SmithG N. Probability and Statistics in Civil Engineering. London: Collins, 1986, 1986

[56] GolbraikhATropsha A. Beware of q2! Journal of Molecular Graphics & Modelling, 2002, 20(4): 269–276

[57] KumarMSamui P. Reliability analysis of pile foundation using GMDH, GP and MARS. In: Proceedings of the 6th International Conference on Geotechnics, Civil Engineering and Structures. Singapore: Springer, 2022: 1151–1159

RIGHTS & PERMISSIONS

Higher Education Press