Performance evaluation of rock fragmentation prediction based on RF-BOA, AdaBoost-BOA, GBoost-BOA, and ERT-BOA hybrid models

Abstract

Rock fragmentation is an important indicator for assessing the quality of blasting operations. However, accurate prediction of rock fragmentation after blasting is challenging due to the complicated blasting parameters and rock properties. For this reason, optimized by the Bayesian optimization algorithm (BOA), four hybrid machine learning models, including random forest, adaptive boosting, gradient boosting, and extremely randomized trees, were developed in this study. A total of 102 data sets with seven input parameters (spacing-toburden ratio, hole depth-to-burden ratio, burden-to-hole diameter ratio, stemming length-to-burden ratio, powder factor, in situ block size, and elastic modulus) and one output parameter (rock fragment mean size, X₅₀) were adopted to train and validate the predictive models. The root mean square error (RMSE), the mean absolute error (MAE), and the coefficient of determination (R²) were used as the evaluation metrics. The evaluation results demonstrated that the hybrid models showed superior performance than the standalone models. The hybrid model consisting of gradient boosting and BOA (GBoost-BOA) achieved the best prediction results compared with the other hybrid models, with the highest R² value of 0.96 and the smallest values of RMSE and MAE of 0.03 and 0.02, respectively. Furthermore, sensitivity analysis was carried out to study the effects of input variables on rock fragmentation. In situ block size (X_B), elastic modulus (E), and stemming length-to-burden ratio (T/B) were set as the main influencing factors. The proposed hybrid model provided a reliable prediction result and thus could be considered an alternative approach for rock fragment prediction in mining engineering.

Keywords

Bayesian optimization / blasting / machine learning / rock fragmentation

References

[1] Amoako R, Jha A, Zhong S. Rock fragmentation prediction using an artificial neural network and support vector regression hybrid approach. Mining. 2022; 2: 233-247.

[2] Asl PF, Monjezi M, Hamidi JK, Armaghani DJ. Optimization of flyrock and rock fragmentation in the Tajareh limestone mine using metaheuristics method of firefly algorithm. Eng Comp. 2018; 34: 241-251.

[3] Bamford T, Esmaeili K, Schoellig AP. A deep learning approach for rock fragmentation analysis. Int J Rock Mech Mining Sci. 2021; 145:104839.

[4] Bayat P, Monjezi M, Mehrdanesh A, Khandelwal M. Blasting pattern optimization using gene expression programming and Grasshopper optimization algorithm to minimise blast-induced ground vibrations. Eng Comp. 2021; 38: 3341-3350.

[5] Bo Y, Huang X, Pan Y, et al. Robust model for tunnel squeezing using Bayesian optimized classifiers with partially missing database. Undergr Space. 2023; 10: 91-117.

[6] Canayaz M, Şehribanoğlu S, Özdağ R, Demir M. COVID-19 diagnosis on CT images with Bayes optimization-based deep neural networks and machine learning algorithms. Neural Comp Appl. 2022; 34: 5349-5365.

[7] Ceryan N, Okkan U, Kesimal A. Prediction of unconfined compressive strength of carbonate rocks using artificial neural networks. Environ Earth Sci. 2013; 68: 807-819.

[8] Chen G, Fu K, Liang Z, et al. The genetic algorithm based back propagation neural network for MMP prediction in CO₂-EOR process. Fuel. 2014; 126: 202-212.

[9] Chen G, He H, Zhao L, Chen KB, Li S, Chen CY-C. Adaptive boost approach for possible leads of triple-negative breast cancer. Chemometr Intel Lab Syst. 2022; 231:104690.

[10] Chen T, Guestrin C. Xgboost: a scalable tree boosting system. In: Krishnapuram B, Shah M, Smola AJ, Aggarwal C, Shen D, Rastogi R, eds. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Association for Computing Machinery (ACM); 2016: 785-794.

[11] Cunningham CVB. Fragmentation estimations and the Kuz-Ram model—four years on. In: Fourney WL, Dick RD, eds. Proceedings of the 2nd International Symposium on Rock Fragmentation by Blasting. European Federation of Explosives Engineers; 1987: 475-478.

[12] Dai Y, Khandelwal M, Qiu Y, Zhou J, Monjezi M, Yang P. A hybrid metaheuristic approach using random forest and particle swarm optimization to study and evaluate backbreak in open-pit blasting. Neural Comp Appl. 2022; 34: 6273-6288.

[13] Dimitraki L, Christaras B, Marinos V, Vlahavas I, Arampelos N. Predicting the average size of blasted rocks in aggregate quarries using artificial neural networks. Bull Eng Geol Environ. 2019; 78: 2717-2729.

[14] Djarum DH, Ahmad Z, Zhang J. River water quality prediction in Malaysia based on extra tree regression model coupled with linear discriminant analysis (LDA). Comp Aid Chem Eng. 2021; 50: 1491-1496.

[15] Egberts G, Schaaphok M, Vermolen F, Zuijlen P. A Bayesian finite-element trained machine learning approach for predicting post-burn contraction. Neural Comp Appl. 2022; 34: 8635-8642.

[16] Enayatollahi I, Aghajani Bazzazi A, Asadi A. Comparison between neural networks and multiple regression analysis to predict rock fragmentation in open-pit mines. Rock Mech Rock Eng. 2014; 47: 799-807.

[17] Geurts P, Louppe G. Learning to rank with extremely randomized trees. In: Chapelle O, Chang Y, Liu T-Y, eds. Proceedings of the Learning to Rank Challenge: PMLR. Journal of Machine Learning Research (JMLR.org); 2011: 49-61.

[18] Greenhill S, Rana S, Gupta S, Vellanki P, Venkatesh S. Bayesian optimization for adaptive experimental design: a review. IEEE Access. 2020; 8: 13937-13948.

[19] Hameed MM, AlOmar MK, Khaleel F, Al-Ansari N. An extra tree regression model for discharge coefficient prediction: novel, practical applications in the hydraulic sector and future research directions. Math Probl Eng. 2021; 2021: 1-19.

[20] Han Z, Li J, Li D, Zhao J. 3D spatial fracture behavior of sandstone containing a surface flaw under uniaxial compression. Int J Rock Mech Mining Sci. 2023; 171:105583.

[21] Han Z, Li J, Wang H, Zhao J. Initiation and propagation of a single internal 3D crack in brittle material under dynamic loads. Eng Fract Mech. 2023; 285:109299.

[22] Hasanipanah M, Amnieh HB, Arab H, Zamzam MS. Feasibility of PSO-ANFIS model to estimate rock fragmentation produced by mine blasting. Neural Comp Appl. 2018; 30: 1015-1024.

[23] He M, Zhang Z, Li N. Deep convolutional neural network-based method for strength parameter prediction of jointed rock mass using drilling logging data. Int J Geomech. 2021; 21(7):04021111.

[24] Hekmat A, Munoz S, Gomez R. Prediction of rock fragmentation based on a modified Kuz-Ram model. In: Widzyk-Capehart E, Hekmat A, Singhal R, eds. Proceedings of the 27th International Symposium on Mine Planning and Equipment Selection-MPES 2018. Springer; 2019: 69-79.

[25] Hjelmberg H. Some ideas on how to improve calculations of the fragment size distribution in bench blasting. In: Holmberg R, Rustan A, eds. Proceedings of the 1st International Symposium on Rock Fragmentation by Blasting. Lulea University of Technology; 1983: 469-494.

[26] Hudaverdi T, Kulatilake PHSW, Kuzu C. Prediction of blast fragmentation using multivariate analysis procedures. Int J Numer Anal Methods Geomech. 2011; 35: 1318-1333.

[27] Inanloo Arabi Shad H, Sereshki F, Ataei A, Karamoozian M. Investigation of the rock blast fragmentation based on the specific explosive energy and in-situ block size. Int J Min Geo-Eng. 2018; 52: 1-6.

[28] Ke G, Meng Q, Finley T, et al. LightGBM: a highly efficient gradient boosting decision tree. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R , Vishwanathan SVN, Garnett R, eds. Proceedings of the Advances in Neural Information Processing Systems. Neural Information Processing Systems (NIPS); 2017: 3147-3155.

[29] Kinyua EM, Jianhua Z, Kasomo RM, Mauti D, Mwangangi J. A review of the influence of blast fragmentation on downstream processing of metal ores. Miner Eng. 2022; 186:107743.

[30] Kou S, Rustan P. Computerized design and result prediction of bench blasting. In: Rossmanith H-P, ed. Proceedings of 4th International Symposium on Rock Fragmentation by Blasting. A. A. Balkema; 1993: 263-271.

[31] Kulatilake PHSW, Qiong W, Hudaverdi T, Kuzu C. Mean particle size prediction in rock blast fragmentation using neural networks. Eng Geol. 2010; 114: 298-311.

[32] Lahmiri S, Bekiros S, Avdoulas C. A comparative assessment of machine learning methods for predicting housing prices using Bayesian optimization. Decision Analyt J. 2023; 6:100166.

[33] Lawal AI. A new modification to the Kuz-Ram model using the fragment size predicted by image analysis. Int J Rock Mech Mining Sci. 2021; 138:104595.

[34] Li D, Armaghani DJ, Zhou J, Lai SH, Hasanipanah M. A GMDH predictive model to predict rock material strength using three nondestructive tests. J Nondestr Eval. 2020; 39: 81.

[35] Li D, Koopialipoor M, Armaghani DJ. A combination of fuzzy Delphi method and ANN-based models to investigate factors of flyrock induced by mine blasting. Nat Res Res. 2021; 30: 1905-1924.

[36] Li D, Liu Z, Armaghani DJ, Xiao P, Zhou J. Novel ensemble intelligence methodologies for rockburst assessment in complex and variable environments. Sci Rep. 2022a; 12(1): 1844.

[37] Li D, Liu Z, Armaghani DJ, Xiao P, Zhou J. Novel ensemble tree solution for rockburst prediction using deep forest. Mathematics. 2022b; 10(5):787.

[38] Li D, Zhao J, Liu Z. A novel method of multitype hybrid rock lithology classification based on convolutional neural networks. Sensors. 2022; 22(4):1574.

[39] Li D, Zhao J, Ma J. Experimental studies on rock thin-section image classification by deep learning-based approaches. Mathematics. 2022; 10(13):2317.

[40] Li E, Yang F, Ren M, Zhang X, Zhou J, Khandelwal M. Prediction of blasting mean fragment size using support vector regression combined with five optimization algorithms. J Rock Mech Geotech Eng. 2021; 13: 1380-1397.

[41] Liu Q, Wang X, Huang X, Yin X. Prediction model of rock mass class using classification and regression tree integrated AdaBoost algorithm based on TBM driving data. Tunnel Undergr Space Technol. 2020; 106:103595.

[42] Liu Z, Armaghani DJ, Fakharian P, et al. Rock strength estimation using several tree-based ML techniques. Comp Model Eng Sci. 2022; 133(3): 1-26.

[43] Mehrdanesh A, Monjezi M, Sayadi AR. Evaluation of effect of rock mass properties on fragmentation using robust techniques. Eng Comp. 2018; 34: 253-260.

[44] Momeni E, Jahed Armaghani D, Hajihassani M, Mohd Amin MF. Prediction of uniaxial compressive strength of rock samples using hybrid particle swarm optimization-based artificial neural networks. Measurement. 2015; 60: 50-63.

[45] Morin MA, Ficarazzo F. Monte Carlo simulation as a tool to predict blasting fragmentation based on the Kuz-Ram model. Comp Geosci. 2006; 32: 352-359.

[46] Nishida T. Data transformation and normalization. Japan J Clin Pathol. 2010; 58: 990-997.

[47] Ouchterlony F. The Swebrec^© function: linking fragmentation by blasting and crushing. Mining Technol. 2005; 114: 29-44.

[48] Pasupulety U, Anees AA, Anmol S, Mohan BR. Predicting stock prices using ensemble learning and sentiment analysis. Proceedings of the IEEE Second International Conference on Artificial Intelligence and Knowledge Engineering (AIKE). IEEE; 2019.

[49] Pedregosa F, Varoquaux G, Gramfort A, et al. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011; 12: 2825-2830.

[50] Pelikan M, Goldberg DE, Cantú-Paz E. BOA: the Bayesian optimization algorithm. Proceedings of the Genetic and Evolutionary Computation Conference GECCO-99. Morgan Kaufmann; 1999: 525-532.

[51] Polamuri SR, Srinivasi DK, Mohan DAK. Stock market prices prediction using random forest and extra tree regression. Int J Recent Technol Eng. 2019; 8: 1224-1228.

[52] Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. CatBoost: unbiased boosting with categorical features. arXiv 2017, arXiv:1706.09516. 2018.

[53] Qiao W, Zhao Y, Xu Y, et al. Deep learning-based pixel-level rock fragment recognition during tunnel excavation using instance segmentation model. Tunnel Undergr Space Technol. 2021; 115:104072.

[54] Sayadi A, Monjezi M, Talebi N, Khandelwal M. A comparative study on the application of various artificial neural networks to simultaneous prediction of rock fragmentation and backbreak. J Rock Mech Geotech Eng. 2013; 5: 318-324.

[55] Shehu SA, Yusuf KO, Hashim MHM. Comparative study of WipFrag image analysis and Kuz-Ram empirical model in granite aggregate quarry and their application for blast fragmentation rating. Geomech Geoeng. 2022; 17: 197-205.

[56] Snoek J, Larochelle H, Adams RP. Practical Bayesian optimization of machine learning algorithms. Adv Neural Inform Process Syst2012; 25: 2951-2959.

[57] Wang S, Zhou J, Li C, et al. Rockburst prediction in hard rock mines developing bagging and boosting tree-based ensemble techniques. J Cent South Univ. 2021; 28(2): 527-542.

[58] Wu Y, Ke Y, Chen Z, Liang S, Zhao H, Hong H. Application of alternating decision tree with AdaBoost and bagging ensembles for landslide susceptibility mapping. Catena. 2020; 187:104396.

[59] Yang B, Ding Y, Lu Z, Yao X, Lei T, Su Y. Intelligent computing of positive switching impulse breakdown voltage of rod-plane air gap based on extremely randomized trees algorithm. Electr Eng. 2021; 103: 3177-3187.

[60] Yang X, Wang Z, Zhou Z, et al. Lithology classification of acidic volcanic rocks based on parameter-optimized AdaBoost algorithm. Acta Pet Sin. 2019; 40: 457-467.

[61] Zhang Q, Hu W, Liu Z, Tan J. TBM performance prediction with Bayesian optimization and automated machine learning. Tunnel Undergr Space Technol. 2020; 103:103493.

[62] Zhang W, Wu C, Zhong H, Li Y, Wang L. Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization. Geosci Front. 2021; 12: 469-477.

[63] Zhang Y, Liu J, Shen W. A review of ensemble learning algorithms used in remote sensing applications. Appl Sci. 2022; 12(17):8654.

[64] Zhou J, Asteris PG, Armaghani DJ, Pham BT. Prediction of ground vibration induced by blasting operations through the use of the Bayesian network and random forest models. Soil Dyn Earthq Eng. 2020; 139:106390.

[65] Zhou J, Li E, Wei H, Li C, Qiao Q, Armaghani DJ. Random forests and cubist algorithms for predicting shear strengths of rockfill materials. Appl Sci. 2019; 9(8):1621.

RIGHTS & PERMISSIONS

2024 The Authors. Deep Underground Science and Engineering published by John Wiley & Sons Australia, Ltd on behalf of China University of Mining and Technology.