A stacked multiple kernel support vector machine for blast induced flyrock prediction

Abstract

As a widely used rock excavation method in civil and mining construction works, the blasting operations and the induced side effects are always investigated by the existing studies. The occurrence of flyrock is regarded as one of the most important issues induced by blasting operations, since the accurate prediction of which is crucial for delineating safety zone. For this purpose, this study developed a flyrock prediction model based on 234 sets of blasting data collected from Sugun Copper Mine site. A stacked multiple kernel support vector machine (stacked MK-SVM) model was proposed for flyrock prediction. The proposed stacked structure can effectively improve the model performance by addressing the importance level of different features. For comparison purpose, 6 other machine learning models were developed, including SVM, MK-SVM, Lagragian Twin SVM (LTSVM), Artificial Neural Network (ANN), Random Forest (RF) and M5 Tree. This study implemented a 5-fold cross validation process for hyperparameters tuning purpose. According to the evaluation results, the proposed stacked MK-SVM model achieved the best overall performance, with RMSE of 1.73 and 1.74, MAE of 0.58 and 1.08, VAF of 98.95 and 99.25 in training and testing phase, respectively.

Keywords

Multiple kernel learning / Support vector machine / Stacked model / Flyrock prediction

References

[[1]] K. Manoj, M. Monjezi, "Prediction of flyrock in open pit blasting operation using machine learning method,", Int. J. Min. Sci. Technol. 23 (2013) 313-316.

[[2]] T. Singh, V. Singh, "An intelligent approach to prediction and control ground vibration in mines,", Geotech. Geol. Geol. Eng. 23 (2005) 249-262.

[[3]] M. Rezaei, M. Monjezi, A.Y. Varjani, "Development of a fuzzy model to predict flyrock in surface mining,", Saf. Sci. 49 (2011) 298-305.

[[4]] M. Hajihassani, D.J. Armaghani, H. Sohaei, E.T. Mohamad, A. Marto, "Prediction of airblast-overpressure induced by blasting using a hybrid artificial neural network and particle swarm optimization,", Appl. Acoust. 80 (2014) 57-67.

[[5]] R. Zhang, Y. Li, Y. Gui, J. Zhou, "Prediction of blasting induced air-overpressure using a radial basis function network with an additional hidden layer,", Appl. Soft Comput. 127 (2022) 109343.

[[6]] Y. Gui, Z. Zhao, L. Jayasinghe, H. Zhou, A. Goh, M. Tao, Blast wave induced spatial variation of ground vibration considering field geological conditions, Int. J. Rock Mech. Min. 101 (2018) 63-68.

[[7]] B. Jayasinghe, Z. Zhao, A.T.C. Goh, H. Zhou, Y. Gui, "Attenuation of rock blasting induced ground vibration in rock-soil interface,",. J. Rock Mech. Geotech. Eng. 11 (2019) 770-778.

[[8]] Y.L. Gui, Z.Y. Zhao, H.Y. Zhou, A.T.C. Goh, L.B. Jayasinghe, Jayasinghe, "Numerical simulation of rock blasting induced free field vibration,", Procedia Eng. 191 (2017/01/01/2017) 451-457.

[[9]] L.B. Jayasinghe, H. Zhou, A. Goh, Z. Zhao, Y. Gui, "Pile response subjected to rock blasting induced ground vibration near soil-rock interface,", Comput. Geotech. 82 (2017) 1-15.

[[10]] D. Ali, H. Abbas, T. Abdullah, "Numerical analysis of stress distribution during tunneling in clay stone rock,", Int. J. Eng. 33 (2020) 1472-1478.

[[11]] D. Li, M. Koopialipoor, D.J. Armaghani "A combination of fuzzy Delphi method and ANN-based models to investigate factors of flyrock induced by mine blasting,", Nat. Resour. Res. 30 (2021) 1905-1924.

[[12]] R.S. Faradonbeh, D. Jahed Armaghani, M. Monjezi, "Development of a new model for predicting flyrock distance in quarry blasting: a genetic programming technique,", Bull. Eng. Geol. Environ. 75 (2016) 993-1006.

[[13]] E. Ghasemi, M. Sari, M. Ataei, "Development of an empirical model for predicting the effects of controllable blasting parameters on flyrock distance in surface mines,",Rock Mech Int. J. Rock Mech. Min. Sci. 52 (2012) 163-170.

[[14]] S. Bhandari, "Engineering Rock Blasting Operations,", 1997.

[[15]] T. Bajpayee, T. Rehak, G. Mowrey, D. Ingram, Blasting injuries in surface mining with emphasis on flyrock and blast area security, J. Saf. Res. 35 (2004) 47-57.

[[16]] T. Little, D. Blair, "Mechanistic Monte Carlo models for analysis of flyrock risk,", Rock fragmentation by blasting 9 (2010) 641-647.

[[17]] J. Roth, A Model for the Determination of Flyrock Range as a Function of Shot Conditions, NTIS, 1979.

[[18]] J. Workman, P. Calder, Flyrock prediction and control in surface mine blasting, International Society of Explosives Engineers, Cleveland, OH (United States), 1994.

[[19]] N. Lundborg, A. Persson, A. Ladegaard-Pedersen, R. Holmberg, "Keeping the lid on flyrock in open-pit blasting,", Eng. Min. J. 176 (1975) 95-100.

[[20]] H. Amini, R. Gholami, M. Monjezi, S.R. Torabi, J. Zadhesh, "Evaluation of flyrock phenomenon due to blasting operation by support vector machine,", Neural Comput. Appl. 21 (2012) 2077-2085.

[[21]] A. Aghajani-Bazzazi, M. Osanloo, Y. Azimi, "Flyrock prediction by multiple regression analysis in Esfordi phosphate mine of Iran," , in:Proceedings of the 9th International Symposium on Rock Fragmentation by Blasting, Granada, Spain, 2009, pp. 649-657.

[[22]] R. Zhang, Z. Cheng, Z. Zhang, Z. Chen, R. Ernst, M. Santosh, "Formation of tarim large igneous province and strengthened lithosphere revealed through machine learning,", J. Geophys. Res. Solid Earth 128 (2023) e2022JB025772.

[[23]] G. Zhang, N.S. Hamzehkolaei, H. Rashnoozadeh, S.S. Band, A. Mosavi, "Reliability assessment of compressive and splitting tensile strength prediction of roller compacted concrete pavement: introducing MARS-Goa-MCS," Int. J. Pavement Eng. 23 (2022) 5030-5047.

[[24]] R. Zhang, C. Zhang, M. Yu, "A similar day based short term load forecasting method using wavelet transform and LSTM,", IEEJ Trans. Electr. Electron. Eng. 17 (2022) 506-513.

[[25]] J. Zhou, Y. Qiu, M. Khandelwal, S. Zhu, X. Zhang, "Developing a hybrid model of Jaya algorithm-based extreme gradient boosting machine to estimate blast-induced ground vibrations,", Int. J. Rock Mech. Min. Sci. 145 (2021) 104856.

[[26]] P.G. Asteris, P.B. Lourenço, P.C. Roussis, C.E. Adami, D.J. Armaghani, L. Cavaleri, et al., "Revealing the nature of metakaolin-based concrete materials using artificial intelligence techniques,", Construct. Build. Mater. 322 (2022) 126500.

[[27]] R. Trivedi, T. Singh, A. Raina, "Prediction of blast-induced flyrock in Indian limestone mines using neural networks,", J. Rock Mech. Geotech. Eng. 6 (2014) 447-454.

[[28]] E. Ghasemi, H. Amini, M. Ataei, R. Khalokakaei, "Application of artificial intelligence techniques for predicting the flyrock distance caused by blasting operation,", Arabian J. Geosci. 7 (2014) 193-202.

[[29]] H. Guo, J. Zhou, M. Koopialipoor, D. Jahed Armaghani, M. Tahir, "Deep neural network and whale optimization algorithm to assess flyrock induced by blasting,", Eng. Comput. 37 (2021) 173-186.

[[30]] E.T. Mohamad, D.J. Armaghani, M. Hajihassani, K. Faizi, A. Marto, "A simulation approach to predict blasting-induced flyrock and size of thrown rocks,", Electron. J. Geotech. Eng. 18 (2013) 365-374.

[[31]] M. Monjezi, A. Mehrdanesh, A. Malek, M. Khandelwal, "Evaluation of effect of blast design parameters on flyrock using artificial neural networks,", Neural Comput. Appl. 23 (2013) 349-356.

[[32]] A. Saghatforoush, M. Monjezi, R. Shirani Faradonbeh, D. Jahed Armaghani, "Combination of neural network and ant colony optimization algorithms for prediction and optimization of flyrock and back-break induced by blasting,", Eng. Comput. 32 (2016) 255-266.

[[33]] R. Trivedi, T. Singh, N. Gupta, Prediction of blast-induced flyrock in opencast mines using ANN and ANFIS, Geotech. Geol. Eng. 33 (2015) 875-891.

[[34]] B.R. Murlidhar, H. Nguyen, J. Rostami, X. Bui, D.J. Armaghani, P. Ragam, et al., "Prediction of flyrock distance induced by mine blasting using a novel Harris Hawks optimization-based multi-layer perceptron neural network,", J. Rock Mech. Geotech. Eng. 13 (2021) 1413-1427.

[[35]] A. Marto, M. Hajihassani, D. Jahed Armaghani, E. Tonnizam Mohamad, A. M. Makhtar, "A novel approach for blast-induced flyrock prediction based on imperialist competitive algorithm and artificial neural network,", Sci. World J, 2014.

[[36]] M. Monjezi, H. Amini Khoshalan, A. Yazdian Varjani, "Prediction of flyrock and backbreak in open pit blasting operation: a neuro-genetic approach,", Arabian J. Geosci. 5 (2012).

[[37]] M. Hasanipanah, B. Keshtegar, D.-K. Thai, N.-T. Troung, "An ANN-adaptive dynamical harmony search algorithm to approximate the flyrock resulting from blasting,", Eng. Comput. (2022) 1-13.

[[38]] M. Koopialipoor, A. Fallah, D.J. Armaghani, A. Azizi, E.T. Mohamad, "Three hybrid intelligent models in estimating flyrock distance resulting from blasting,", Eng. Comput. 35 (2019) 243-256.

[[39]] B.R. Murlidhar, D. Kumar, D. Jahed Armaghani, E.T. Mohamad, B. Roy, B.T. Pham, "A novel intelligent ELM-BBO technique for predicting distance of mine blasting-induced flyrock,", Nat. Resour. Res. 29 (2020) 4103-4120.

[[40]] D. Jahed Armaghani, E. Tonnizam Mohamad, M. Hajihassani, S. Alavi Nezhad Khalil Abad, A. Marto, M. Moghaddam, "Evaluation and prediction of flyrock resulting from blasting operations using empirical and computational methods,", Eng. Comput. 32 (2016) 109-121.

[[41]] M. Hasanipanah, R.S. Faradonbeh, D.J. Armaghani, H.B. Amnieh, M. Khandelwal, "Development of a precise model for prediction of blast-induced flyrock using regression tree technique,", Environ. Earth Sci. 76 (2017) 1-10.

[[42]] M. Barkhordari, D. Armaghani, P. Fakharian, "Ensemble machine learning models for prediction of flyrock due to quarry blasting,", Int. J. Environ. Sci. Technol. 19 (2022) 8661-8676.

[[43]] J. Ye, M. Koopialipoor, J. Zhou, D.J. Armaghani, X. He, "A novel combination of tree-based modeling and Monte Carlo simulation for assessing risk levels of flyrock induced by mine blasting,", Nat. Resour. Res. 30 (2021) 225-243.

[[44]] M. Yari, D.J. Armaghani, C. Maraveas, A.N. Ejlali, E.T. Mohamad, P.G. Asteris, "Several tree-based solutions for predicting flyrock distance due to mine blasting,", Appl. Sci. 13 (2023) 1345.

[[45]] H.N. Rad, M. Hasanipanah, M. Rezaei, A.L. Eghlim, "Developing a least squares support vector machine for estimating the blast-induced flyrock,", Eng. Comput. 34 (2018) 709-717.

[[46]] H. Nguyen, X.-N. Bui, Y. Choi, C.W. Lee, D.J. Armaghani, "A novel combination of whale optimization algorithm and support vector machine with different kernel functions for prediction of blasting-induced fly-rock in quarry mines,",. Nat. Resour. Res. 30 (2021) 191-207.

[[47]] C. Li, J. Zhou, K. Du, D.J. Armaghani, S. Huang, "Prediction of flyrock distance in surface mining using a novel hybrid model of Harris hawks optimization with multi-strategies-based support vector regression,",. Nat. Resour. Res. (2023) 1-29.

[[48]] C. Cortes, V. Vapnik, "Support-vector networks,", Mach. Learn. 20 (1995) 273-297.

[[49]] C. Cortes, V. Vapnik, "Support vector machine,", Mach. Learn. 20 (1995) 273-297.

[[50]] J.C. Platt, "12 fast training of support vector machines using sequential minimal optimization,". Advances in Kernel Methods, 1999, pp. 185-208.

[[51]] R.-E. Fan, P.-H. Chen, C.-J. Lin, T. Joachims, "Working set selection using second order information for training support vector machines,", RJ. Mach. Learn. Res. 6 (2005).

[[52]] M. Kloft, U. Brefeld, S. Sonnenburg, A. Zien, "Lp-norm multiple kernel learning,",. J. Mach. Learn. Res. 12 (2011) 953-997.

[[53]] J. Bi, K. Bennett, M. Embrechts, C. Breneman, M. Song, "Dimensionality reduction via sparse support vector machines,", J. Mach. Learn. Res. 3 (2003) 1229-1243.

[[54]] F. L€ow, U. Michel, S. Dech, C. Conrad, "Impact of feature selection on the accuracy and spatial uncertainty of per-field crop classification using support vector machines,", ISPRS J. Photogrammetry Remote Sens. 85 (2013) 102-119.

[[55]] M. Tanveer, K. Shubham, A regularization on Lagrangian twin support vector regression, Int. J. Machine Learn. Cybern. 8 (2017) 807-821.

[[56]] X. Peng, "TSVR: an efficient twin support vector machine for regression,", Neural Network. 23 (2010) 365-372.

[[57]] H.I. Burgan, H. Aksoy, Daily flow duration curve model for ungauged intermittent subbasins of gauged rivers, J. Hydrol. 604 (Jan 2022).

[[58]] D.N. Moriasi, J.G. Arnold, M.W. Van Liew, R.L. Bingner, R.D. Harmel, T.L. Veith, Model evaluation guidelines for systematic quantification of accuracy in watershed simulations, Transac. Asabe 50 (May-Jun 2007) 885-900.

[[59]] Y. Li, X. Lei, N. Wang, Y. Ren, X. Jin, G. Li, et al., Study on the failure characteristics of overburden and the evolution law of seepage field in deep buried thick coal seam under aquifers, Nat. Hazards 118 (2023) 1035-1064.