Rockburst prediction based on data preprocessing and hyperband-RNN-DNN

Abstract

A data preprocessing workflow is proposed to address key challenges in rockburst data analysis, including dimensionality differences among various sample features, variations in data values within the same feature, missing data, poor data consistency, and sample class imbalance. The workflow is divided into four steps. Each step introduces multiple algorithms, which are sequentially combined according to the order of the four steps. Then, these coupled algorithms are utilized to preprocess the rockburst data set. The rockburst data set contains 459 samples, and the maximum tangential stress (MTS), the uniaxial compressive strength (UCS), the uniaxial tensile strength (UTS), the elastic strain energy index (WET), the rock stress factor (SCF), and the rock brittleness coefficient (B) are selected as the feature parameters. Subsequently, three architectures, Deep Neural Network (DNN), Convolutional Neural Network (CNN), and Recurrent Neural Network (RNN), are used to evaluate the data sets processed by different coupled algorithms. The hyperband algorithm is introduced to optimize the hyperparameters of the RNN model, and the prediction accuracy of different architectures is compared between the RNN model with dense layers and without dense layers. Finally, a rockburst prediction model based on data preprocessing and the Hyperband-DNN model is developed. The prediction results show that data preprocessing can significantly improve the model prediction accuracy; the model architecture with the highest prediction accuracy can be found quickly using the hyperband algorithm; and adding the dense layer can improve the stability and prediction accuracy of the model.

Keywords

data preprocessing / hyperband algorithm / hyperparameter optimization / RNN-DNN / rockburst prediction

References

[1] Adoko AC, Gokceoglu C, Wu L, Zuo QJ. Knowledge-based and data-driven fuzzy modeling for rockburst prediction. Int J Rock Mech Min Sci. 2013; 61: 86-95.

[2] Afraei S, Shahriar K, Madani SH. Developing intelligent classification models for rock burst prediction after recognizing significant predictor variables, section 1: literature review and data preprocessing procedure. Tunnel Undergr Space Technol. 2019; 83: 324-353.

[3] Askaripour M, Saeidi A, Rouleau A, Mercier-Langevin P. Rockburst in underground excavations: a review of mechanism, classification, and prediction methods. Underground Space. 2022; 7(4): 577-607.

[4] Basnet PMS, Mahtab S, Jin A. A comprehensive review of intelligent machine learning based predicting methods in long-term and short-term rock burst prediction. Tunnel Undergr Space Technol. 2023; 142: 105434.

[5] Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002; 16: 321-357.

[6] Demidova L, Klyueva I. SVM classification: Optimization with the SMOTE algorithm for the class imbalance problem. In: 2017 6th Mediterranean Conference on Embedded Computing (MECO). IEEE; 2017: 1-4.

[7] Dong L, Li X, PENG K. Prediction of rockburst classification using Random Forest. Trans Nonferrous Met Soc China. 2013; 23(2): 472-477.

[8] Fan Y, Lu W, Zhou Y, Yan P, Leng Z, Chen M. Influence of tunneling methods on the strainburst characteristics during the excavation of deep rock masses. Engineering Geology. 2016; 201: 85-95.

[9] Fan Y, Lu WB, Yan P, Chen M, Zhang YZ. Transient characters of energy changes induced by blasting excavation of deep-buried tunnels. Tunnel Undergr Space Technol. 2015; 49: 9-17.

[10] Ghasemi E, Gholizadeh H, Adoko AC. Evaluation of rockburst occurrence and intensity in underground structures using decision tree approach. Eng Comput. 2020; 36: 213-225.

[11] Gong F, Dai J, Xu L. A strength-stress coupling criterion for rockburst: inspirations from 1114 rockburst cases in 197 underground rock projects. Tunnel Undergr Space Technol. 2023; 142: 105396.

[12] Guo D, Chen H, Tang L, Chen Z, Samui P. Assessment of rockburst risk using multivariate adaptive regression splines and deep forest model. Acta Geotechnica. 2021; 1: 1-23.

[13] Guo J, Guo J, Zhang Q, Huang M. Research on rockburst classification prediction based on BP-SVM model. IEEE Access. 2022; 10: 50427-50447.

[14] Han H, Wang WY, Mao BH. Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning. In: International Conference on Intelligent Computing. Springer Berlin Heidelberg; 2005: 878-887.

[15] He M, Cheng T, Qiao Y, Li H. A review of rockburst: experiments, theories, and simulations. J Rock Mech Geotech Eng. 2023; 15(5): 1312-1353.

[16] He M, Ren F, Liu D. Rockburst mechanism research and its control. Int J Min Sci Technol. 2018; 28(5): 829-837.

[17] Hirata A, Kameoka Y, Hirano T. Safety management based on detection of possible rock bursts by AE monitoring during tunnel excavation. Rock Mech Rock Eng. 2007; 40: 563-576.

[18] Hu X, Huang L, Chen J, Li X, Zhang H. Rockburst prediction based on optimization of unascertained measure theory with normal cloud. Compl Intell Syst. 2023: 1-16.

[19] Keneti A, Sainsbury BA. Review of published rockburst events and their contributing factors. Eng Geol. 2018; 246: 361-373.

[20] Li D, Liu Z, Xiao P, Zhou J, Armaghani DJ. Intelligent rockburst prediction model with sample category balance using feedforward neural network and Bayesian optimization. Underground Space. 2022; 7(5): 833-846.

[21] Li L, Jamieson K, DeSalvo G, Rostamizadeh A, Talwalkar A. Hyperband: a novel bandit-based approach to hyperparameter optimization. J Mach Learn Res. 2018; 18(185): 1-52.

[22] Li M, Li K, Qin Q. A rockburst prediction model based on extreme learning machine with improved Harris Hawks optimization and its application. Tunnel Undergr Space Technol. 2023; 134: 104978.

[23] Li S, Kuang Z, Xiao Y, Qiao Z, Yang W. Rockburst tendency prediction based on an integrating method of combination weighting and matter-element extension theory: a case study in the Bayu Tunnel of the Sichuan-Tibet railway. Eng Geol. 2022; 308: 106796.

[24] Li Z, Zhao Y, Hu X, Botta N, Ionescu C, Chen G. Ecod: unsupervised outlier detection using empirical cumulative distribution functions. IEEE Trans Knowl Data Eng. 2022; 1: 00382.

[25] Liu FT, Ting KM, Zhou ZH. Isolation Forest. In: 2008 Eighth IEEE International Conference on Data Mining. IEEE; 2008: 413-422.

[26] Liu Q, Xue Y, Li G, et al. Application of KM-SMOTE for rockburst intelligent prediction. Tunnel Undergr Space Technol. 2023; 138: 105180.

[27] Luo H, Fang Y, Wang J, et al. Combined prediction of rockburst based on multiple factors and stacking ensemble algorithm. Underground Space. 2023; 13: 241-261.

[28] Ortlepp WD. RaSiM comes of age—a review of the contribution to the understanding and control of mine rockbursts. Proceedings of the Sixth International Symposium on Rockburst and Seismicity in Mines, Perth, Western Australia, 2005: 9–11.

[29] Pu Y, Apel DB, Liu V, Mitri H. Machine learning methods for rockburst prediction-state-of-the-art review. Int J Min Sci Technol. 2019; 29(4): 565-570.

[30] Pu Y, Apel DB, Wang C, Wilson B. Evaluation of burst liability in kimberlite using support vector machine. Acta Geophysica. 2018; 66: 973-982.

[31] Qiu D, Li X, Xue Y, et al. Analysis and prediction of rockburst intensity using improved D-S evidence theory based on multiple machine learning algorithms. Tunnel Undergr Space Technol. 2023; 140: 105331.

[32] Qiu Y, Zhou J. Short-term rockburst damage assessment in burst-prone mines: an explainable XGBOOST hybrid model with SCSO algorithm. Rock Mech Rock Eng. 2023; 56(12): 8745-8770.

[33] Qu H, Yang L, Zhu J, Chen S, Li B, Li B. A multi-index evaluation method for rockburst proneness of deep underground rock openings with attribute recognition model and its application. Int J Rock Mech Min Sci. 2022; 159: 105225.

[34] Rastegarmanesh A, Moosavi M, Kalhor A. A data-driven fuzzy model for prediction of rockburst. Georisk: Assess Manage Risk Eng Syst Geohazards. 2021; 15(2): 152-164.

[35] Sun J, Wang L, Zhang H, Shen Y. Application of fuzzy neural network in predicting the risk of rock burst. Proc Earth Planet Sci. 2009; 1(1): 536-543.

[36] Sun L, Hu N, Ye Y, et al. Ensemble stacking rockburst prediction model based on Yeo–Johnson, K-means SMOTE, and optimal rockburst feature dimension determination. Sci Rep. 2022; 12(1): 15352.

[37] Tan W, Hu N, Ye Y, Wu M, Huang Z, Wang X. Rockburst intensity classification prediction based on four ensemble learning. Chin J Rock Mech Eng. 2022; 41: 3250-3259.

[38] Wang C, Wu A, Lu H, Bao T, Liu X. Predicting rockburst tendency based on fuzzy matter–element model. Int J Rock Mech Min Sci. 2015; 75: 224-232.

[39] Wu S, Wu Z, Zhang C. Rock burst prediction probability model based on case analysis. Tunnel Undergr Space Technol. 2019; 93: 103069.

[40] Xia Y, Zhang H, Lin M, Yan Y. Prediction of tunnel rockbursts based on data preprocessing technology considering influences of stress gradient of surrounding rock. Chin J Geotech Eng. 2023; 45(10): 1987-1994.

[41] Xu C, Liu X, Wang E, Zheng Y, Wang S. Rockburst prediction and classification based on the ideal-point method of information theory. Tunnel Undergr Space Technol. 2018; 81: 382-390.

[42] Xue Y, Bai C, Kong F, et al. A two-step comprehensive evaluation model for rockburst prediction based on multiple empirical criteria. Engineering Geology. 2020; 268: 105515.

[43] Xue Y, Bai C, Qiu D, Kong F, Li Z. Predicting rockburst with database using particle swarm optimization and extreme learning machine. Tunnel Undergr Space Technol. 2020; 98: 103287.

[44] Yin X, Liu Q, Pan Y, Huang X, Wu J, Wang X. Strength of stacking technique of ensemble learning in rockburst prediction with imbalanced data: comparison of eight single and ensemble models. Nat Resour Res. 2021; 30: 1795-1815.

[45] Zhang S, Mu C, Feng X, Ma K, Guo X, Zhang X. Intelligent dynamic warning method of rockburst risk and level based on recurrent neural network. Rock Mech Rock Eng. 2024; 57: 3509-3529.

[46] Zhao JS, Duan SQ, Chen BR, et al. Failure mechanism of rock masses with complex geological conditions in a large underground cavern: a case study. Soil Dyn Earthq Eng. 2024; 177: 108439.

[47] Zhao JS, Jiang Q, Lu JF, Chen BR, Pei SF, Wang ZL. Rock fracturing observation based on microseismic monitoring and borehole imaging: in situ investigation in a large underground cavern under high geostress. Tunnel Undergr Space Technol. 2022; 126: 104549.

[48] Zhou J, Koopialipoor M, Li E, Armaghani DJ. Prediction of rockburst risk in underground projects developing a neuro-bee intelligent system. Bull Eng Geol Environ. 2020; 79: 4265-4279.

[49] Zhou J, Li X, Mitri HS. Evaluation method of rockburst: state-of-the-art literature review. Tunnel Undergr Space Technol. 2018; 81: 632-659.

[50] Zhou J, Li X, Shi X. Long-term prediction model of rockburst in underground openings using heuristic algorithms and support vector machines. Safety Science. 2012; 50(4): 629-644.

[51] Zhou J, Zhang Y, Li C, He H, Li X. Rockburst prediction and prevention in underground space excavation. Underground Space. 2024; 14: 70-98.

[52] Zhou K, LIN Y, Deng H, Li J, Liu C. Prediction of rock burst classification using cloud model with entropy weight. Trans Nonferrous Met Soc China. 2016; 26(7): 1995-2002.

Rights & permissions

2025 The Author(s). Deep Underground Science and Engineering published by John Wiley & Sons Australia, Ltd on behalf of China University of Mining and Technology.