Surrounding rock classification from onsite images with deep transfer learning based on EfficientNet

Abstract

This paper proposes an accurate, efficient and explainable method for the classification of the surrounding rock based on a convolutional neural network (CNN). The state-of-the-art robust CNN model (EfficientNet) is applied to tunnel wall image recognition. Gaussian filtering, data augmentation and other data pre-processing techniques are used to improve the data quality and quantity. Combined with transfer learning, the generality, accuracy and efficiency of the deep learning (DL) model are further improved, and finally we achieve 89.96% accuracy. Compared with other state-of-the-art CNN architectures, such as ResNet and Inception-ResNet-V2 (IRV2), the presented deep transfer learning model is more stable, accurate and efficient. To reveal the rock classification mechanism of the proposed model, Gradient-weight Class Activation Map (Grad-CAM) visualizations are integrated into the model to enable its explainability and accountability. The developed deep transfer learning model has been applied to support the tunneling of the Xingyi City Bypass in the high mountain area of Guizhou, China, with great results.

Graphical abstract

Keywords

surrounding rock classification / convolutional neural network / EfficientNet / Gradient-weight Class Activation Map

References

[1] Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 2017, 60(6): 84–90

[2] SunYWangXTangX. Deep convolutional network cascade for facial point detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New Jersey: IEEE, 2013: 3476–3483

[3] Siruvuri S V, Budarapu P R, Paggi M. Influence of cracks on fracture strength and electric power losses in Silicon solar cells at high temperatures: deep machine learning and molecular dynamics approach. Applied Physics A, Materials Science & Processing, 2023, 129(6): 408

[4] Sharma S, Awasthi R, Sastry Y S, Budarapu P R. Physics-informed neural networks for estimating stress transfer mechanics in single lap joints. Journal of Zhejiang University—Science A, 2021, 22(8): 621–631

[5] Huang H, Li Q, Zhang D. Deep learning based image recognition for crack and leakage defects of metro shield tunnel. Tunnelling and Underground Space Technology, 2018, 77: 166–176

[6] Aksoy C O, Geniş M, Aldaş G U, Özacar V, Özer S C, Yılmaz Ö. A comparative study of the determination of rock mass deformation modulus by using different empirical approaches. Engineering Geology, 2012, 131: 19–28

[7] Goh A T C, Zhang W. Reliability assessment of stability of underground rock caverns. International Journal of Rock Mechanics and Mining Sciences, 2012, 55: 157–163

[8] Cha Y J, Choi W, Suh G, Mahmoudkhani S, Büyüköztürk O. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(9): 731–747

[9] Ran X, Xue L, Zhang Y, Liu Z, Sang X, He J. Rock classification from field image patches analyzed using a deep convolutional neural network. Mathematics, 2019, 7(8): 755–771

[10] Chen J, Yang T, Zhang D, Huang H, Tian Y. Deep learning based classification of rock structure of tunnel face. Geoscience Frontiers, 2021, 12(1): 395–404

[11] Sharma A, Liu X, Yang X, Shi D. A patch-based convolutional neural network for remote sensing image classification. Neural Networks, 2017, 95: 19–28

[12] Nogueira K, Penatti O A B, Dos Santos J A. Towards better exploiting convolutional neural networks for remote sensing scene classification. Pattern Recognition, 2017, 61: 539–556

[13] Perol T, Gharbi M, Denolle M. Convolutional neural network for earthquake detection and location. Science Advances, 2018, 4(2): e1700578

[14] Patel A K, Chatterjee S. Computer vision-based limestone rock-type classification using probabilistic neural network. Geoscience Frontiers, 2016, 7(1): 53–60

[15] KwokC Y TWongM SHoH CLoF L CKoF W Y. Deep learning approach for rock outcrops identification. In: Proceedings of 2018 Fifth International Workshop on Earth Observation and Remote Sensing Applications (EORSA). New Jersey: IEEE, 2018: 1–6

[16] Alférez G H, Vázquez E L, Ardila A M M, Clausen B L. Automatic classification of plutonic rocks with deep learning. Applied Computing and Geosciences, 2021, 10: 100061

[17] ChengGGuoW. Rock images classification by using deep convolution neural network. Journal of Physics: Conference Series, 2017, 887(1): 012089

[18] dos Anjos C E M, Avila M R V, Vasconcelos A G P, Pereira Neta A M, Medeiros L C, Evsukoff A G, Surmas R, Landau L. Deep learning for lithological classification of carbonate rock micro-CT images. Computational Geosciences, 2021, 25(3): 971–983

[19] Liang Y, Cui Q, Luo X, Xie Z. Research on classification of fine-grained rock images based on deep learning. Computational Intelligence and Neuroscience, 2021, (1): 5779740

[20] Li J, Zhang L, Wu Z, Ling Z, Cao X, Guo K, Yan F. Autonomous Martian rock image classification based on transfer deep learning methods. Earth Science Informatics, 2020, 13(3): 951–963

[21] SimonyanKZissermanA. Very deep convolutional networks for large-scale image recognition. 2014, arXiv:1409.1556

[22] Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J, Chen T. Recent advances in convolutional neural networks. Pattern Recognition, 2018, 77: 354–377

[23] TanMLeQ. Efficientnet: Rethinking model scaling for convolutional neural networks. 2019 arXiv: 1905.11946

[24] HeKZhangXRenSSunJ. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition. New Jersey: IEEE, 2016: 770–778

[25] Szegedy C, Ioffe S, Vanhoucke V, Alemi A. Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the AAAI Conference on Artificial Intelligence, 2017, 31(1): 4278–4284

[26] HeYLinJLiuZWangHLiL JHanS. Amc: Automl for model compression and acceleration on mobile devices. In: Proceedings of the European Conference on Computer Vision (ECCV). Berlin: Springer, 2018: 784–800

[27] TanMChenBPangRVasudevanVSandlerMHowardALeQ V. Mnasnet: Platform-aware neural architecture search for mobile. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Jersey: IEEE, 2019: 2820–2828

[28] Weiss K, Khoshgoftaar T M, Wang D D. A survey of transfer learning. Journal of Big Data, 2016, 3(1): 1–40

[29] Pan S J, Yang Q. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(10): 1345–1359

[30] ZeilerM DFergusR. Visualizing and understanding convolutional networks. In: Proceedings of the European Conference on Computer Vision (ECCV). Berlin: Springer, 2014: 818–833

[31] Fei-Fei L, Fergus R, Perona P. One-shot learning of object categories. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(4): 594–611

[32] KinnunenTKamarainenJ KLensuLLankinenJKälviäinenH. Making visual object categorization more challenging: Randomized caltech-101 data set. In: Proceedings of 20th International Conference on Pattern Recognition. New Jersey: IEEE, 2010: 476–479

[33] GriffinGHolubAPeronaP. Caltech-256 Object Category Dataset. Pasadena: California Institute of Technology, 2007

[34] DonahueJJiaYVinyalsOHoffmanJZhangNTzengEDarrellT. Decaf: A deep convolutional activation feature for generic visual recognition. In: Proceedings of the 31st International Conference on Machine Learning. Beijing: ACM, 2014: 647–655

[35] SharifR AAzizpourHSullivanJCarlssonS. CNN features off-the-shelf: an astounding baseline for recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. New Jersey: IEEE, 2014: 806–813

[36] ZhouBLapedrizaAXiaoJTorralbaAOlivaA. Learning deep features for scene recognition using places database. In: Advances in Neural Information Processing Systems. Massachusetts: MIT Press, 2014, 487–495

[37] Folk R L, Andrews P B, Lewis D W. Detrital sedimentary rock classification and nomenclature for use in New Zealand. New Zealand Journal of Geology and Geophysics, 1970, 13(4): 937–968

[38] White C G. A rock drillability index. Rocks & Minerals, 1969, 44(7): 490–490

[39] Shen Y J, Yan R X, Yang G S, Xu G L, Wang S Y. Comparisons of evaluation factors and application effects of the new [BQ] GSI system with international rock mass classification systems. Geotechnical and Geological Engineering, 2017, 35(6): 2523–2548

[40] Jefferies M G, Davies M P. Soil classification by the cone penetration test. Canadian Geotechnical Journal, 1991, 28(1): 173–176

[41] Guo S, Qi S, Saroglou C A B Q. a classification system for anisotropic rock mass based on China National Standard. Journal of Central South University, 2020, 27(10): 3090–3102

[42] Verma H, Siruvuri S V, Budarapu P R. A machine learning-based image classification of silicon solar cells. International Journal of Hydromechatronics., 2024, 7(1): 49–66

[43] ZhouBKhoslaALapedrizaAOlivaATorralbaA. Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. New Jersey: IEEE, 2016: 2921–2929

RIGHTS & PERMISSIONS

Higher Education Press