Immersive visualization of 3D subsurface ground model developed from sparse boreholes using virtual reality (VR)

Abstract

Analytics and visualization of multi-dimensional and complex geo-data, such as three-dimensional (3D) subsurface ground models, is critical for development of underground space and design and construction of underground structures (e.g., tunnels, dams, and slopes) in engineering practices. Although complicated 3D subsurface ground models now can be developed from site investigation data (e.g., boreholes) which is often sparse in practice, it remains a great challenge to visualize a 3D subsurface ground model with sophisticated stratigraphic variations by conventional two-dimensional (2D) geological cross-sections. Virtual reality (VR) technology, which has an attractive capability of constructing a virtual environment that links to the physical world, has been rapidly developed and applied to visualization in various disciplines recently. Leveraging on the rapid development of VR, this study proposes a framework for immersive visualization of 3D subsurface ground models in geo-applications using VR technology. The 3D subsurface model is first developed from limited borehole data in a data-driven manner. Then, a VR system is developed using related software and hardware devices currently available in the markets for immersive visualization and interaction with the developed 3D subsurface ground model. The results demonstrate that VR visualization of the 3D subsurface ground model in an immersive environment has great potential in revolutionizing the geo-practices from 2D cross-sections to a 3D immersive virtual environment in digital era, particularly for the emerging digital twins.

Keywords

Immersive visualization / 3D subsurface model / Virtual reality / Virtual environment / Interaction

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgement

The work was supported by the Research Grant Council of Hong Kong Special Administrative Region (Project No. CityU 11203322) and Shenzhen Science and Technology Innovation Commission (Shenzhen-Hong Kong-Macau Science and Technology Project (Category C) No. SGDX20210823104002020), China. The financial support is gratefully acknowledged.

References

[1] Andersen, K., Gaab, S. J., Sattarvand, J., & Harris, F. C. (2020). METS VR: Mining evacuation training simulator in virtual reality for underground mines. In Proceedings of the 17th International Conference on Information Technology-New Generations (ITNG 2020) (pp. 325-332).

[2] Anthes, C., García-Hernández, R. J., Wiedemann, M., & Kranzlmüller, D. (2016). State of the art of virtual reality technology. In In Proceedings of the 2016 IEEE Aerospace Conference (pp.1-19).

[3] Autodesk, Inc. (2023). Maya. Retrieved September 30, 2023, from https://autodesk.com/maya

[4] Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574-594.

[5] Beheiry, M., Doutreligne, S., Caporal, C., Ostertag, C., Dahan, M., & Masson, J. B. (2019). Virtual reality: Beyond visualization. Journal of Molecular Biology, 431(7), 1315-1321.

[6] Blanc, T., Beheiry, M., Caporal, C., Masson, J. B., & Hajj, B. (2020). Genuage: Visualize and analyze multidimensional single-molecule point cloud data in virtual reality. Nature Methods, 17(11), 1100-1102.

[7] Brooke, J. (1996). SUS: A ‘quick and dirty’ usability scale. In Usability evaluation in industry (pp. 189-194). London: Taylor & Francis.

[8] Caravaca, G., Le Mouélic, S., Mangold, N., L’Haridon, J., Le Deit, L., & Massé M. (2020). 3D digital outcrop model reconstruction of the Kimberley outcrop (Gale crater, Mars) and its integration into Virtual Reality for simulated geological analysis. Planetary and Space Science, 182, 104808.

[9] Chang, C., Bang, K., Wetzstein, G., Lee, B., & Gao, L. (2020). Toward the next-generation VR/AR optics: A review of holographic near-eye displays from a human-centric perspective. Optica, 7(11), 1563-1578.

[10] Ching, J. Y., & Phoon, K. K. (2020). Constructing a site-specific multivariate probability distribution using sparse, incomplete, and spatially variable (MUSIC-X) data. Journal of Engineering Mechanics, 146(7), 04020061.

[11] Ching, J. Y., Yang, Z. Y., & Phoon, K. K. (2021). Dealing with non-lattice data in three-dimensional probabilistic site characterization. Journal of Engineering Mechanics, 147(5), 06021003.

[12] Community, B. O. (2023). Blender - A 3D modelling and rendering package. Retrieved September 30, 2023, from http://www.blender.org

[13] Dasaka, S. M., & Zhang, L. M. (2012). Spatial variability of in situ weathered soil. Géotechnique, 62(5), 375-384.

[14] DINOloket (Data and Information on the Dutch Subsurface). (2023). Subsurface models. Retrieved September 30, 2023, from https://www.dinoloket.nl/en/subsurface-models

[15] Dionisio, J. D. N., Burns, W. G., III, & Gilbert, R. (2013). 3D virtual worlds and the metaverse: Current status and future possibilities. ACM Computing Surveys, 45(3), 1-38.

[16] Donalek, C., Djorgovski, S. G., Cioc, A., Wang, A., Zhang, J., Lawler, E., Yeh, S., Mahabal, A., Graham, M., Drake, A., Davidoff, S., Norris, J. S., & Longo, G. (2014). Immersive and collaborative data visualization using virtual reality platforms. In In 2014 IEEE International Conference on Big Data (Big Data) (pp. 609-614).

[17] Epic, Games. (2023). Unreal Engine. Retrieved September 30, 2023, from https://www.unrealengine.com

[18] ESRI (Environmental Systems Research Institute). (2023). ArcGIS desktop. Retrieved September 30, 2023, from https://www.esri.com/en-us/arcgis/products/arcgis-desktop

[19] Fan, Q. X., Zhou, S. W., & Ning, Y. (2015). Optimization design of foundation excavation for Xiluodu super-high arch dam in China. Journal of Rock Mechanics and Geotechnical Engineering, 7(2), 120-135.

[20] GEO. (2000). Geoguide 3—Guide to Rock and Soil Descriptions. Retrieved from https://www.cedd.gov.hk/filemanager/eng/content_110/eg3_20170829.pdf

[21] GEO. (2006). Foundation Design and Construction. Retrieved from https://www.cedd.gov.hk/filemanager/eng/content_148/ep1_2006.pdf

[22] Gerloni, I. G., Carchiolo, V., Vitello, F. R., Sciacca, E., Becciani, U., Costa, A., Riggi, S., Bonali, F. L., Russo, E., Fallati, L., Marchese, F., & Bicocca, M. (2018). Immersive virtual reality for earth sciences. In In 2018 Federated Conference on Computer Science and Information Systems (FedCSIS) (pp. 527-534).

[23] Hack, R., Orlic, B., Ozmutlu, S., Zhu, S. C., & Rengers, N. (2006). Three and more dimensional modelling in geo-engineering. Bulletin of Engineering Geology and the Environment, 65, 143-153.

[24] He, H. H., He, J., Xiao, J. Z., Zhou, Y. X., Liu, Y., & Li, C. (2020). 3D geological modeling and engineering properties of shallow superficial deposits: A case study in Beijing, China. Tunnelling and Underground Space Technology, 100, 103390.

[25] Hou, W. S., Yang, L., Deng, D. C., Ye, J., Clarke, K., Yang, Z. J., Zhuang, W. M., Liu, J. X., & Huang, J. C. (2016). Assessing quality of urban underground spaces by coupling 3D geological models: The case study of Foshan city, South China. Computers & Geosciences, 89, 1-11.

[26] Huang, Y., Paisley, J., Lin, Q., Ding, X. H., Fu, X. Y., & Zhang, X. P. (2014). Bayesian nonparametric dictionary learning for compressed sensing MRI. IEEE Transactions on Image Processing, 23(12), 5007-5019.

[27] Isleyen, E., & Duzgun, H. S. (2019). Use of virtual reality in underground roof fall hazard assessment and risk mitigation. International Journal of Mining Science and Technology, 29(4), 603-607.

[28] Jaud, M., Geoffroy, L., Chauvet, F., Durand, E., & Civet, F. (2022). Potential of a virtual reality environment based on very-highresolution satellite imagery for structural geology measurements of lava flows. Journal of Structural Geology, 158, 104569.

[29] Jørgensen, F., Høyer, A. S., Sandersen, P. B. E., He, X. L., & Foged, N. (2015). Combining 3D geological modelling techniques to address variations in geology, data type and density-An example from Southern Denmark. Computers & Geosciences, 81, 53-63.

[30] Joshua, J. (2017). Information bodies: computational anxiety in Neal Stephenson’s snow crash. Interdisciplinary Literary Studies, 19(1), 17-47.

[31] Jurado, J. M., Graciano, A., Ortega, L., & Feito, F. R. (2017). Web-based GIS application for real-time interaction of underground infrastructure through virtual reality. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (pp.1-4).

[32] Kalacska, M., Arroyo-Mora, J. P., & Lucanus, O. (2021). Comparing UAS LiDAR and structure-from-motion photogrammetry for peatland mapping and virtual reality (VR) visualization. Drones, 5(2), 36.

[33] Kharroubi, A., Hajji, R., Billen, R., & Poux, F. (2019). Classification and integration of massive 3d points clouds in a virtual reality (VR) environment. In 6th International Workshop LowCost 3D - Sensors, Algorithms, Applications (pp.165-171).

[34] Lewis, J. R. (2018). The system usability scale: Past, present, and future. International Journal of Human-Computer Interaction, 34(7), 577-590.

[35] Lin, C. R., Loffin, R. B., & Stark, T. (1998). Virtual reality for geosciences visualization. In Proceedings of the 3rd Asia Pacific Computer Human Interaction (pp.196-201).

[36] Lin, C. R., Loftin, R. B., & Nelson, H. R. (2000). Interaction with geoscience data in an immersive environment. In Proceedings of IEEE Virtual Reality 2000 (pp. 55-62).

[37] Linowes, J. (2015). Unity virtual reality projects. Birmingham: Packt Publishing.

[38] Liu, K. H., Chen, L., Li, L. X., Ren, H. W., & Wang, F. Y. (2023). MetaMining: Mining in the metaverse. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 53(6), 3858-3867.

[39] Lyu, B. R., Hu, Y., & Wang, Y. (2023). Data-driven development of threedimensional subsurface models from sparse measurements using Bayesian compressive sampling (BCS): A benchmarking study. ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering, 9(2), 04023010.

[40] Mack, K., & Ruud, R. (2019). Unreal Engine 4 Virtual Reality Projects:Build Immersive, Real-world VR Applications Using UE4, C++, and Unreal Blueprints. Birmingham: Packt Publishing.

[41] McCaffrey, M. (2017). Unreal engine VR Cookbook: Developing virtual reality with UE4 (game design). Boston: Addison-Wesley Professional.

[42] Meta Platforms, Inc. (2023). Meta Quest 2. Retrieved September 30, 2020, from https://www.meta.com/quest/products/quest-2/

[43] Mysiorek, J., Stead, D., Chang, O., Donati, D., Rosser, N., & Onsel, I. E. (2022). Virtual and Mixed Reality Geodatabases: The Importance of Integrating Engineering Geological Field Techniques with New Methods for Site Characterization. In GeoCalgary 2022 “Reflection on Resources” (pp. 1-8).

[44] Onsel, I. E., Donati, D., Stead, D., & Chang, O. (2018). Applications of virtual and mixed reality in rock engineering. In Proceedings of the 52nd U.S. Rock Mechanics/Geomechanics Symposium (pp.ARMA- 2018-798).

[45] Phoon, K. K., Ching, J. Y., & Shuku, T. (2022). Challenges in data-driven site characterization. Georisk: Assessment and Management of Risk for Engineered Systems and Geohazards, 16(1), 114-126.

[46] Shi, C., & Wang, Y. (2022a). Data-driven construction of Threedimensional subsurface geological models from limited Site-specific boreholes and prior geological knowledge for underground digital twin. Tunnelling and Underground Space Technology, 126, 104493.

[47] Shi, C., & Wang, Y. (2022b). Machine learning of three-dimensional subsurface geological model for a reclamation site in Hong Kong. Bulletin of Engineering Geology and Environment, 81(12), 504.

[48] Shuku, T., & Phoon, K. K. (2021). Three-dimensional subsurface modeling using Geotechnical Lasso. Computers and Geotechnics, 133, 104068.

[49] Shuku, T., & Phoon, K. K. (2023). Data-driven subsurface modelling using a Markov random field model. Georisk: Assessment and Management of Risk for Engineered Systems and Geohazards, 17(1), 41-63.

[50] Sutherland, I. E. (1965). The ultimate display. In Proceedings of the IFIP Congress (pp.506-508).

[51] Sutherland, I. E. (1968). A head-mounted three-dimensional display. In Proceedings of Fall Joint Computer Conference (pp.757-764).

[52] Tipping, M. E. (2001). Sparse Bayesian learning and the relevance vector machine. Journal of Machine Learning Research, 1, 211-244.

[53] Unity, Technologies. (2023). Unity Engine. Retrieved September 30, 2023 from https://unity.com/products

[54] Wang, D. X., Guo, Y., Liu, S. Y., Zhang, Y. R., Xu, W. L., & Xiao, J. (2019). Haptic display for virtual reality: Progress and challenges. Virtual Reality & Intelligent Hardware, 1(2), 136-162.

[55] Wang, Y., & Cao, Z. J. (2013). Probabilistic characterization of Young’s modulus of soil using equivalent samples. Engineering Geology, 159, 106-118.

[56] Wang, Y., & Zhao, T. Y. (2016). Interpretation of soil property profile from limited measurement data: A compressive sampling perspective. Canadian Geotechnical Journal, 53(9), 1547-1559.

[57] Wang, Y. T., Su, Z., Zhang, N., Xing, R., Liu, D. X., Luan, T. H., & Shen, X. M. (2022). A survey on metaverse: Fundamentals, security, and privacy. IEEE Communications Surveys & Tutorials, 25(1), 319-352.

[58] Webster, R., & Oliver, M. A. (2007). Geostatistics for Environmental Scientists. England: John Wiley and Sons.

[59] Wu, S. C., Zhang, J. M., & Wang, R. (2021). Machine learning method for CPTu based 3D stratification of New Zealand geotechnical database sites. Advanced Engineering Informatics, 50, 101397.

[60] Wu, X. C., Liu, G., Weng, Z. P., Tian, Y. P., Zhang, Z. T., Li, Y., & Chen, G. S. (2021). Constructing 3D geological models based on large-scale geological maps. Open Geosciences, 13(1), 851-866.

[61] Xiao, T., Li, D. Q., Cao, Z. J., Au, S. K., & Phoon, K. K. (2016). Threedimensional slope reliability and risk assessment using auxiliary random finite element method. Computers and Geotechnics, 79, 146-158.

[62] Xie, J. C., Yang, Z. J., Wang, X. W., Zeng, Q. R., Li, J. L., & Li, B. (2018). A virtual reality collaborative planning simulator and its method for three machines in a fully mechanized coal mining face. Arabian Journal for Science and Engineering, 43, 4835-4854.

[63] Zhang, H. (2017). Head-mounted display-based intuitive virtual reality training system for the mining industry. International Journal of Mining Science and Technology, 27(4), 717-722.

[64] Zhao, K., Janutolo, M., & Barla, G. (2012). A completely 3D model for the simulation of mechanized tunnel excavation. Rock Mechanics and Rock Engineering, 45, 475-497.

[65] Zhao, T. Y., & Wang, Y. (2020). Non-parametric simulation of nonstationary non-Gaussian 3D random field samples directly from sparse measurements using signal decomposition and Markov chain Monte Carlo (MCMC) simulation. Reliability Engineering & System Safety, 203, 107087.

[66] Zhao, T. Y., & Wang, Y. (2021). Statistical interpolation of spatially varying but sparsely measured 3D geo-data using compressive sensing and variational Bayesian inference. Mathematical Geosciences, 53, 1171-1199.

[67] Zhao, T. Y., Hu, Y., & Wang, Y. (2018). Statistical interpretation of spatially varying 2D geo-data from sparse measurements using Bayesian compressive sampling. Engineering Geology, 246, 162-175.

[68] Zhao, Y. H., Jiang, J. J., Chen, Y., Liu, R. C., Yang, Y. L., Xue, X. Y., & Chen, S. M. (2022). Metaverse: Perspectives from graphics, interactions and visualization. Visual Informatics, 6(1), 56-67.

[69] Zhu, X., Chu, J., Wang, K. D., Wu, S. F., Yan, W., & Chiam, K. (2021). Prediction of rockhead using a hybrid N-XGBoost machine learning framework. Journal of Rock Mechanics and Geotechnical Engineering, 13(6), 1231-1245.