Enhancing deformation characteristics prediction of coarse-grained soils with time-series generative adversarial network-based data augmentation and pre-training

Abstract

Coarse-grained soils are fundamental to major infrastructures like embankments, roads, and bridges. Understanding their deformation characteristics is essential for ensuring structural stability. Traditional methods, such as triaxial compression tests and numerical simulations, face challenges like high costs, time consumption, and limited generalizability across different soils and conditions. To address these limitations, this study employs deep learning to predict the volumetric strain of coarse-grained soils as axial strain changes, aiming to obtain the axial strain ({\epsilon }_{\mathrm{a}})–volumetric strain ({\epsilon }_{\mathrm{v}}) curve, which helps derive key mechanical parameters like cohesion (c), and elastic modulus (E). However, the limited data from triaxial tests poses challenges for training deep learning models. We propose using a Time-series Generative Adversarial Network (TimeGAN) for data augmentation. Additionally, we apply feature importance analysis to assess the quality of the numerical augmented data, providing feedback for improving the TimeGAN model. To further enhance model performance, we introduce the pre-training strategy to reduce bias between augmented and real data. Experimental results demonstrate that our approach effectively predicts {\epsilon }_{\mathrm{a}}–{\epsilon }_{\mathrm{v}} curve, with the mean absolute error (MAE) of 0.2219 and the R² of 0.9155. The analysis aligns with established findings in soil mechanics, underscoring the potential of our method in engineering applications.

Graphical abstract

Keywords

coarse-grained soils / deformation characteristics / TimeGAN / data augmentation / pre-training

References

[1] He Z M, Xiang D, Liu Y X, Gao Q F, Bian H B. Deformation behavior of coarse-grained soil as an embankment filler under cyclic loading. Advances in Civil Engineering, 2020, 2020(1): 4629105

[2] Zhang X T, Gao Y Z, Wang Y, Yu Y Z, Sun X. Experimental study on compaction-induced anisotropic mechanical property of rockfill material. Frontiers of Structural and Civil Engineering, 2021, 15(1): 109–123

[3] Liu X Y, Zou D G, Liu J M, Zheng B W. Predicting the small strain shear modulus of coarse-grained soils. Soil Dynamics and Earthquake Engineering, 2021, 141: 106468

[4] Chen J H, Zhang Y J, Yang Y X, Yang B, Huang B C, Ji X P. Influence of coarse grain content on the mechanical properties of red sandstone soil. Sustainability, 2023, 15(4): 3117

[5] Li S Y, Wang T C, Wang H, Jiang M J, Zhu J A. Experimental studies of scale effect on the shear strength of coarse-grained soil. Applied Sciences—Basel, 2022, 12(1): 447

[6] Le Q H, Nguyen D H, Sang-To T, Khatir S, Le-Minh H, Gandomi A H, Cuong-Le T. Machine learning based models for predicting compressive strength of geopolymer concrete. Frontiers of Structural and Civil Engineering, 2024, 18(7): 1028–1049

[7] Khuntia S, Mujtaba H, Patra C, Farooq K, Sivakugan N, Das B M. Prediction of compaction parameters of coarse grained soil using multivariate adaptive regression splines (MARS). International Journal of Geotechnical Engineering, 2015, 9(1): 79–88

[8] Ikeagwuani C C, Nwonu D C. Statistical analysis and prediction of spatial resilient modulus of coarse-grained soils for pavement subbase and base layers using MLR, ANN and Ensemble techniques. Innovative Infrastructure Solutions, 2022, 7(4): 273

[9] Verma G, Kumar B. Multi-layer perceptron (MLP) neural network for predicting the modified compaction parameters of coarse-grained and fine-grained soils. Innovative Infrastructure Solutions, 2022, 7(1): 78

[10] Anitescu C, Atroshchenko E, Alajlan N, Rabczuk T. Artificial neural network methods for the solution of second order boundary value problems. Computers, Materials & Continua, 2019, 59(1): 345–359

[11] Samaniego E, Anitescu C, Goswami S, Nguyen-Thanh V M, Guo H, Hamdia K, Zhuang X, Rabczuk T. An energy approach to the solution of partial differential equations in computational mechanics via machine learning: Concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 2020, 362: 112790

[12] Shrestha A, Mahmood A. Review of deep learning algorithms and architectures. IEEE Access: Practical Innovations, Open Solutions, 2019, 7: 53040–53065

[13] Qu T M, di S C, Feng Y T, Wang M, Zhao T T, Wang M Q. Deep learning predicts stress–strain relations of granular materials based on triaxial testing data. CMES—Computer Modeling in Engineering and Sciences, 2021, 128(1): 129–144

[14] Shorten C, Khoshgoftaar T M. A survey on image data augmentation for deep learning. Journal of Big Data, 2019, 6(1): 60

[15] Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 2017, 60(6): 84–90

[16] Islam Z, Abdel-Aty M, Cai Q, Yuan J H. Crash data augmentation using variational autoencoder. Accident Analysis and Prevention, 2021, 151: 105950

[17] Ohno H. Auto-encoder-based generative models for data augmentation on regression problems. Soft Computing, 2020, 24(11): 7999–8009

[18] Delgado J M D, Oyedele L. Deep learning with small datasets: using autoencoders to address limited datasets in construction management. Applied Soft Computing, 2021, 112: 107836

[19] GoodfellowI JPouget-AbadieJMirzaM XuBWarde-Farley DOzairSCourvilleABengioY. Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence N D, Weinberger K Q, eds. Advances in Neural Information Processing Systems 27 (NIPS 2014). Quebec: Institute of Electrical and Electronics Engineers (IEEE), 2014, 2672−2680

[20] Jiang X, Ge Z. RAGAN: Regression attention generative adversarial networks. IEEE Transactions on Artificial Intelligence, 2023, 4(6): 1549–1563

[21] Ma Z R, Wang J J, Feng Y S, Wang R K, Zhao Z H, Chen H W. Hydrogen yield prediction for supercritical water gasification based on generative adversarial network data augmentation. Applied Energy, 2023, 336: 120814

[22] YoonJJarrett Dvan der SchaarM. Time-series generative adversarial networks. In: Wallach H, Larochelle H, Beygelzimer A, d’Alche-Buc F, Fox E, Garnett R, eds. Advances in Neural Information Processing Systems 32 (NIPS 2019). Vancouver: Neural Information Processing Systems Foundation (NeurIPS), 2019: 5508–5518

[23] Zhang Y F, Zhou Z H, Liu J W, Yuan J J. Data augmentation for improving heating load prediction of heating substation based on TimeGAN. Energy, 2022, 260: 124919

[24] Wang Y, Song M, Jia M, Shi L, Li B. TimeGAN based distributionally robust optimization for biomass-photovoltaic-hydrogen scheduling under source-load-market uncertainties. Energy, 2023, 284: 128589

[25] Liang T, Wang F L, Wang S, Li K, Mo X L, Lu D. Machinery Health Prognostic with Uncertainty for Mineral Processing using TSC-TimeGAN. Reliability Engineering & System Safety, 2024, 246: 110055

[26] WangYZhang JWangY. Do generated data always help contrastive learning? 2024, arXiv:2403.12448

[27] HendrycksDLee KMazeikaM. Using pre-training can improve model robustness and uncertainty. In: Chaudhuri K, Salakhutdinov R, eds. Proceedings of the 36th International Conference on Machine Learning. Long Beach, CA: Association for the Advancement of Artificial Intelligence, 2019, 2712–2721

[28] Zafar M R, Khan N. Deterministic local interpretable model-agnostic explanations for stable explainability. Machine Learning and Knowledge Extraction, 2021, 3(3): 525–541

[29] LundbergS MLee S I. A unified approach to interpreting model predictions. In: Guyon I, Luxburg U V, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, eds. Advances in Neural Information Processing Systems 30 (NIPS 2017). Long Beach, CA: Neural Information Processing Systems Foundation (NeurIPS), 2017: 1705.07874

[30] Meng F, Zhang J S, Chen X B, Wang Q Y. Deformation characteristics of coarse-grained soil with various gradations. Journal of Central South University, 2014, 21(6): 2469–2476

[31] Ahmed S S, Martinez A, DeJong J T. Effect of gradation on the strength and stress-dilation behavior of coarse-grained soils in drained and undrained triaxial compression. Journal of Geotechnical and Geoenvironmental Engineering, 2023, 149(5): 04023019

[32] JiangJ SLiu H LChengZ LDingHZouY Z. Influences of density and confining pressure on mechanical properties for coarse-grained soils. Journal of Changjiang River Scientific Research, 2009, 26(8): 46–50 (in Chinese)

RIGHTS & PERMISSIONS

Higher Education Press