Forecasting measured responses of structures using temporal deep learning and dual attention

Abstract

The objective of this study is to develop a novel and efficient model for forecasting the nonlinear behavior of structures in response to time-varying random excitation. The key idea is to design a deep learning architecture to leverage the relationships, between external excitations and structure’s vibration signals, and between historical values and future values, within multiple time-series data. The proposed method consists of two main steps: the first step applies a global attention mechanism to combine multiple-measured time series and time-varying excitation into a weighted time series before feeding it to a temporal architecture; the second step utilizes a self-attention mechanism followed by a fully connected layer to predict multi-step future values. The viability of the proposed method is demonstrated via two case studies involving synthetic data from a three-dimensional (3D) reinforced concrete structure and experimental data from an 18-story steel frame. Furthermore, comparison and robustness studies are carried out, showing that the proposed method outperforms conventional methods and maintains high performance in the presence of noise with an amplitude of less than 10%.

Graphical abstract

Keywords

structural dynamic / time-varying excitation / deep learning / signal processing / response forecasting

References

[1] Ghandourah E, Bendine K, Khatir S, Benaissa B, Banoqitah E M, Alhawsawi A M, Moustafa E B. Novel approach-based sparsity for damage localization in functionally graded material. Buildings, 2023, 13(7): 1768

[2] Benaissa B, Hocine N A, Khatir S, Riahi M K, Mirjalili S. Yuki algorithm and pod-RBF for elastostatic and dynamic crack identification. Journal of Computational Science, 2021, 55: 101451

[3] Al Thobiani F, Khatir S, Benaissa B, Ghandourah E, Mirjalili S, Wahab M A. A hybrid PSO and grey wolf optimization algorithm for static and dynamic crack identification. Theoretical and Applied Fracture Mechanics, 2022, 118: 103213

[4] Khatir A, Capozucca R, Khatir S, Magagnini E, Benaissa B, le Thanh C, Wahab M A. A new hybrid PSO-YUKI for double cracks identification in CFRP cantilever beam. Composite Structures, 2023, 311: 116803

[5] Ho L V, Trinh T T, de Roeck G, Bui-Tien T, Nguyen-Ngoc L, Wahab M A. An efficient stochastic-based coupled model for damage identification in plate structures. Engineering Failure Analysis, 2022, 131: 105866

[6] Ghandourah E, Khatir S, Banoqitah E M, Alhawsawi A M, Benaissa B, Wahab M A. Enhanced ANN predictive model for composite pipes subjected to low-velocity impact loads. Buildings, 2023, 13(4): 973

[7] Benaissa B, Khatir S, Jouini M S, Riahi M K. Optimal axial-probe design for foucault-current tomography: A global optimization approach based on linear sampling method. Energies, 2023, 16(5): 2448

[8] Tran V T, Nguyen T K, Nguyen-Xuan H, Wahab M A. Vibration and buckling optimization of functionally graded porous microplates using BCMO-ANN algorithm. Thin-walled Structures, 2023, 182: 110267

[9] Dang B L, Nguyen-Xuan H, Wahab M A. An effective approach for varans-VOF modelling interactions of wave and perforated breakwater using gradient boosting decision tree algorithm. Ocean Engineering, 2023, 268: 113398

[10] Nguyen T T, Dang V H, Nguyen H X. Efficient framework for structural reliability analysis based on adaptive ensemble learning paired with subset simulation. Structures, 2022, 45: 1738–1750

[11] Dang H V, Trestian R, Bui-Tien T, Nguyen H X. Probabilistic method for time-varying reliability analysis of structure via variational bayesian neural network. Structures, 2021, 34: 3703–3715

[12] Wang S, Wang H, Zhou Y, Liu J, Dai P, Du X, Wahab M A. Automatic laser profile recognition and fast tracking for structured light measurement using deep learning and template matching. Measurement, 2021, 169: 108362

[13] Nguyen D H, Wahab M A. Damage detection in slab structures based on two-dimensional curvature mode shape method and faster r-cnn. Advances in Engineering Software, 2023, 176: 103371

[14] Möller B, Reuter U. Prediction of uncertain structural responses using fuzzy time series. Computers & Structures, 2008, 86(10): 1123–1139

[15] Zhang R, Chen Z, Chen S, Zheng J, Buyukozturk O, Sun H. Deep long short-term memory networks for nonlinear structural seismic response prediction. Computers & Structures, 2019, 220: 55–68

[16] Samaniego E, Anitescu C, Goswami S, Nguyen-Thanh V M, Guo H, Hamdia K, Zhuang X, Rabczuk T. An energy approach to the solution of partial differential equations in computational mechanics via machine learning concepts, implementation and applications. Computer Methods in Applied Mechanics and Engineering, 2020, 362: 112790

[17] GuoHZhuangX RabczukT. A deep collocation method for the bending analysis of kirchhoff plate. 2021, arXiv: 2102.02617

[18] Zhuang X, Guo H, Alajlan N, Zhu H, Rabczuk T. Deep autoencoder based energy method for the bending, vibration, and buckling analysis of kirchhoff plates with transfer learning. European Journal of Mechanics-A/Solids, 2021, 87: 104225

[19] Guo H, Zhuang X, Chen P, Alajlan N, Rabczuk T. Stochastic deep collocation method based on neural architecture search and transfer learning for heterogeneous porous media. Engineering with Computers, 2022, 38(6): 5173–5198

[20] Guo H, Zhuang X, Chen P, Alajlan N, Rabczuk T. Analysis of three-dimensional potential problems in non-homogeneous media with physics-informed deep collocation method using material transfer learning and sensitivity analysis. Engineering with Computers, 2022, 38(6): 5423–5444

[21] Zhang R, Liu Y, Sun H. Physics-guided convolutional neural network (PHYCNN) for data-driven seismic response modeling. Engineering Structures, 2020, 215: 110704

[22] Oh B K, Park Y, Park H S. Seismic response prediction method for building structures using convolutional neural network. Structural Control and Health Monitoring, 2020, 27(5): 2519

[23] Yu Y, Yao H, Liu Y. Structural dynamics simulation using a novel physics-guided machine learning method. Engineering Applications of Artificial Intelligence, 2020, 96: 103947

[24] Xu Y, Lu X, Cetiner B, Taciroglu E. Real-time regional seismic damage assessment framework based on long short-term memory neural network. Computer-Aided Civil and Infrastructure Engineering, 2021, 36(4): 504–521

[25] Du X, Ma C, Zhang G, Li J, Lai Y K, Zhao G, Deng X, Liu Y J, Wang H. An efficient LSTM network for emotion recognition from multichannel EEG signals. IEEE Transactions on Affective Computing, 2020, 13(3): 1528–1540

[26] Gao Y, Ruan Y. Interpretable deep learning model for building energy consumption prediction based on attention mechanism. Energy and Building, 2021, 252: 111379

[27] Liu C, Zhang L, Niu J, Yao R, Wu C. Intelligent prognostics of machining tools based on adaptive variational mode decomposition and deep learning method with attention mechanism. Neurocomputing, 2020, 417: 239–254

[28] Zhang Y, Chen S, Cao W, Guo P, Gao D, Wang M, Zhou J, Wang T. Mffnet Multi-dimensional feature fusion network based on attention mechanism for semg analysis to detect muscle fatigue. Expert Systems with Applications, 2021, 185: 115639

[29] Kong F, Li J, Jiang B, Wang H, Song H. Integrated generative model for industrial anomaly detection via Bidirectional LSTM and attention mechanism. IEEE Transactions on Industrial Informatics, 2021, 19(1): 541–550

[30] Hsu C Y, Lu Y W, Yan J H. Temporal convolution-based long-short term memory network with attention mechanism for remaining useful life prediction. IEEE Transactions on Semiconductor Manufacturing, 2022, 35(2): 220–228

[31] Sun S, Liu J, Wang J, Chen F, Wei S, Gao H. Remaining useful life prediction for AC contactor based on MMPE and LSTM with dual attention mechanism. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 1–13

[32] He J, Yang H, Zhou S, Chen J, Chen M. A dual-attention mechanism multi-channel convolutional LSTM for short-term wind speed prediction. Atmosphere, 2022, 14(1): 71

[33] Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation, 1997, 9(8): 1735–1780

[34] KatharopoulosAVyasAPappasN FleuretF. Transformers are RNNs Fast autoregressive transformers with linear attention. 2020, arXiv: 2006.16236

[35] CholletF.. Deep Learning with Python. Shelter Island, NY: Manning Publications Co., 2021

[36] Wang C, Xiao J, Sun Z. Seismic analysis on recycled aggregate concrete frame considering strain rate effect. International Journal of Concrete Structures and Materials, 2016, 10(3): 307–323

[37] McKennaFFenves G LScottM H. Open System for Earthquake Engineering Simulation. University of California, Berkeley, accessed 2020-08-15. Available at the website of Opensees Berkeley

[38] FilippouF CPopov E PBerteroV V. Effects of Bond Deterioration on Hysteretic Behavior of Reinforced Concrete Joints. Report to the National Science Foundation. 1983

[39] HishamMYassin M. Nonlinear analysis of prestressed concrete structures under monotonic and cycling loads. Dissertation for the Doctoral Degree. Berkeley, CA: University of California, 1994

[40] USGeological SurveyCaliforniaGeological Survey. Center for Engineering Strong-Motion Data. 2020. Available at the website of Strongmotioncenter

[41] Marteau P F. Time warp edit distance with stiffness adjustment for time series matching. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 31(2): 306–318

[42] Salvador S, Chan P. Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis, 2007, 11(5): 561–580

[43] SeaboldSPerktold J. Statsmodels econometric and statistical modeling with python. In: Proceedings of the 9th Python in Science Conference. Texas: Scipy, 2010

[44] Chen T, He T, Benesty M, Khotilovich V, Tang Y. Xgboost extreme gradient boosting. R package version 0.4-2, 2015, 1(4): 1–4

[45] TheGPyOpt authors. Gpyopt A bayesian optimization framework in python. 2016. Available at the website of GitHub

[46] Lin X, Kato M, Zhang L, Nakashima M. Quantitative investigation on collapse margin of steel high-rise buildings subjected to extremely severe earthquakes. Earthquake Engineering and Engineering Vibration, 2018, 17: 445–457

[47] Xu H, Ren W X, Wang Z C. Deflection estimation of bending beam structures using fiber bragg grating strain sensors. Advances in Structural Engineering, 2015, 18(3): 395–403

[48] Dang V H, Vu T C, Nguyen B D, Nguyen Q H, Nguyen T D. Structural damage detection framework based on graph convolutional network directly using vibration data. Structures, 2022, 38: 40–51

Acknowledgements

This work was financially supported by the Hanoi University of Civil Engineering (Vietnam), ID 28{2023/KHXD-TD}.

Competing interests

The authors declare that they have no competing interests.

RIGHTS & PERMISSIONS

2024 Higher Education Press