CNN-LSTM based incremental attention mechanism enabled phase-space reconstruction for chaotic time series prediction
To improve the prediction accuracy of chaotic time series and reconstruct a more reasonable phase space structure of the prediction network, we propose a convolutional neural network (CNN)-long short-term memory (LSTM) prediction model based on the incremental attention mechanism. Firstly, a traversal search is conducted through the traversal layer for finite parameters in the phase space. Then, an incremental attention layer is utilized for parameter judgment based on the dimension weight criteria (DWC). The phase space parameters that best meet DWC are selected and fed into the input layer. Finally, the constructed CNN-LSTM network extracts spatiotemporal features and provides the final prediction results. The model is verified using Logistic, Lorenz, and sunspot chaotic time series, and the performance is compared from the two dimensions of prediction accuracy and network phase space structure. Additionally, the CNN-LSTM network based on incremental attention is compared with LSTM, CNN, recurrent neural network (RNN), and support vector regression (SVR) for prediction accuracy. The experiment results indicate that the proposed composite network model possesses enhanced capability in extracting temporal features and achieves higher prediction accuracy. Also, the algorithm to estimate the phase space parameter is compared with the traditional CAO, false nearest neighbor, and C-C, three typical methods for determining the chaotic phase space parameters. The experiments reveal that the phase space parameter estimation algorithm based on the incremental attention mechanism is superior in prediction accuracy compared with the traditional phase space reconstruction method in five networks, including CNN-LSTM, LSTM, CNN, RNN, and SVR.
Chaotic time series / Incremental attention mechanism / Phase-space reconstruction / Chaotic time series / Incremental attention mechanism / Phase-space reconstruction
[1] | |
[2] | Y.-N. Wang. Automatic Classification of Sunspots Using Convolutional Neural Networks. M.S. Thesis. Harbin Institute of Technology, Harbin, China (2020). |
[3] | X.-J. Li. Nonlinear Characteristics Identification and Analysis for River Runoff Time Series, Ph.D, Dissertation, |
[4] | |
[5] | G.E.P. Box, G.M. Jenkins, G.C. Reinsel, G.M. Ljung. Time Series Analysis: Forecasting and Control ( |
[6] | |
[7] | |
[8] | |
[9] | |
[10] | |
[11] | |
[12] | |
[13] | |
[14] | |
[15] | L.-Y. Cao. Practical method for determining the minimum embedding dimension of a scalar time series. Physica D, 110 (1/2) (1997), pp. 43-50. View articleGoogle Scholar. |
[16] | |
[17] | |
[18] | |
[19] | |
[20] | |
[21] | |
[22] | |
[23] | |
[24] | |
[25] | |
[26] | SILSO, World data center--sunspot number and long-term solar observations, royal observatory of Belgium, online sunspot number catalogue [Online]. Available, https://www.sidc.be/sunspot-data/SIDCpub.php. |
/
〈 | 〉 |