Relevance of hybrid artificial intelligence for improving the forecasting accuracy of natural resource prices

Abstract

The prediction performance of traditional forecasting methods is low due to the high level of complexity in a series of energy prices. The present study attempts to compare the traditional regression, machine learning tools and hybrid models to conclude the outperforming model. The first step is to propose the effective denoising technique for Tadawul energy index, which has confirmed the superiority of CSD based denoising. However, we use the CSD-ARIMA, CSD-ANN, and CSD-RNN as hybrid models. As a result, CSD-RNN outperforms both other models in terms of MSE, MAPE, RMSE and D_stat. The findings are useful for policy makers, investors and portfolio managers to forecast the energy trends, and hedge the portfolio risk accordingly.

Keywords

Hybrid artificial intelligence / CSD denoising technique / Forecasting / Energy prices / Saudi Arabia

CRediT authorship contribution statement

Mei Li: Writing – original draft, Writing – review & editing. Rida Waheed: Conceptualization, Resources, Validation, Visualization, Writing – original draft. Dervis Kirikkaleli: Supervision. Ghazala Aziz: Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Software.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgement:

The authors extend their appreciation to the Deputyship for Research & Innovation, Ministry of Education in Saudi Arabia for funding this research work through the project number MoF-IF-UJ-22-20745-X.

References

[1] E. Alonso, A.M. Sherman, T.J. Wallington, M.P. Everson, F.R. Field, R. Roth, R.E. Kirchain. Evaluating rare earth element availability: A case with revolutionary demand from clean technologies. Environ. Sci. Tech., 46 (6) (2012), pp. 3406-3414,

[2] H. Apaydin, H. Feizi, M.T. Sattari, M.S. Colak. Comparative analysis of recurrent Neural Network. Water (Switzerland), 12 (2020), pp. 1-18

[3] O.F. Ayadi, J. Williams, L.M. Hyman. Fractional dynamic behavior in Forcados Oil Price Series: An application of detrended fluctuation analysis. Energy Sustain. Dev., 13 (1) (2009), pp. 11-17,

[4] M. Baxter, R.G. King. Approximate band-pass filters for economic time series. NBER Working Paper Series, 5022 (1995), pp. 1-53

[5] M.A. Bollinger, J.L. Pagliari. Another look at private real estate returns by strategy. J. Portf. Manag., 45 (7) (2019), pp. 95-111,

[6] B.L. Bowerman, R.T. O’Connell, A.B. Koehler. Forecasting, Time series, and Regression: An Applied Approach. South-Western Pub (2005)

[7] G.E. Box, G.M. Jenkins. Time series analysis, control, and forecasting. Holden Day, 3226 (1976)

[8] R.N. Bracewell. The Fourier Transform and Its Applications. McGraw-Hill Education (1989)

[9] M. Bristone, R. Prasad, A.A. Abubakar. CPPCNDL: Crude oil price prediction using complex network and deep learning algorithms. Petroleum, 6 (4) (2020), pp. 353-361,

[10] Candès, E. J., Wakin, M. B., 2019. Introduction to Compressive Sampling (CS). Analog Circuits and Signal Processing, March 2008, 33–53. doi:

[11] L. Chinmoy, S. Iniyan, R. Goic. Modeling wind power investments, policies and social benefits for deregulated electricity market – A review. Appl. Energy, 242 (2019), pp. 364-377,

[12] A. Darudi, M. Bashari, M.H. Javidi. Electricity price forecasting using a new data fusion algorithm. IET Gener. Transm. Distrib., 9 (12) (2015), pp. 1382-1390,

[13] De Pasquale, F., Della Penna, S., Snyder, A. Z., Lewis, C., Mantini, D., Marzetti, L., Belardinelli, P., Ciancetta, L., Pizzella, V., Romani, G. L., Corbetta, M., 2010. Temporal dynamics of spontaneous MEG activity in brain networks. Proceedings of the National Academy of Sciences of the United States of America 107(13), 6040–6045. doi:

[14] S. Demir, K. Mincev, K. Kok, N.G. Paterakis. Data augmentation for time series regression: Applying transformations, autoencoders and adversarial networks to electricity price forecasting. Appl. Energy, 304 (2021), Article 117695,

[15] F.X. Diebold, R.S. Mariano. Comparing Predictive Accuracy. J. Bus. Econ. Stat., 20 (1) (2002), pp. 134-144,

[16] Y. Ding. A novel decompose-ensemble methodology with AIC-ANN approach for crude oil forecasting. Energy, 154 (2018), pp. 328-336,

[17] X. Ding, L. Fu, Y. Ding, Y. Wang. A novel hybrid method for oil price forecasting with ensemble thought. Energy Rep., 8 (2022), pp. 15365-15376,

[18] D.L. Donoho. De-Noising by Soft-Thresholding. IEEE Trans. Inf. Theory, 41 (3) (1995), pp. 613-627,

[19] D.L. Donoho. Compressed sensing. IEEE Trans. Inf. Theory, 52 (4) (2006), pp. 1289-1306,

[20] Y. Eldar, G. Kutyniok. Compressed Sensing (Theory and Applications). Cambridge University Press (2012)

[21] L. Fan, S. Pan, Z. Li, H. Li. An ICA-based support vector regression scheme for forecasting crude oil prices. Technol. Forecast. Soc. Chang., 112 (2016), pp. 245-253,

[22] E.S. Gardner. Exponential smoothing: The state of the art. J. Forecast., 4 (1) (1985), pp. 1-28

[23] A. Gianfreda, F. Ravazzolo, L. Rossini. Comparing the forecasting performances of linear models for electricity prices with high RES penetration. Int. J. Forecast., 36 (3) (2020), pp. 974-986,

[24] A.A. Godarzi, R.M. Amiri, A. Talaei, T. Jamasb. Predicting oil price movements: A dynamic Artificial Neural Network approach. Energy Policy, 68 (2014), pp. 371-382,

[25] Han, B., Xiong, J., Li, L., Yang, J., Wang, Z., 2010. Research on millimeter-wave image denoising method based on contourlet and compressed sensing. 2010 2nd International Conference on Signal Processing Systems, 2.

[26] X. Hao, Y. Zhao, Y. Wang. Forecasting the real prices of crude oil using robust regression models with regularization constraints. Energy Econ., 86 (2020), Article 104683,

[27] S.C. Hillmer, G.C. Tiao. An ARIMA-model-based approach to seasonal adjustment. J. Am. Stat. Assoc., 77 (377) (1982), pp. 63-70

[28] R.J. Hodrick, E.C. Prescott. Postwar U. S. Business Cycles: An Empirical Investigation. J. Money Credit Bank., 29 (1) (1997), pp. 1-16

[29] K. Hornik, M. Stinchcombe, H. White. Multilayer feedforward networks are universal approximators. Neural Netw., 2 (5) (1989), pp. 359-366

[30] R. Jammazi, C. Aloui. Crude oil price forecasting: Experimental evidence from wavelet decomposition and neural network modeling. Energy Econ., 34 (3) (2012), pp. 828-841,

[31] P.H. Kuo, C.J. Huang. An electricity price forecasting model by hybrid structured deep neural networks. Sustainability (Switzerland), 10 (4) (2018), pp. 1-17,

[32] R. Li. Forecasting energy spot prices: A multiscale clustering recognition approach. Resour. Policy, 81 (2023), Article 103320,

[33] W. Li, D.M. Becker. Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling. Energy, 237 (2021), Article 121543,

[34] J. Li, S. Zhu, Q. Wu. Monthly crude oil spot price forecasting using variational mode decomposition. Energy Econ., 83 (2019), pp. 240-253,

[35] H. Lu, X. Ma, M. Ma, S. Zhu. Energy price prediction using data-driven models: A decade review. Comput. Sci. Rev., 39 (2021), Article 100356,

[36] S.G. Mallat. A Theory for Multiresolution Signal Decomposition: The Wavelet Representation. IEEE Trans. Pattern Anal. Mach. Intell., 11 (7) (1989), pp. 79-85

[37] M. Marim, E. Angelini, J.-C. Olivo-Marin. Denoising in fluorescence microscopy using compressed sensing with multiple reconstructions and non-local merging. Annual International Conference of the IEEE Engineering in Medicine and Biology, 2010 (2010), pp. 3394-3397

[38] A. Meng, P. Wang, G. Zhai, C. Zeng, S. Chen, X. Yang, H. Yin. Electricity price forecasting with high penetration of renewable energy using attention-based LSTM network trained by crisscross optimization. Energy, 254 (2022), Article 124212,

[39] H. Min. Examining the impact of wnergy price volatility on commodity prices from energy supply chain perspectives. Energies, 15 (21) (2022), p. 7957,

[40] H. Oluwaseyi Musibau, W. Olawale Shittu, M. Yanotti. Natural resources endowment: What more does West Africa need in order to grow?. Resour. Policy, 77 (2022), Article 102669,

[41] Ö. Öztunç Kaymak, Y. Kaymak. Prediction of crude oil prices in COVID-19 outbreak using real data. Chaos Solitons Fractals, 158 (2022), Article 111990,

[42] L. Peng, S. Liu, R. Liu, L. Wang. Effective long short-term memory with differential evolution algorithm for electricity price prediction. Energy, 162 (2018), pp. 1301-1314,

[43] F. Petropoulos, D. Apiletti, V. Assimakopoulos, M.Z. Babai, D.K. Barrow, S. Ben Taieb, C. Bergmeir, R.J. Bessa, J. Bijak, J.E. Boylan, J. Browell, C. Carnevale, J.L. Castle, P. Cirillo, M.P. Clements, C. Cordeiro, F.L. Cyrino Oliveira, S. De Baets, A. Dokumentov, F. Ziel. Forecasting: theory and practice. Int. J. Forecast., 38 (3) (2022), pp. 705-871,

[44] N. Sarantis. Nonlinearities, cyclical behaviour and predictability in stock markets: International evidence. Int. J. Forecast., 17 (3) (2001), pp. 459-482,

[45] I.H. Sarker. AI-based modeling: Techniques, applications and research issues towards automation, intelligent and smart systems. SN Comput. Sci., 3 (2) (2022), pp. 1-20,

[46] J. Schmidhuber. System Modeling and Optimization. The Technical University of Munich (TUM) Habilitation (1993)

[47] N. Sonnichsen. Average annual Brent crude oil price from 1976 to 2022. Statista. (2022)

[48] M. Srivastava, A. Rao, J.S. Parihar, S. Chavriya, S. Singh. What do the AI methods tell us about predicting price volatility of key natural resources: Evidence from hyperparameter tuning. Resour. Policy, 80 (2023), Article 103249,

[49] D.S. Stoffer, R.H. Shumway. An approach to time series smoothing and forecasting using the EM algorithm. J. Time Ser. Anal., 3 (4) (1982), pp. 253-264

[50] Z.R. Struzik. Wavelet methods in (financial) time-series processing. Physica A, 296 (1–2) (2001), pp. 307-319,

[51] D. Wang, H. Luo, O. Grunder, Y. Lin, H. Guo. Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm. Appl. Energy, 190 (2017), pp. 390-407,

[52] F. Wang, J. Wang. Statistical analysis and forecasting of return interval for SSE and model by lattice percolation system and neural network. Comput. Ind. Eng., 62 (1) (2012), pp. 198-205,

[53] J. Wang, W. Yang, P. Du, T. Niu. Outlier-robust hybrid electricity price forecasting model for electricity market management. J. Clean. Prod., 249 (2020), Article 119318,

[54] F. Weng, H. Zhang, C. Yang. Volatility forecasting of crude oil futures based on a genetic algorithm regularization online extreme learning machine with a forgetting factor: The role of news during the COVID-19 pandemic. Resour. Policy, 73 (2021), Article 102148,

[55] H. Yang, K.R. Schell. Real-time electricity price forecasting of wind farms with deep neural network transfer learning and hybrid datasets. Appl. Energy, 299 (2021), Article 117242,

[56] C.Z. Yao, P.C. Kuang. A study of lead–lag structure between international crude oil price and several financial markets. Physica A, 531 (2019), Article 121755,

[57] T. Yin, Y. Wang. Predicting the price of WTI crude oil futures using artificial intelligence model with chaos. Fuel, 316 (2022), Article 122523,

[58] Y. Yu. Role of Natural resources rent on economic growth: Fresh empirical insight from selected developing economies. Resour. Policy, 81 (2023), Article 103326,

[59] L. Yu, Y. Zhao, L. Tang. A compressed sensing based AI learning paradigm for crude oil price forecasting. Energy Econ., 46 (2014), pp. 236-245,

[60] L. Yu, W. Dai, L. Tang. A novel decomposition ensemble model with extended extreme learning machine for crude oil price forecasting. Eng. Appl. Artif. Intel., 47 (2016), pp. 110-121,

[61] D. Zhang, G. Zang, J. Li, K. Ma, H. Liu. Prediction of soybean price in China using QR-RBF neural network model. Comput. Electron. Agric., 154 (2018), pp. 10-17,