Time series online prediction algorithm based on least squares support vector machine

Abstract

Deficiencies of applying the traditional least squares support vector machine (LS-SVM) to time series online prediction were specified. According to the kernel function matrix’s property and using the recursive calculation of block matrix, a new time series online prediction algorithm based on improved LS-SVM was proposed. The historical training results were fully utilized and the computing speed of LS-SVM was enhanced. Then, the improved algorithm was applied to time series online prediction. Based on the operational data provided by the Northwest Power Grid of China, the method was used in the transient stability prediction of electric power system. The results show that, compared with the calculation time of the traditional LS-SVM(75-1 600 ms), that of the proposed method in different time windows is 40–60 ms, and the prediction accuracy(normalized root mean squared error) of the proposed method is above 0.8. So the improved method is better than the traditional LS-SVM and more suitable for time series online prediction.

Keywords

time series prediction / machine learning / support vector machine / statistical learning theory

References

[1] KugiumtzisD., LingiardeO. C., Christoph-ersenN.. Regularized local linear prediction of chaotic time series[J]. Physica D, 1998, 11(2): 344-360

[2] WhiteheadB. A., ChoateT. D.. Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction[J]. IEEE Transactions on Neural Networks, 1996, 7(4): 869-880

[3] YeeP., HaykinS.. A dynamic regularized radial basis function network for nonlinear, nonstationary time series prediction[J]. IEEE Transactions on Signal Processing, 1999, 47(9): 2503-2521

[4] GencayR., LiuT.. Nonlinear modeling and prediction with feedforward and recurrent networks[J]. Physica D, 1997, 10(8): 119-134

[5] YuL.-x., ZhangY.-qing.. Evolutionary fuzzy neural networks for hybrid financial prediction[J]. IEEE Transactions on Systems, Man and Cybernetics, Part C, 2005, 35(2): 244-249

[6] GhazaliR., HussainA., El-DeredyW.. Application of ridge polynomial neural networks to financial time series prediction[C]. International Joint Conference on Neural Networks, 2006, Vancouver, BC, Canada, Tyndale House Press: 235-239

[7] VapnikV. N.The Nature of Statistical Learning Theory[M], 1995, New York, Spring-Verlag Press

[8] CherkasskyV., MulierF.Learning from Data-Concepts: Theory and Methods[M], 1998, New York, John Wiley Sons Press

[9] JoachimsT.. Text categorization with support vector machines: learning with many relevant features[C]. Proceedings of the European Conference on Machine Learning(ECML), 1998, Paris, John Wiley Sons Publisher: 137-142

[10] GuyonI., WestonJ., BarnhillS.. Gene selection for cancer classification using support vector machines[J]. Machine Learning, 2002, 46(1): 389-422

[11] HeX.-w., ZhaoH.-ming.. Support vector machine and its application to machinery fault diagnosis[J]. Journal of Central South University of Technology: Natural Science, 2005, 36(1): 97-101

[12] ZhongW.-m., PiD.-y., SunY.-xian.. Support vector machine based nonlinear model multi-step-ahead optimizing predictive control[J]. Journal of Central South University of Technology, 2005, 12(5): 591-595

[13] KivinenJ., SmolaA., WilliamsonR.Online learning with kernels: Advances in Neural Information Processing Systems[M], 2002, Cambridge, MA, MIT Press

[14] RalaivolaL.. Incremental support vector machine learning: A local approach[C]. Proceedings of the International on Conference on Artificial Neural Networks, 2001, Vienna, St Martin Publisher: 322-329

[15] KuhA.. Adaptive kernel methods for CDMA systems[C]. Proceedings of the International Joint Conference on Neural networks, 2001, Washington DC, Spring-Verlag Publisher: 1404-1409

[16] SuykensJ., VandewaleJ.. Least squares support vector machine classifiers[J]. Neural Processing Letters, 1999, 9(3): 293-300