Federated anomaly detection in smart grid systems^✩

Abstract

Smart Grid infrastructures have enhanced energy distribution efficiency, reliability, and sustainability, but their proper operation requires robust anomaly detection to mitigate risks from equipment failures, cyberattacks, and natural disasters. Federated Learning (FL) offers a privacy-preserving solution by allowing power plants and grid sectors to collaboratively train models without sharing raw data, addressing privacy concerns, regulatory compliance, and single points of failure that often emerge in centralized approaches. FL also improves real-time anomaly detection and scalability by adapting dynamically to different grid topologies while incurring minimal communication overhead. Within our FL framework, Transformer models excel in anomaly detection due to their self-attention mechanisms that capture intricate temporal dependencies in sensor data. Unlike traditional models, Transformers effectively learn long-range patterns, enhancing detection accuracy and responsiveness. This work conducts a comparative study of two state-of-the-art Tranformer models in an FL environment, evaluating their anomaly detection performance across four diverse smart grid datasets. To assess robustness, we introduce a GAN-based Anomaly Injection Attack (GAIA) that generates and injects realistic syntheitc anomalies. Our results indicate that both federated Transformer models achieve high detection performance across seven metrics, even under adversarial conditions, offering valuable insights into their capabilities in decentralized smart grid applications.

Keywords

Federated learning / Transformers / Anomaly detection / Smart grid

CRediT authorship contribution statement

Tre’ R. Jeter: Writing – original draft, Visualization, Validation, Software, Methodology, Investigation, Data curation, Conceptualization; Raed Alharbi: Data curation; Jung Taek Seo: Funding acquisition; My T. Thai: Writing – review & editing, Supervision, Resources, Project administration, Funding acquisition.

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgment

This work was supported by the Korea Institute of Energy Technology Evaluation and Planning (KETEP) grant funded by the Korea government (MOTIE) (RS-2023-00303559, A Study on Development of Cyber-Physical Attack Response System and Security Management System for Maximizing Availability of Real-Time Distributed Resources).

References

[1] S.S. Refaat, A. Mohamed, H. Abu—Rub, Big data impact on stability and reliability improvement of smart grid, in: 2017 IEEE International Conference on Big Data (Big Data), IEEE, 2017, pp. 1975-1982.

[2] Z. Guo, B. Qin, Z. Guan, Y. Wang, H. Zheng, Q. Wu, A high—efficiency and incentive—compatible peer—to—peer energy trading mechanism, IEEE Trans. Smart Grid IEEE 15 (1) (2023) 1075-1088.

[3] M.A. Shoeb, F. Shahnia, G.M. Shafiullah, A multilayer and event—triggered voltage and frequency management technique for microgrid’s central controller considering operational and sustainability aspects, IEEE Trans. Smart Grid 10 (5) (2018) 5136-5151.

[4] A.U. Rehman, Z. Wadud, R.M. Elavarasan, G. Hafeez, I. Khan, Z. Shafiq, H.H. Alhelou, An optimal power usage scheduling in smart grid integrated with renewable energy sources for energy management, IEEE Access 9 (2021) 84619-84638.

[5] D. Batic, L. Stankovic, V. Stankovic, Analysis of smart meter data for energy waste management, in: Artificial Intelligence for Sustainability: Innovations in Business and Financial Services, Springer, 2024, pp. 153-173.

[6] H. Yang, X. Shi, R.C. Qiu, X. He, Q. Ai, Z. Wang, Monitoring data factorization of high renewable energy penetrated grids for probabilistic static voltage stability assessment, IEEE Trans. Smart Grid 13 (2) (2021) 1273-1286.

[7] A. Takiddin, M. Ismail, U. Zafar, E. Serpedin, Deep autoencoder—based anomaly detection of electricity theft cyberattacks in smart grids, IEEE Syst. J. 16 (3) (2022) 4106-4117.

[8] F. Wei, Z. Wan, H. He, X. Lin, Ultrafast active response strategy against malfunction attack on fault current limiter, IEEE Trans. Smart Grid 11 (3) (2019) 2722-2733.

[9] M. Yan, Y. He, M. Shahidehpour, X. Ai, Z. Li, J. Wen, Coordinated regional—district operation of integrated energy systems for resilience enhancement in natural disasters, IEEE Trans. Smart Grid 10 (5) (2018) 4881-4892.

[10] Y. Chen, W. Wei, M. Li, L. Chen, J.P.S. Catalão, Flexibility requirement when tracking renewable power fluctuation with peer—to—peer energy sharing, IEEE Trans. Smart Grid 13 (2) (2021) 1113-1125.

[11] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, Ł. Kaiser, I. Polosukhin, Attention is all you need, Adv. Neural Inf. Process. Syst. 30 (2017).

[12] B. Chen, M. Sinn, J. Ploennigs, A. Schumann, Statistical anomaly detection in mean and variation of energy consumption, in: 2014 22nd International Conference on Pattern Recognition, IEEE, 2014, pp. 3570-3575.

[13] G. Pang, C. Shen, A. Van Den Hengel, Deep anomaly detection with deviation networks, in: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 353-362.

[14] J. Xu, H. Wu, J. Wang, M. Long, Anomaly transformer: time series anomaly detection with association discrepancy, in: International Conference on Learning Representations, 2022. https://openreview.net/forum?id=LzQQ89U1qm_.

[15] J. Song, K. Kim, J. Oh, S. Cho, Memto: memory—guided transformer for multivariate time series anomaly detection, Adv. Neural Inf. Process. Syst. 36 (2024) 57947-57963.

[16] S. Kullback, Kullback—leibler divergence, Encyclopedia of Machine Learning 1951 581-583.

[17] M.N. Vu, J. Tre’R, R. Alharbi, M.T. Thai, Active data reconstruction attacks in vertical federated learning, in: 2023 IEEE International Conference on Big Data (BigData), IEEE, 2023, pp. 1374-1379.

[18] I. Goodfellow, J. Pouget—Abadie, M. Mirza, B. Xu, D. Warde—Farley, S. Ozair, A. Courville, Y. Bengio, Generative adversarial nets, Adv. Neural Inf. Process. Syst. 27 (2014).

[19] M. Mirza, S. Osindero, Conditional Generative Adversarial Nets, arXiv:1411.1784 (2014).

[20] G.G. Chrysos, J. Kossaifi, S. Zafeiriou, Robust conditional generative adversarial networks, in: International Conference on Learning Representations, 2018.

[21] L. Shen, Z. Li, J. Kwok, Timeseries anomaly detection using temporal hierarchical one—class network, Adv. Neural Inf. Process. Syst. 33 (2020) 13016-13026.

[22] Z. Li, Y. Zhao, J. Han, Y. Su, R. Jiao, X. Wen, D. Pei, Multivariate time series anomaly detection and interpretation using hierarchical inter—metric and temporal embedding, in: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021, pp. 3220-3230.

[23] Y. Su, Y. Zhao, C. Niu, R. Liu, W. Sun, D. Pei, Robust anomaly detection for multivariate time series through stochastic recurrent neural network, in: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2019, pp. 2828-2837.

[24] C.A. Huang, A. Vaswani, J. Uszkoreit, I. Simon, C. Hawthorne, N. Shazeer, A.M. Dai, M.D. Hoffman, M. Dinculescu, D. Eck, Music transformer: generating music with long—term structure, in: 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6—9, 2019, OpenReview.net, 2019. https://openreview.net/forum?id=rJe4ShAcF7.

[25] H. Wu, T. Hu, Y. Liu, H. Zhou, J. Wang, M. Long, TimesNet: temporal 2D—variation modeling for general time series analysis, in: The Eleventh International Conference on Learning Representations, 2022.

[26] S. Tuli, G. Casale, N.R. Jennings, TranAD: deep transformer networks for anomaly detection in multivariate time series data, Proc. VLDB Endow. 15 (6) (2022) 1201-1214.

[27] Y. He, G.J. Mendis, J. Wei, Real—time detection of false data injection attacks in smart grid: a deep learning—based intelligent mechanism, IEEE Trans. Smart Grid 8 (5) (2017) 2505-2516.

[28] Y. Li, X. Wei, Y. Li, Z. Dong, M. Shahidehpour, Detection of false data injection attacks in smart grid: a secure federated deep learning approach, IEEE Trans. Smart Grid 13 (6) (2022) 4862-4872.

[29] Z. Miao, J. Yu, A robust learning framework for smart grids in defense against false—data injection attacks, ACM Trans. Sens. Netw. 20 (2) (2024) 1-12.

[30] S. Qin, J. Zhu, D. Wang, L. Ou, H. Gui, G. Tao, Decomposed transformer with frequency attention for multivariate time series anomaly detection, in: 2022 IEEE International Conference on Big Data (Big Data), IEEE, 2022, pp. 1090-1098.

[31] C. Zhang, S.R. Kuppannagari, R. Kannan, V.K. Prasanna, Generative adversarial network for synthetic time series data generation in smart grids, in: 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), IEEE, 2018, pp. 1-6.

[32] Y. Zhu, B. Jiang, H. Jin, M. Zhang, F. Gao, J. Huang, T. Lin, X. Wang, Networked time series prediction with incomplete data via generative adversarial network, ACM Trans. Knowl. Discovery Data ACM New York, NY 18 (5) (2024) 1-25.

[33] Z. Liu, Q. Wang, Y. Ye, Y. Tang, A GAN—based data injection attack method on data—driven strategies in power systems, IEEE Trans. Smart Grid 13 (4) (2022) 3203-3213.