RES-AD: An AutoML-Driven Robust Ensemble Framework for Real-Time Anomaly Detection and Energy Forecasting in Smart Grids

Murad Ali Khan , Naeem Iqbal , Syed Shehryar Ali Naqvi , Muhammad Faseeh , Do-Hyeun Kim

CAAI Transactions on Intelligence Technology ›› 2026, Vol. 11 ›› Issue (5) : 1375 -1395.

PDF (3460KB)
CAAI Transactions on Intelligence Technology ›› 2026, Vol. 11 ›› Issue (5) :1375 -1395. DOI: 10.1049/cit2.70155
ORIGINAL RESEARCH
research-article
RES-AD: An AutoML-Driven Robust Ensemble Framework for Real-Time Anomaly Detection and Energy Forecasting in Smart Grids
Author information +
History +
PDF (3460KB)

Abstract

Accurate load forecasting and reliable anomaly detection are critical for the stable operation of modern smart grids (SGs), which increasingly rely on cyber-connected infrastructures. However, the integration of smart metres and two-way communication exposes SGs to data integrity attacks that can manipulate consumption measurements, degrade forecast accuracy and compromise grid stability. This study proposes RES-AD, a robust AutoML-driven ensemble framework designed for real-time detection of abnormal consumption patterns and accurate short-term energy forecasting. RES-AD consists of an Optimal Ensemble Classifier (OEC) for anomaly detection and an Optimal Ensemble Regressor (OER) for forecasting, both selected and optimised automatically using H2O AutoML. Five types of synthetic data integrity attacks are injected to simulate realistic adversarial conditions, whereas SMOTE and correlation-based feature selection ensure balanced and informative training data. The revised framework further incorporates stealthy adversarial attack simulation evaluated using FGSM and demonstrates strong robustness with only a 1.7% degradation under perturbation, further mitigated through adversarial augmentation. Additionally, real-time readiness is validated through latency and memory profiling, where the OEC ensemble requires only 23.36 ms per inference with a footprint below 0.05 MB, making it suitable for edge or SCADA-integrated deployment. Experimental results using public residential smart metre data show that OEC achieves 99.7% (hourly) and 99.9% (daily) detection accuracy, whereas OER improves energy forecasting with a MAPE reduction of 11.11% and 11.72%, respectively. These outcomes demonstrate that RES-AD provides a scalable, attack-aware and deployment-ready solution that enhances both the reliability and resilience of modern smart grid operations.

Keywords

anomaly detection / AutoML / cyber-attacks / energy forecasting / ensemble learning / smart grid / smart metres / sustainable energy management

Cite this article

Download citation ▾
Murad Ali Khan, Naeem Iqbal, Syed Shehryar Ali Naqvi, Muhammad Faseeh, Do-Hyeun Kim. RES-AD: An AutoML-Driven Robust Ensemble Framework for Real-Time Anomaly Detection and Energy Forecasting in Smart Grids. CAAI Transactions on Intelligence Technology, 2026, 11 (5) : 1375-1395 DOI:10.1049/cit2.70155

登录浏览全文

4963

注册一个新账户 忘记密码

References

[1]

X. Fang, S. Misra, G. Xue, and D. Yang, “ Smart Grid-The New and Improved Power Grid: A Survey,” IEEE Communications Surveys and Tutorials 14, no. 4 (2011): 944-980, https://doi.org/10.1109/surv.2011.101911.00087.

[2]

H. Karimipour and V. Dinavahi, “ Robust Massively Parallel Dynamic State Estimation of Power Systems Against Cyber-Attack,” IEEE Access 6 (2017): 2984-2995, https://doi.org/10.1109/access.2017.2786584.

[3]

Z. Huang, C. Wang, T. Zhu, and A. Nayak, “ Cascading Failures in Smart Grid: Joint Effect of Load Propagation and Interdependence,” IEEE Access 3 (2015): 2520-2530, https://doi.org/10.1109/access.2015.2506503.

[4]

M. X. Cheng, M. Crow, and Q. Ye, “ A Game Theory Approach to Vulnerability Analysis: Integrating Power Flows With Topological Analysis,” International Journal of Electrical Power & Energy Systems 82 (2016): 29-36, https://doi.org/10.1016/j.ijepes.2016.02.045.

[5]

H. Karimipour and V. Dinavahi, “ On False Data Injection Attack Against Dynamic State Estimation on Smart Power Grids,” in 2017 IEEE International Conference on Smart Energy Grid Engineering (SEGE) (IEEE, 2017), 388-393.

[6]

M. Fahim and A. Sillitti, “ Anomaly Detection, Analysis and Prediction Techniques in IoT Environment: A Systematic Literature Review,” IEEE Access 7 (2019): 81664-81681, https://doi.org/10.1109/access.2019.2921912.

[7]

A. G. Miles, Y. Chakhchoukh, and S. S. Alam, “Robust Distribution State Estimation for Reliable Locational Marginal Pricing Under Cyber-Attacks,” IEEE Transactions on Power Systems 39, no. 3 (2023): 4963-4974, https://doi.org/10.1109/tpwrs.2023.3325219.

[8]

A. D. Syrmakesis, H. H. Alhelou, and N. D. Hatziargyriou, “ A Novel Cyberattack-Resilient Frequency Control Method for Interconnected Power Systems Using SMO-Based Attack Estimation,” IEEE Transactions on Power Systems 39, no. 4 (2023): 5672-5686, https://doi.org/10.1109/tpwrs.2023.3340744.

[9]

S. Yang, K.-W. Lao, H. Hui, and Y. Chen, “ Secure Distributed Control for Demand Response in Power Systems Against Deception Cyber-Attacks With Arbitrary Patterns,” IEEE Transactions on Power Systems 39, no. 6 (2024): 7277-7290.

[10]

B. R. Amin, S. Taghizadeh, M. S. Rahman, M. J. Hossain, V. Varadharajan, and Z. Chen, “ Cyber Attacks in Smart Grid-Dynamic Impacts, Analyses and Recommendations,” IET Cyber-Physical Systems: Theory & Applications 5, no. 4 (2020): 321-329, https://doi.org/10.1049/iet-cps.2019.0103.

[11]

R. Xu, R. Wang, Z. Guan, L. Wu, J. Wu, and X. Du, “ Achieving Efficient Detection Against False Data Injection Attacks in Smart Grid,” IEEE Access 5 (2017): 13787-13798, https://doi.org/10.1109/access.2017.2728681.

[12]

Y. Li, X. Wei, Y. Li, Z. Dong, and M. Shahidehpour, “ Detection of False Data Injection Attacks in Smart Grid: A Secure Federated Deep Learning Approach,” IEEE Transactions on Smart Grid 13, no. 6 (2022): 4862-4872, https://doi.org/10.1109/tsg.2022.3204796.

[13]

A. Huseinović, S. Mrdović, K. Bicakci, and S. Uludag, “ A Survey of Denial-of-Service Attacks and Solutions in the Smart Grid,” IEEE Access 8 (2020): 177447-177470, https://doi.org/10.1109/access.2020.3026923.

[14]

M. K. Hasan, A. A. Habib, S. Islam, N. Safie, S. N. H. S. Abdullah, and B. Pandey, “ Ddos: Distributed Denial of Service Attack in Communication Standard Vulnerabilities in Smart Grid Applications and Cyber Security With Recent Developments,” Energy Reports 9 (2023): 1318-1326, https://doi.org/10.1016/j.egyr.2023.05.184.

[15]

İ. Avcı, “ Investigation of Cyber-Attack Methods and Measures in Smart Grids,” Sakarya University Journal of Science 25, no. 4 (2021): 1049-1060, https://doi.org/10.16984/saufenbilder.955914.

[16]

K. N. Qureshi, R. Hussain, and G. Jeon, “ A Distributed Software Defined Networking Model to Improve the Scalability and Quality of Services for Flexible Green Energy Internet for Smart Grid Systems,” Computers & Electrical Engineering 84 (2020): 106634, https://doi.org/10.1016/j.compeleceng.2020.106634.

[17]

R. Younisse and M. AlKasassbeh, “ Sgid: A Semi-Synthetic Dataset for Injection Attacks in Smart Grid Systems,” in 2024 15th International Conference on Information and Communication Systems (ICICS) (IEEE, 2024), 1-4.

[18]

Z. Fengming, L. Shufang, G. Zhimin, W. Bo, T. Shiming, and P. Mingming, “ Anomaly Detection in Smart Grid Based on Encoder-Decoder Framework With Recurrent Neural Network,” Journal of China Universities of Posts and Telecommunications 24, no. 6 (2017): 67-73, https://doi.org/10.1016/s1005-8885(17)60243-7.

[19]

B. Rossi, S. Chren, B. Buhnova, and T. Pitner, “ Anomaly Detection in Smart Grid Data: An Experience Report,” in 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (IEEE, 2016), 2313-2318.

[20]

M. A. Khan, N. Iqbal, H. Jamil, D.-H. Kim, and D. H. Kim, “ An Optimized Ensemble Prediction Model Using Automl Based on Soft Voting Classifier for Network Intrusion Detection,” Journal of Network and Computer Applications 212 (2023): 103560, https://doi.org/10.1016/j.jnca.2022.103560.

[21]

G. Fenza, M. Gallo, and V. Loia, “ Drift-Aware Methodology for Anomaly Detection in Smart Grid,” IEEE Access 7 (2019): 9645-9657, https://doi.org/10.1109/access.2019.2891315.

[22]

X. He, Q. Ai, R. C. Qiu, W. Huang, L. Piao, and H. Liu, “ A Big Data Architecture Design for Smart Grids Based on Random Matrix Theory,” IEEE Transactions on Smart Grid 8, no. 2 (2015): 674-686, https://doi.org/10.1109/TSG.2015.2445828.

[23]

R. Moslemi, M. Davoodi, and J. M. Velni, “ A Distributed Approach for Estimation of Information Matrix in Smart Grids and Its Application for Anomaly Detection,” in 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (IEEE, 2020), 1-7.

[24]

R. Moghaddass and J. Wang, “ A Hierarchical Framework for Smart Grid Anomaly Detection Using Large-Scale Smart Meter Data,” IEEE Transactions on Smart Grid 9, no. 6 (2017): 5820-5830, https://doi.org/10.1109/tsg.2017.2697440.

[25]

Y. Liu, R. Yuan, S. Zheng, K. Yan, and H. Miao, “ An Abnormal Detection of Positive Active Total Power Based on Local Outlier Factor,” in 2021 IEEE International Conference on Power Electronics, Computer Applications (ICPECA) (IEEE, 2021), 180-183.

[26]

D. M. Menon and N. Radhika, “ Anomaly Detection in Smart Grid Traffic Data for Home Area Network,” in 2016 International Conference on Circuit, Power and Computing Technologies (ICCPCT) (IEEE, 2016), 1-4.

[27]

S. S. Rawat, V. A. Polavarapu, V. Kumar, E. Aruna, and V. Sumathi, “ Anomaly Detection in Smart Grid Using Rough Set Theory and K Cross Validation,” in 2014 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2014] (IEEE, 2014), 479-483.

[28]

F. Fathnia and M. H. J. D. Bayaz, “ Anomaly Detection in Smart Grid With Help of an Improved Optics Using Coefficient of Variation,” in Electrical Engineering (ICEE), Iranian Conference on (IEEE, 2018), 1044-1050.

[29]

M. Panthi, “ Anomaly Detection in Smart Grids Using Machine Learning Techniques,” in 2020 First International Conference on Power, Control and Computing Technologies (ICPC2T) (IEEE, 2020), 220-222.

[30]

C. Promper, D. Engel, and R. C. Green, “ Anomaly Detection in Smart Grids With Imbalanced Data Methods,” in 2017 IEEE Symposium Series on Computational Intelligence (SSCI) (IEEE, 2017), 1-8.

[31]

H. Karimipour, S. Geris, A. Dehghantanha, and H. Leung, “ Intelligent Anomaly Detection for large-scale Smart Grids,” in 2019 IEEE Canadian Conference of Electrical and Computer Engineering (CCECE) (IEEE, 2019), 1-4.

[32]

T. Kotsiopoulos, P. Sarigiannidis, D. Ioannidis, and D. Tzovaras, “ Machine Learning and Deep Learning in Smart Manufacturing: The Smart Grid Paradigm,” Computer Science Review 40 (2021): 100341, https://doi.org/10.1016/j.cosrev.2020.100341.

[33]

M. Cui, J. Wang, and M. Yue, “ Machine Learning-Based Anomaly Detection for Load Forecasting Under Cyberattacks,” IEEE Transactions on Smart Grid 10, no. 5 (2019): 5724-5734, https://doi.org/10.1109/tsg.2018.2890809.

[34]

M. N. Kurt, O. Ogundijo, C. Li, and X. Wang, “ Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach,” IEEE Transactions on Smart Grid 10, no. 5 (2018): 5174-5185, https://doi.org/10.1109/tsg.2018.2878570.

[35]

S. N. Islam, Z. Baig, and S. Zeadally, “ Physical Layer Security for the Smart Grid: Vulnerabilities, Threats, and Countermeasures,” IEEE Transactions on Industrial Informatics 15, no. 12 (2019): 6522-6530, https://doi.org/10.1109/tii.2019.2931436.

[36]

C. Lopez, A. Sargolzaei, H. Santana, and C. Huerta, “ Smart Grid Cyber Security: An Overview of Threats and Countermeasures,” Journal of Energy and Power Engineering 9, no. 7 (2015): 632-647, https://doi.org/10.1109/ISAP63260.2024.10744349.

[37]

S. Shapsough, F. Qatan, R. Aburukba, F. Aloul, and A. Al Ali, “ Smart Grid Cyber Security: Challenges and Solutions,” in 2015 International Conference on Smart Grid and Clean Energy Technologies (ICSGCE) (IEEE, 2015), 170-175.

[38]

F. Passerini and A. M. Tonello, “ Smart Grid Monitoring Using Power Line Modems: Anomaly Detection and Localization,” IEEE Transactions on Smart Grid 10, no. 6 (2019): 6178-6186, https://doi.org/10.1109/tsg.2019.2899264.

[39]

M. Ghiasi, N. Ghadimi, and E. Ahmadinia, “An Analytical Methodology for Reliability Assessment and Failure Analysis in Distributed Power System,” SN Applied Sciences 1, no. 1 (2019): 44, https://doi.org/10.1007/s42452-018-0049-0.

[40]

M. Ghiasi, M. Dehghani, T. Niknam, A. Kavousi-Fard, P. Siano, and H. H. Alhelou, “ Cyber-Attack Detection and Cyber-Security Enhancement in Smart DC-Microgrid Based on Blockchain Technology and Hilbert Huang Transform,” IEEE Access 9 (2021): 29429-29440, https://doi.org/10.1109/access.2021.3059042.

[41]

M. Dehghani, T. Niknam, M. Ghiasi, N. Bayati, and M. Savaghebi, “ Cyber-Attack Detection in DC Microgrids Based on Deep Machine Learning and Wavelet Singular Values Approach,” Electronics 10, no. 16 (2021): 1914, https://doi.org/10.3390/electronics10161914.

[42]

E. Altamimi, A. K. Al-Ali, A. Al-Ali, and Q. Malluhi, “ Distribution-Based Residual Analysis of Load Forecasting for Enhanced Anomaly Detection,” SSRN Electronic Journal (2025), https://ssrn.com/abstract=5230288.

[43]

S. Zheng, M. Zhu, and Y. Liu, “ Research on Anomaly Detection and Correction of Power Metering Data Based on Machine Learning Algorithm,” Science and Technology for Energy Transition 2025, no. 1 (2025): 25-35, https://doi.org/10.2516/stet/2024106.

[44]

P. K. R. Shabad, A. Alrashide, and O. Mohammed, “ Anomaly Detection in Smart Grids Using Machine Learning,” ResearchGate (2023), https://www.researchgate.net/publication/356141365.

[45]

A. Trindade, “ Electricity Load Diagrams 2011-2014,” UCI Machine Learning Repository (2015), https://doi.org/10.24432/C58C86.

[46]

L. Che, X. Liu, Z. Shuai, and J. Zhao, “ The Impact of Ramp-Induced Data Attacks on Power System Operational Security,” IEEE Transactions on Industrial Informatics 15, no. 9 (2019): 5064-5075, https://doi.org/10.1109/tii.2019.2895058.

[47]

K. Sun, I. Esnaola, S. M. Perlaza, and H. V. Poor, “ Stealth Attacks on the Smart Grid,” IEEE Transactions on Smart Grid 11, no. 2 (2019): 1276-1285, https://doi.org/10.1109/tsg.2019.2935353.

[48]

P. Wang and M. Govindarasu, “ Multi-Agent Based Attack-Resilient System Integrity Protection for Smart Grid,” IEEE Transactions on Smart Grid 11, no. 4 (2020): 3447-3456, https://doi.org/10.1109/tsg.2020.2970755.

[49]

M. Turowski, O. Neumann, L. Mannsperger, et al., “ Managing Anomalies in Energy Time Series for Automated Forecasting,” in Energy Informatics Academy Conference (Springer, 2023), 3-29, https://doi.org/10.1007/978-3-031-48649-4_1.

[50]

J. Rogers, Data Augmentation for Smart Grid Anomaly Detection (University of Rhode Island, 2024), https://doi.org/10.23860/diss-1659.

[51]

A. A. Korba, N. Tamani, Y. Ghamri-Doudane, and N. E. I. Karabadji, “ Anomaly-Based Framework for Detecting Power Overloading Cyberattacks in Smart Grid AMI,” Computers & Security 96 (2020): 101896, https://doi.org/10.1016/j.cose.2020.101896.

[52]

Ö. Sen, S. Glomb, M. Henze, and A. Ulbig, “ Benchmark Evaluation of Anomaly-Based Intrusion Detection Systems in the Context of Smart Grids,” in 2023 IEEE PES Innovative Smart Grid Technologies Europe (ISGT EUROPE) (IEEE, 2023), 1-6, https://doi.org/10.1109/ISGTEUROPE56780.2023.10407262.

[53]

C. A. Fonseca, “ Scada System of Pipelines,” in Handbook of Pipeline Engineering (Springer, 2024), 1-28.

[54]

M. A. Mohamed, T. Chen, W. Su, and T. Jin, “ Proactive Resilience of Power Systems Against Natural Disasters: A Literature Review,” in IEEE Access, vol. 7 (IEEE, 2019), 163778-163795, https://doi.org/10.1109/ACCESS.2019.2952362.

[55]

A. Wali and F. Alshehry, “ A Survey of Security Challenges in Cloud-Based SCADA Systems,” Computers 13, no. 4 (2024): 97, https://doi.org/10.3390/computers13040097.

[56]

N. S. Nafi, K. Ahmed, M. A. Gregory, and M. Datta, “ A Survey of Smart Grid Architectures, Applications, Benefits and Standardization,” Journal of Network and Computer Applications 76 (2016): 23-36, https://doi.org/10.1016/j.jnca.2016.10.003.

[57]

B. N. Jørgensen and Z. G. Ma, “ Cybersecurity and Resilience of Smart Grids: A Review of Threat Landscape, Incidents, and Emerging Solutions,” Applied Sciences 16, no. 2 (2026): 981, https://doi.org/10.3390/app16020981.

[58]

W. Kang, L. Zhang, Z. Hu, and Z. Xia, “ A Secure and Efficient Data Aggregation Scheme for Cloud-Edge Collaborative Smart Meters,” International Journal of Electrical Power & Energy Systems 162 (2024): 110270, https://doi.org/10.1016/j.ijepes.2024.110270.

[59]

G. Areo, Blockchain for Secure Call Logging in Asterisk-Based Voip Systems (2024).

[60]

H.-J. Jun and H.-S. Yang, “ Performance of the Xmpp and the Mqtt Protocols on IEC 61850-Based Micro Grid Communication Architecture,” Energies 14, no. 16 (2021): 5024, https://doi.org/10.3390/en14165024.

[61]

L. Tightiz and H. Yang, “ A Comprehensive Review on IoT Protocols’ Features in Smart Grid Communication,” Energies 13, no. 11 (2020): 2762, https://doi.org/10.3390/en13112762.

PDF (3460KB)

0

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉