Toward grid-interactive and low-carbon buildings: A comparative analysis of artificial intelligence-driven optimization of renewable sizing and demand-side control

Abstract

As buildings account for nearly one-third of global energy consumption, improving their energy performance and renewable integration is essential for achieving sustainability targets. Traditional building energy management systems (BEMS), often rule-based and static, struggle to adapt to fluctuating demands, variable tariffs, and the intermittency of solar resources. This study introduces an integrated, artificial intelligence (AI)-driven BEMS framework that jointly optimizes rooftop photovoltaic (PV) sizing and adaptive demand-side management (DSM) using reinforcement learning (Q-Learning) and benchmarks its performance against two established deterministic tools: HOMER Pro for techno-economic PV sizing and particle swarm optimization (PSO) for DSM load scheduling. Using realistic hourly building loads, meteorological data, and time-of-use pricing, the Q-Learning model converged to a PV–inverter configuration closely aligned with HOMER Pro’s optimum, achieving a slightly lower net present cost (–1.85%) and a modest increase in renewable fraction (+3.1%). In DSM applications, Q-Learning consistently outperformed PSO by shifting a larger share of flexible loads and securing higher daily cost reductions. Under grid-only conditions, Q-Learning reduced energy costs by 7.58% in winter and 8.27% in summer, while PV-integrated scenarios achieved savings of 35.14% and 26.89%, respectively. These results demonstrate that reinforcement learning can effectively enhance the performance of conventional BEMS approaches by providing more adaptive scheduling aligned with tariff structures and solar availability. The proposed framework supports more efficient, flexible, and sustainable building operations, highlighting the practical potential of AI-driven energy management in modern grid-interactive environments.

Keywords

Building energy management system / Demand-side management / Photovoltaic sizing / Reinforcement learning

References

[1] Correia S, Matos-Carvalho JP, Kim C, et al. Real-Time AI-Based power demand forecasting for peak shaving and consumption reduction using vehicle-to-grid and reused energy storage systems: a case study at a business center on Jeju Island. Appl. Sci. (Basel) 2025; 15(1): 3050. https://doi.org/10.3390/APP15063050

[2] Kwon K, Lee S, Kim S. AI-based home energy management system considering energy efficiency and resident satisfaction. IEEE Internet Things J. 2022; 9(2): 1608-1621. https://doi.org/10.1109/JIOT.2021.3104830

[3] Ali ANF, Sulaima MF, Razak IAWA, et al. Artificial intelligence application in demand response: advantages, issues, status, and challenges. IEEE Access. 2023; 11: 16907-16922. https://doi.org/10.1109/ACCESS.2023.3237737

[4] Lin Y, Tang J, Guo J, et al. Advancing AI-enabled techniques in energy system modeling: a review of data-driven, mechanism-driven, and hybrid modeling approaches. Energies (Basel). 2025; 18: 845. https://doi.org/10.3390/en18040845

[5] Yu S, Liu X, Li R, et al. Demand side management full season optimal operation potential analysis for coupled hybrid photovoltaic/thermal, heat pump, and thermal energy storage systems. J Energy Storage. 2024; 80: 110375. https://doi.org/10.1016/J.EST.2023.110375

[6] Liu Z, Zhang X, Sun Y, Zhou Y. Advanced controls on energy reliability, flexibility and occupant-centric control for smart and energy-efficient buildings. Energy Build. 2023; 297: 113436. https://doi.org/10.1016/J.ENBUILD.2023.113436

[7] Li D, Qi Z, Zhou Y, Elchalakani M. Machine learning applications in building energy systems: review and prospects. Buildings. 2025; 648(15): 648. https://doi.org/10.3390/BUILDINGS15040648

[8] Agostinelli S, Cumo F, Guidi G, Tomazzoli C. Cyber-physical systems improving building energy management: digital twin and artificial intelligence. Energies. 2021; 14: 2338. https://doi.org/10.3390/EN14082338

[9] Mariano-Hernández D, Hernández-Callejo L, Zorita-Lamadrid A, et al. A review of strategies for building energy management system: Model predictive control, demand side management, optimization, and fault detect & diagnosis. J Build Eng. 2021; 33: 101692. https://doi.org/10.1016/J.JOBE.2020.101692

[10] Behzadi A, Thorin E, Duwig C, Sadrizadeh S. Supply-demand side management of a building energy system driven by solar and biomass in Stockholm: A smart integration with minimal cost and emission. Energy Convers Manag. 2023; 292: 117420. https://doi.org/10.1016/J.ENCONMAN.2023.117420

[11] Shen R, Zhong S, Wen X, et al. Multi-agent deep reinforcement learning optimization framework for building energy system with renewable energy. Appl Energy. 2022; 312: 118724. https://doi.org/10.1016/J.APENERGY.2022.118724

[12] Ramesh S, N SB, Sathyavarapu SJ, et al. Comparative analysis of Q-learning, SARSA, and deep Q-network for microgrid energy management. Sci Rep. 2025; 15: 1-11. https://doi.org/10.1038/S41598-024-83625-8

[13] Vázquez-Canteli JR, Nagy Z. Reinforcement learning for demand response: A review of algorithms and modeling techniques. Appl Energy. 2019; 235: 1072-1089. https://doi.org/10.1016/J.APENERGY.2018.11.002

[14] Menos-aikateriniadis C, Lamprinos I, Georgilakis PS. Particle swarm optimization in residential demand-side management: a review on scheduling and control algorithms for demand response provision. Energies. 2022; 15: 2211. https://doi.org/10.3390/EN15062211

[15] Paul K, Jyothi B, Kumar RS, et al. Optimizing sustainable energy management in grid connected microgrids using quantum particle swarm optimization for cost and emission reduction. Sci Rep. 2025; 15: 1-20. https://doi.org/10.1038/S41598-025-90040-0

[16] Latoń D, Grela J, Ożadowicz A. Applications of deep reinforcement learning for home energy management systems: a review. Energies. 2024; 17: 6420. https://doi.org/10.3390/EN17246420

[17] Liu Y, Zhang D, Gooi HB. Optimization strategy based on deep reinforcement learning for home energy management. CSEE Journal of Power and Energy Syst. 2020; 6: 572-582. https://doi.org/10.17775/CSEEJPES.2019.02890

[18] Ojand K, Dagdougui H. Q-Learning-based model predictive control for energy management in residential aggregator. IEEE Trans Autom Sci Eng. 2022; 19: 70-81. https://doi.org/10.1109/TASE.2021.3091334

[19] Gbadega PA, Sun Y. A hybrid constrained particle swarm optimization-model predictive control (CPSO-MPC) algorithm for storage energy management optimization problem in micro-grid. Energy Rep. 2022; 8: 692-708. https://doi.org/10.1016/J.EGYR.2022.10.035

[20] Liu J, Wang M, Peng J, et al. Techno-economic design optimization of hybrid renewable energy applications for high-rise residential buildings. Energy Convers Manag. 2020; 213: 112868. https://doi.org/10.1016/J.ENCONMAN.2020.112868

[21] Das BK, Alotaibi MA, Das P, et al. Feasibility and techno-economic analysis of stand-alone and grid-connected PV/Wind/Diesel/Batt hybrid energy system: a case study. Energy Strategy Reviews. 2021; 37: 100673. https://doi.org/10.1016/J.ESR.2021.100673

[22] Emrani A, Berrada A, Arechkik A, Bakhouya M. Improved techno-economic optimization of an off-grid hybrid solar/wind/gravity energy storage system based on performance indicators. J Energy Storage. 2022; 49: 104163. https://doi.org/10.1016/J.EST.2022.104163

[23] Wankouo Ngouleu CA, Koholé YW, Fohagui FCV, Tchuen G. Optimum design and scheduling strategy of an off-grid hybrid photovoltaic-wind-diesel system with an electrochemical, mechanical, chemical and thermal energy storage systems: A comparative scrutiny. Appl Energy. 2025; 377: 124646. https://doi.org/10.1016/J.APENERGY.2024.124646

[24] Chegari B, Tabaa M, Simeu E, El Ganaoui M. Optimal energy management of a hybrid system composed of PV, wind turbine, pumped hydropower storage, and battery storage to achieve a complete energy self-sufficiency in residential buildings. IEEE Access. 2024; 12: 126624-126639. https://doi.org/10.1109/ACCESS.2024.3454149

[25] Medghalchi Z, Taylan O. A novel hybrid optimization framework for sizing renewable energy systems integrated with energy storage systems with solar photovoltaics, wind, battery and electrolyzer-fuel cell. Energy Convers Manag. 2023; 294: 117594. https://doi.org/10.1016/J.ENCONMAN.2023.117594

[26] Jahanbin A, Abdolmaleki L, Berardi U. Techno-economic feasibility of integrating hybrid battery-hydrogen energy storage system into an academic building. Energy Convers Manag. 2024; 309: 118445. https://doi.org/10.1016/J.ENCONMAN.2024.118445

[27] Abbas AK, Ayop R, Tan CW, et al. Advanced energy-management and sizing techniques for renewable microgrids with electric-vehicle integration: a review. Res Eng. 2025; 27: 106252. https://doi.org/10.1016/J.RINENG.2025.106252

[28] Iqbal S, Sarfraz M, Ayyub M, et al. A comprehensive review on residential demand side management strategies in smart grid environment. Sustainability. 2021; 13: 7170. https://doi.org/10.3390/SU13137170

[29] Hemanth GR, Charles Raja S, Jeslin Drusila Nesamalar J, Senthil Kumar J. Cost effective energy consumption in a residential building by implementing demand side management in the presence of different classes of power loads. Adv Buil Energy Res. 2022; 16: 145-170. https://doi.org/10.1080/17512549.2020.1752799

[30] Farrokhifar M, Bahmani H, Faridpak B, et al. Model predictive control for demand side management in buildings: a survey. Sustain Cities Soc. 2021; 75: 103381. https://doi.org/10.1016/J.SCS.2021.103381

[31] Tepe İF, Irmak E. Optimizing real-time demand response in smart homes through fuzzy-based energy management and control system. Electrical Engineering 2025; 107: 2121-2145. https://doi.org/10.1007/S00202-024-02613-3

[32] Jasim AM, Jasim BH, Flah A, et al. A new optimized demand management system for smart grid-based residential buildings adopting renewable and storage energies. Energy Rep. 2023; 9: 4018-4035. https://doi.org/10.1016/J.EGYR.2023.03.038

[33] Fernández Bandera C, Bastos Porsani G, Fernández-Vigil Iglesias M. A demand side management approach to increase self-consumption in buildings. Buil Simul. 2022; 16: 317-335. https://doi.org/10.1007/S12273-022-0933-9

[34] Philipo GH, Kakande JN, Krauter S. Neural network-based demand-side management in a stand-alone solar pv-battery microgrid using load-shifting and peak-clipping. Energies. 2022; 15: 5215. https://doi.org/10.3390/EN15145215

[35] Doma A, Padsala R, Ouf MM, Eicker U. Bottom-up framework for modelling occupancy-based demand-side management strategies in a mixed-use district. Appl Energy. 2024; 375: 124081. https://doi.org/10.1016/J.APENERGY.2024.124081

[36] Naccarelli R, Serroni S, Casaccia S, et al. Methodological approach for optimizing demand response in building energy management through AI-enhanced comfort-based flexibility models. In: 2024 9th International Conference on Smart and Sustainable Technologies, (SpliTech, 2024). https://doi.org/10.23919/SPLITECH61897.2024.10612382

[37] Archive Reference Buildings by Building Type: Midrise Apartment | Department of Energy; 2025. https://www.energy.gov/eere/articles/archive-reference-buildings-building-type-midrise-apartment. Accessed 27 Sep 2025

[38] NASA. NASA Prediction Of Worldwide Energy Resource (POWER); 2020. https://Power.Larc.Nasa.Gov/Data-Access-Viewer/

[39] Florida Power & Light (FPL) Time-of-Use (TOU) rates; 2025. https://www.fpl.com/rates/time-of-use.html. Accessed 28 Jun 2025

[40] Yaouba, Zieba Falama R, Ngangoum Welaji F, et al. Optimal decision-making on hybrid off-grid systems for rural and remote areas electrification in the Northern Cameroon. J Electr Comput Eng. 2022: 1-14. https://doi.org/10.1155/2022/5316520