Distributed context-aware Transformer-enabled dynamic energy consumption prediction for smart building networks^✩

Abstract

The integration of communication networks and artificial intelligence enables the effective collection of data over smart building networks, facilitating more accurate predictions of Building Energy Consumption (BEC). However, existing schemes for BEC prediction suffer from limited dynamic adaptability, risks of privacy leakage, and the inability to accurately capture actual energy consumption patterns. To improve prediction accuracy while ensuring privacy and dynamic adaptability, we propose a novel BEC prediction design that incorporates dynamic threshold participation and privacy-preserving mechanisms. Specifically, we design a three-tier network architecture integrated with threshold participation tokens to support dynamic access and dropout of building entities during the BEC model construction process. Furthermore, we develop a Context-Aware Transformer (CAT) network integrated into Federated Learning (FL) to enhance feature sensitivity and facilitate the sharing of knowledge derived from Internet of Things (IoT) data and BEC features. Finally, we evaluate the performance of our design using real-world data, and the results demonstrate that our design achieves superior performance in distributed BEC prediction.

Keywords

Smart building / Dynamic BEC prediction / Context-aware Transformer / Privacy preservation / Federated learning

CRediT authorship contribution statement

Rui Dai: Writing -- original draft, Software, Methodology, Data curation, Conceptualization. Ge Bai: Writing -- review & editing, Supervision, Funding acquisition.

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgements

This work is partially supported by the Fund for Humanities and Social Science Research from the Ministry of Education (China, 23YJA760002).

References

[1] Y. Cardinale, G. Freites, E. Valderrama, A. Aguilera, C. Angsuchotmetee, Semantic framework of event detection in emergency situations for smart buildings, Digit. Commun. Netw. 8 (1) (2022) 64-79.

[2] X. Chen, B. Vand, S. Baldi, Challenges and strategies for achieving high energy efficiency in building districts, Buildings 14 (6) (2024) 1839.

[3] A.—R. Ali—Tagba, M. Baneto, D.D. Lucache, Factors influencing the energy consumption in a building: comparative study between two different climates, Energies 17 (16) (2024) 4041.

[4] T. Haida, S. Muto, Y. Takahashi, Y. Ishi, Peak load forecasting using multiple—year data with trend data processing techniques, Electr. Eng. Jpn. 124 (1) (1998) 7-16.

[5] Y. Chen, W. Liu, Z. Niu, Z. Feng, Q. Hu, T. Jiang, Pervasive intelligent endogenous 6G wireless systems: prospects, theories and key technologies, Digit. Commun. Netw. 6 (3) (2020) 312-320.

[6] M.A.M. Daut, M.Y. Hassan, H. Abdullah, H.A. Rahman, M.P. Abdullah, F. Hussin, Building electrical energy consumption forecasting analysis using conventional and artificial intelligence methods: a review, Renew. Sustain. Energy Rev. 70 (2017) 1108-1118.

[7] W. Mai, C. Chung, T. Wu, W.C. Wong, Electric load forecasting for large office building based on radial basis function neural network, in: Proceedings of the 2014 IEEE PES General Meeting Conference & Exposition, IEEE, 2014, pp. 1-5.

[8] C. Roldán—Blay, G. Escrivá—Escrivá, C. Álvarez—Bel, C. Roldán—Porta, J. Rodríguez—García, Upgrade of an artificial neural network prediction method for electrical consumption forecasting using an hourly temperature curve model, Energy Build. 60 (2013) 38-46.

[9] Y. Wei, L. Xia, S. Pan, J. Wu, X. Zhang, M. Han, W. Zhang, J. Xie, Q. Li, Prediction of occupancy level and energy consumption in office building using blind system identification and neural networks, Appl. Energy 240 (2019) 276-294.

[10] X. Deng, Y. Zhang, Y. Zhang, H. Qi, Toward smart multizone HVAC control by combining context—aware system and deep reinforcement learning, IEEE Internet Things J. 9 (21) (2022) 21010-21024.

[11] A. Bailly, C. Blanc, É. Francis, T. Guillotin, F. Jamal, B. Wakim, P. Roy, Effects of dataset size and interactions on the prediction performance of logistic regression and deep learning models, Comput. Methods Programs Biomed. 213 (2022) 106504.

[12] G. Zhang, Q. Hu, Y. Zhang, Y. Dai, T. Jiang, Lightweight cross—domain authentication scheme for securing wireless iot devices using backscatter communication, IEEE Internet Things J. 11 (12) (2024) 22021-22035.

[13] Q. Yang, Y. Liu, T. Chen, Y. Tong, Federated machine learning: concept and applications, ACM Trans. Intell. Syst. Technol. 10 (2) (2019) 1-19.

[14] V. Tanasiev, G.C. Pătru, D. Rosner, G. Sava, H. Necula, A. Badea, Enhancing environmental and energy monitoring of residential buildings through IoT, Autom. Constr. 126 (2021) 103662.

[15] G. Bedi, G.K. Venayagamoorthy, R. Singh, Development of an IoT—driven building environment for prediction of electric energy consumption, IEEE Internet Things J. 7 (6) (2020) 4912-4921.

[16] C.K. Metallidou, K.E. Psannis, E.A. Egyptiadou, Energy efficiency in smart buildings: IoT approaches, IEEE Access 8 (2020) 63679-63699.

[17] Y. Gao, S. Li, Y. Xiao, W. Dong, M. Fairbank, B. Lu, An iterative optimization and learning—based iot system for energy management of connected buildings, IEEE Internet Things J. 9 (21) (2022) 21246-21259.

[18] C. Zhang, Z. Li, H. Jiang, Y. Luo, S. Xu, Deep learning method for evaluating photovoltaic potential of urban land—use: a case study of Wuhan, China, Appl. Energy 283 (2021) 116329.

[19] H. Xiao, W. Hu, H. Zhou, G.—P. Liu, Prediction—based power consumption monitoring of industrial equipment using interpretable data—driven models, IEEE Trans. Autom. Sci. Eng. 21 (2) (2024) 1312-1322.

[20] G. Piras, F. Muzi, V.A. Tiburcio, Digital management methodology for building production optimization through digital twin and artificial intelligence integration, Buildings 14 (7) (2024) 2110.

[21] W. Jin, Q. Fu, J. Chen, Y. Wang, L. Liu, Y. Lu, H. Wu, A novel building energy consumption prediction method using deep reinforcement learning with consideration of fluctuation points, J. Build. Eng. 63 (2023) 105458.

[22] J. Gao, B. Hou, X. Guo, Z. Liu, Y. Zhang, K. Chen, J. Li, Secure aggregation is insecure: category inference attack on federated learning, IEEE Trans. Dependable Secure Comput. 20 (1) (2023) 147-160.

[23] P. Zhao, Z. Cao, J. Jiang, F. Gao, Practical private aggregation in federated learning against inference attack, IEEE Internet Things J. 10 (1) (2023) 318-329.

[24] R. Shokri, M. Stronati, C. Song, V. Shmatikov, Membership inference attacks against machine learning models, in: Proceedings of the 2017 IEEE Symposium on Security and Privacy (SP), IEEE, 2017, pp. 3-18.

[25] V. Shejwalkar, A. Houmansadr, Manipulating the Byzantine: optimizing model poisoning attacks and defenses for federated learning, in: Proceedings of the NDSS, 2021.

[26] A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L.u. Kaiser, I. Polosukhin, Attention is all you need, in: I. Guyon, U.V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, R. Garnett (Eds.), Proceedings of the Advances in Neural Information Processing Systems 30, 2017.

[27] B. McMahan, E. Moore, D. Ramage, S. Hampson, B.A. y Arcas, Communication—efficient learning of deep networks from decentralized data, in: Artificial Intelligence and Statistics, PMLR, 2017, pp. 1273-1282.

[28] M. Hearst, S. Dumais, E. Osuna, J. Platt, B. Scholkopf, Support vector machines, IEEE Intell. Syst. Appl. 13 (4) (1998) 18-28.

[29] A. Graves, Long Short—Term Memory, Springer Berlin Heidelberg, Berlin, Heidelberg, 2012, pp. 37-45.

[30] H. Li, Z. Cai, J. Wang, J. Tang, W. Ding, C.—T. Lin, Y. Shi, FedTP: federated learning by transformer personalization, IEEE Trans. Neural Netw. Learn. Syst. 35 (10) (2024) 13426-13440.

[31] S.T. Ahmed, V. Vinoth Kumar, T. Mahesh, L. Narasimha Prasad, A. Velmurugan, V. Muthukumaran, V. Niveditha, FedOPT: federated learning—based heterogeneous resource recommendation and optimization for edge computing, Soft Comput. (2024) 1-12.