Applications of thermostatically controlled loads for demand response with the proliferation of variable renewable energy

Abstract

More flexibility is desirable with the proliferation of variable renewable resources for balancing supply and demand in power systems.Thermostatically controlled loads (TCLs) attract tremendous attentions because of their specific thermal inertia capability in demand response (DR) programs. To effectively manage numerous and distributed TCLs, intermediate coordinators, e.g., aggregators, as a bridge between end users and dispatch operators are required to model and control TCLs for serving the grid. Specifically, intermediate coordinators get the access to fundamental models and response modes of TCLs, make control strategies, and distribute control signals to TCLs according the requirements of dispatch operators. On the other hand, intermediate coordinators also provide dispatch models that characterize the external characteristics of TCLs to dispatch operators for scheduling different resources. In this paper, the bottom-up key technologies of TCLs in DR programs based on the current research have been reviewed and compared, including fundamental models, response modes, control strategies, dispatch models and dispatch strategies of TCLs, as well as challenges and opportunities in future work.

Graphical abstract

Keywords

thermostatically controlled load / demand response / renewable energy / power system operation

References

[1] Wu H, Shahidehpour M, Alabdulwahab A, . Demand response exchange in the stochastic day-ahead scheduling with variable renewable generation. IEEE Transactions on Sustainable Energy, 2015, 6(2): 516–525

[2] Sajjad I, Chicco G, Napoli R. Definitions of demand flexibility for aggregate residential loads. IEEE Transactions on Smart Grid, 2016, 7(6): 2633–2643

[3] Radaideh A, Vaidya U, Ajjarapu V. Sequential set-point control for heterogeneous thermostatically controlled loads through an extended Markov chain abstraction. IEEE Transactions on Smart Grid, 2019, 10(1): 116–127

[4] Kohlhepp P, Harb H, Wolisz H, . Large-scale grid integration of residential thermal energy storages as demand-side flexibility resource: a review of international field studies. Renewable & Sustainable Energy Reviews, 2019, 101: 527–547

[5] Xu X, Yan Z, Shahidehpour M, . Data-driven risk-averse two-stage optimal stochastic scheduling of energy and reserve with correlated wind power. IEEE Transactions on Sustainable Energy, 2020, 11(1): 436–447

[6] Erdinc O, Tascikaraoglu A, Paterakis N, . End-user comfort oriented day-ahead planning for responsive residential HVAC demand aggregation considering weather forecasts. IEEE Transactions on Smart Grid, 2017, 8(1): 362–372

[7] Kim Y J, Norford L K, Kirtley J L. Modeling and analysis of a variable speed heat pump for frequency regulation through direct load control. IEEE Transactions on Power Systems, 2015, 30(1): 397–408

[8] Song M, Gao C, Yan H, . Thermal battery modeling of inverter air conditioning for demand response. IEEE Transactions on Smart Grid, 2018, 9(6): 5522–5534

[9] Hao H, Wu D, Lian J, . Optimal coordination of building loads and energy storage for power grid and end user services. IEEE Transactions on Smart Grid, 2018, 9(5): 4335–4345

[10] Pahwa A, Brice C W. Modeling and system identification of residential air conditionning load. IEEE Transactions on Power Apparatus and Systems, 1985, 104(6): 1418–1425

[11] Song M, Gao C, Su W. Modeling and controlling of air-conditioning load for demand response applications. Automation of Electric Power Systems, 2016, 40(14): 158–167 (in Chinese)

[12] Molina A, Gabaldon A, Fuentes J A, . Implementation and assessment of physically based electrical load models: application to direct load control residential programmes. IEE Proceedings. Generation, Transmission and Distribution, 2003, 150(1): 61–66

[13] Iacovella S, Ruelens F, Vingerhoets P, . Cluster control of heterogeneous thermostatically controlled loads using tracer devices. IEEE Transactions on Smart Grid, 2017, 8(2): 528–536

[14] Hao H, Corbin C D, Kalsi K, . Transactive control of commercial buildings for demand response. IEEE Transactions on Power Systems, 2017, 32(1): 774–783

[15] Wu X, He J, Xu Y, . Hierarchical control of residential HVAC units for primary frequency regulation. IEEE Transactions on Smart Grid, 2018, 9(4): 3844–3856

[16] Song M, Gao C, Shahidehpour M, . Impact of uncertain parameters on TCL power capacity calculation via HDMR for generating power pulses. IEEE Transactions on Smart Grid, 2019, 10(3): 3112–3124

[17] Wai C H, Beaudin M, Zareipour H, . Cooling devices in demand response: a comparison of control methods. IEEE Transactions on Smart Grid, 2015, 6(1): 249–260

[18] Sinitsyn N A, Kundu S, Backhaus S. Safe protocols for generating power pulses with heterogeneous populations of thermostatically controlled loads. Energy Conversion and Management, 2013, 67: 297–308

[19] Lu N, Zhang Y. Design considerations of a centralized load controller using thermostatically controlled appliances for continuous regulation reserves. IEEE Transactions on Smart Grid, 2013, 4(2): 914–921

[20] Hu J, Cao J, Yong T, . Demand response load following of source and load systems. IEEE Transactions on Control Systems Technology, 2017, 25(5): 1586–1598

[21] Kim Y J, Fuentes E, Norford L K. Experimental study of grid frequency regulation ancillary service of a variable speed heat pump. IEEE Transactions on Power Systems, 2016, 31(4): 3090–3099

[22] Song M, Cao C W, Shahidehpour M, . Multi-time-scale modeling and parameter estimation of TCLs for smoothing out wind power generation variability. IEEE Transactions on Sustainable Energy, 2019, 10(1): 105–118

[23] Malhame R, Chong C Y. Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system. IEEE Transactions on Automatic Control, 1985, 30(9): 854–860

[24] Tindemans S H, Trovato V, Strbac G. Decentralized control of thermostatic loads for flexible demand response. IEEE Transactions on Control Systems Technology, 2015, 23(5): 1685–1700

[25] Bashash S, Fathy H K. Modeling and control of aggregate air conditioning loads for robust renewable power management. IEEE Transactions on Control Systems Technology, 2013, 21(4): 1318–1327

[26] Kamgarpour M, Ellen C, Soudjani S E Z, . Modeling options for demand side participation of thermostatically controlled loads. In: Bulk Power System Dynamics and Control- IX Optimization, Security and Control of the Emerging Power Grid (IREP), Rethymno, Greece, 2013

[27] Song M, Gao C, Shahidehpour M, . State space modeling and control of aggregated TCLs for regulation services in power grids. IEEE Transactions on Smart Grid, 2019, 10(4): 4095–4106

[28] Song M, Cao C, Yang J, . Novel aggregate control model of air conditioning loads for fast regulation service. IET Generation, Transmission & Distribution, 2017, 11(17): 4391–4401

[29] Liu M, Shi Y. Model predictive control of aggregated heterogeneous second-order thermostatically controlled loads for ancillary services. IEEE Transactions on Power Systems, 2016, 31(3): 1963–1971

[30] Hu J, Cao J, Chen M Z Q, . Load following of multiple heterogeneous TCL aggregators by centralized control. IEEE Transactions on Power Systems, 2017, 32(4): 3157–3167

[31] Liu M, Shi Y, Liu X. Distributed MPC of aggregated heterogeneous thermostatically controlled loads in smart grid. IEEE Transactions on Industrial Electronics, 2016, 63(2): 1120–1129

[32] Mathieu J L, Koch S, Callaway D S. State estimation and control of electric loads to manage real-time energy imbalance. IEEE Transactions on Power Systems, 2013, 28(1): 430–440

[33] Lu N. An evaluation of the HVAC load potential for providing load balancing service. IEEE Transactions on Smart Grid, 2012, 3(3): 1263–1270

[34] Esmaeil Zadeh Soudjani S, Abate A. Aggregation and control of populations of thermostatically controlled loads by formal abstractions. IEEE Transactions on Control Systems Technology, 2015, 23(3): 975–990

[35] Li C, Chen Y, Luo F, . Real-time decision making model for thermostatically controlled load aggregators by natural aggregation algorithm. In: IEEE International Conference on Energy Internet, Beijing, China, 2017

[36] Radaideh A, Vaidya U, Ajjarapu V. Sequential set-point control for heterogeneous thermostatically controlled loads through an extended markov chain abstraction. IEEE Transactions on Smart Grid, 2019, 10(1): 116–127

[37] Bhattarai B P, de Cerio Mendaza I D, Myers K S, . Optimum aggregation and control of spatially distributed flexible resources in smart grid. IEEE Transactions on Smart Grid, 2018, 9(5): 5311–5322

[38] Bashash S, Fathy H K. Modeling and control insights into demand-side energy management through setpoint control of thermostatic loads. In: Proceedings of the 2011 American Control Conference, San Francisco, CA, USA, 2011

[39] Hao H, Sanandaji B M, Poolla K, . Aggregate flexibility of thermostatically controlled loads. IEEE Transactions on Power Systems, 2015, 30(1): 189–198

[40] Ruelens F, Claessens B J, Vandael S, . Residential demand response applications using batch reinforcement learning. IEEE Transactions on Smart Grid, 2017, 8(5): 2149–2159

[41] Vrettos E, Ziras C, Andersson G. Fast and reliable primary frequency reserves from refrigerators with decentralized stochastic control. IEEE Transactions on Power Systems, 2017, 32(4): 2924–2941

[42] Molina-Garcia A, Bouffard F, Kirschen D S. Decentralized demand-side contribution to primary frequency control. IEEE Transactions on Power Systems, 2011, 26(1): 411–419

[43] Guo D, Zhang W, Yan G, . Decentralized control of aggregated loads for demand response. In: 2013 American Control Conference (ACC), Washington D.C., USA, 2013

[44] Meng K, Wang D, Dong Z Y, . Distributed control of thermostatically controlled loads in distribution network with high penetration of solar PV. CSEE Journal of Power and Energy Systems., 2017, 3(1): 53–62

[45] Saker N, Petit M, Vannier J C, . Demand side management of electrical water heaters and evaluation of the cold load pick-up characteristics. In: 2011 IEEE Trondheim PowerTech, Trondheim, Norway, 2011

[46] Perfumo C, Braslavsky J, Ward J K. A sensitivity analysis of the dynamics of a population of thermostatically-controlled loads. In: 2013 Australasian Universities Power Engineering Conference (AUPEC), Hobart, TAS, Australia, 2013

[47] Gilvanejad M, Askarian Abyaneh H, Mazlumi K. Estimation of cold-load pickup occurrence rate in distribution systems. IEEE Transactions on Power Delivery, 2013, 28(2): 1138–1147

[48] Wang D, Lu N, Miao W, . Performance evaluation of controlling thermostatically controlled appliances as virtual generators using comfort-constrained state-queueing models. IET Generation Transmission & Distribution, 2014, 8(4): 591–599

[49] Mahdavi N, Braslavsky J H, Perfumo C. Mapping the effect of ambient temperature on the power demand of populations of air conditioners. IEEE Transactions on Smart Grid, 2018, 9(3): 1540–1550

[50] Ruiz N, Cobelo I, Oyarzabal J. A direct load control model for virtual power plant management. IEEE Transactions on Power Systems, 2009, 24(2): 959–966

[51] Trovato V, Tindemans S H, Strbac G. The leaky storage model for optimal multi-service allocation of thermostatic loads. IET Generation, Transmission & Distribution, 2016, 10(3): 585–593

[52] Trovato V, Tindemans S H, Strbac G. Security constrained economic dispatch with flexible thermostatically controlled loads. In: IEEE PES Innovative Smart Grid Technologies, Istanbul, Turkey, 2014

[53] Song M, Gao C, Yang J, . Energy storage modeling of inverter air conditioning for output optimizing of wind generation in the electricity market. CSEE Journal of Power & Energy Systems, 2018, 4(3): 305–315

[54] Luo F, Dong Z Y, Meng K, . An operational planning framework for large-scale thermostatically controlled load dispatch. IEEE Transactions on Industrial Informatics, 2017, 13(1): 217–227

[55] Zhao L, Zhang W, Hao H, . A geometric approach to aggregate flexibility modeling of thermostatically controlled loads. IEEE Transactions on Power Systems, 2017, 32(6): 4721–4731

[56] Mathieu J L, Kamgarpour M, Lygeros J, . Arbitraging intraday wholesale energy market prices with aggregations of thermostatic loads. IEEE Transactions on Power Systems, 2015, 30(2): 763–772

[57] Kurucz C N, Brandt D, Sim S. A linear programming model for reducing system peak through customer load control programs. IEEE Transactions on Power Systems, 1996, 11(4): 1817–1824

[58] Yang H T, Huang K Y. Direct load control using fuzzy dynamic programming. IEE Proceedings–Generation, Transmission and Distribution, 1999, 146(3): 294–300

[59] Lee T F, Cho M Y, Hsiao Y C, . Optimization and implementation of a load control scheduler using relaxed dynamic programming for large air conditioner loads. IEEE Transactions on Power Systems, 2008, 23(2): 691–702

[60] Chu C M, Jong T L, Huang Y W. Mitigating DLC constraints of air-conditioning loads using a group-DLC method. In: 2007 IEEE Power Engineering Society General Meeting, Tampa, FL, USA, 2007

[61] Wen Y, Li W, Huang G, . Frequency dynamics constrained unit commitment with battery energy storage. IEEE Transactions on Power Systems, 2016, 31(6): 5115–5125

[62] Ning Y, Li X, Ma X, . Optimal schedule strategy of battery energy storage systems for peak load shifting based on interior point method. In: 2016 12th World Congress on Intelligent Control and Automation (WCICA), Guilin, China, 2016

[63] Li N, Uckun C, Constantinescu E M, . Flexible operation of batteries in power system scheduling with renewable energy. IEEE Transactions on Sustainable Energy, 2016, 7(2): 685–696

[64] Lujano-Rojas J M, Dufo-Lopez R, Bernal-Agustin J L, . Optimizing daily operation of battery energy storage systems under real-time pricing schemes. IEEE Transactions on Smart Grid, 2017, 8(1): 316–330

[65] Hutchison G, Giaouris D, Gadoue S, . Non-invasive identification of turbo-generator parameters from actual transient network data. IET-Generation Transmission & Distribution, 2015, 9(11): 1129–1136

[66] Mahdavi N, Braslavsky J H, Seron M M, . Model predictive control of distributed air-conditioning loads to compensate fluctuations in solar powe. IEEE Transactions on Smart Grid, 2017, 8(6): 3055–3065

[67] Mathieu J L, Callaway D S. State estimation and control of heterogeneous thermostatically controlled loads for load following. In: 2012 45th Hawaii International Conference on System Sciences, Maui, HI, USA, 2012

[68] Vanouni M, Lu N. A reward allocation mechanism for thermostatically controlled loads participating in intra-hour ancillary services. IEEE Transactions on Smart Grid, 2018, 9(5): 4209–4219

[69] Renani Y K, Ehsan M, Shahidehpour M. Optimal transactive market operations with distribution system operators. IEEE Transactions on Smart Grid, 2018, 9(6): 6692–6701

[70] Gregoratti D, Matamoros J. Distributed energy trading: the multiple-microgrid case. Industrial Electronics IEEE Transactions on Industrial Electronics, 2015, 62(4): 2551–2559

[71] Liu Z, Wu Q, Shahidehpour M, . Transactive real-time electric vehicle charging management for commercial buildings with PV on-site generation. IEEE Transactions on Smart Grid, 2019, 10(5): 4939–4950

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (Grant No. 52007030), the US National Science Foundation (Grant No. ECCS-1552073), and awards of the US Department of Energy (DE-EE0007998 and DE-EE0009028).

RIGHTS & PERMISSIONS

2021 Higher Education Press