Applications of thermostatically controlled loads for demand response with the proliferation of variable renewable energy

Abstract

More flexibility is desirable with the proliferation of variable renewable resources for balancing supply and demand in power systems.Thermostatically controlled loads (TCLs) attract tremendous attentions because of their specific thermal inertia capability in demand response (DR) programs. To effectively manage numerous and distributed TCLs, intermediate coordinators, e.g., aggregators, as a bridge between end users and dispatch operators are required to model and control TCLs for serving the grid. Specifically, intermediate coordinators get the access to fundamental models and response modes of TCLs, make control strategies, and distribute control signals to TCLs according the requirements of dispatch operators. On the other hand, intermediate coordinators also provide dispatch models that characterize the external characteristics of TCLs to dispatch operators for scheduling different resources. In this paper, the bottom-up key technologies of TCLs in DR programs based on the current research have been reviewed and compared, including fundamental models, response modes, control strategies, dispatch models and dispatch strategies of TCLs, as well as challenges and opportunities in future work.

Key words： thermostatically controlled load; demand response; renewable energy; power system operation

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (Grant No. 52007030), the US National Science Foundation (Grant No. ECCS-1552073), and awards of the US Department of Energy (DE-EE0007998 and DE-EE0009028).

References

1 Wu H, Shahidehpour M, Alabdulwahab A, . Demand response exchange in the stochastic day-ahead scheduling with variable renewable generation. IEEE Transactions on Sustainable Energy, 2015, 6(2): 516–525

2 Sajjad I, Chicco G, Napoli R. Definitions of demand flexibility for aggregate residential loads. IEEE Transactions on Smart Grid, 2016, 7(6): 2633–2643

3 Radaideh A, Vaidya U, Ajjarapu V. Sequential set-point control for heterogeneous thermostatically controlled loads through an extended Markov chain abstraction. IEEE Transactions on Smart Grid, 2019, 10(1): 116–127

4 Kohlhepp P, Harb H, Wolisz H, . Large-scale grid integration of residential thermal energy storages as demand-side flexibility resource: a review of international field studies. Renewable & Sustainable Energy Reviews, 2019, 101: 527–547

5 Xu X, Yan Z, Shahidehpour M, . Data-driven risk-averse two-stage optimal stochastic scheduling of energy and reserve with correlated wind power. IEEE Transactions on Sustainable Energy, 2020, 11(1): 436–447

6 Erdinc O, Tascikaraoglu A, Paterakis N, . End-user comfort oriented day-ahead planning for responsive residential HVAC demand aggregation considering weather forecasts. IEEE Transactions on Smart Grid, 2017, 8(1): 362–372

7 Kim Y J, Norford L K, Kirtley J L. Modeling and analysis of a variable speed heat pump for frequency regulation through direct load control. IEEE Transactions on Power Systems, 2015, 30(1): 397–408

8 Song M, Gao C, Yan H, . Thermal battery modeling of inverter air conditioning for demand response. IEEE Transactions on Smart Grid, 2018, 9(6): 5522–5534

9 Hao H, Wu D, Lian J, . Optimal coordination of building loads and energy storage for power grid and end user services. IEEE Transactions on Smart Grid, 2018, 9(5): 4335–4345

10 Pahwa A, Brice C W. Modeling and system identification of residential air conditionning load. IEEE Transactions on Power Apparatus and Systems, 1985, 104(6): 1418–1425

11 Song M, Gao C, Su W. Modeling and controlling of air-conditioning load for demand response applications. Automation of Electric Power Systems, 2016, 40(14): 158–167 (in Chinese)

12 Molina A, Gabaldon A, Fuentes J A, . Implementation and assessment of physically based electrical load models: application to direct load control residential programmes. IEE Proceedings. Generation, Transmission and Distribution, 2003, 150(1): 61–66

13 Iacovella S, Ruelens F, Vingerhoets P, . Cluster control of heterogeneous thermostatically controlled loads using tracer devices. IEEE Transactions on Smart Grid, 2017, 8(2): 528–536

14 Hao H, Corbin C D, Kalsi K, . Transactive control of commercial buildings for demand response. IEEE Transactions on Power Systems, 2017, 32(1): 774–783

15 Wu X, He J, Xu Y, . Hierarchical control of residential HVAC units for primary frequency regulation. IEEE Transactions on Smart Grid, 2018, 9(4): 3844–3856

16 Song M, Gao C, Shahidehpour M, . Impact of uncertain parameters on TCL power capacity calculation via HDMR for generating power pulses. IEEE Transactions on Smart Grid, 2019, 10(3): 3112–3124

17 Wai C H, Beaudin M, Zareipour H, . Cooling devices in demand response: a comparison of control methods. IEEE Transactions on Smart Grid, 2015, 6(1): 249–260

18 Sinitsyn N A, Kundu S, Backhaus S. Safe protocols for generating power pulses with heterogeneous populations of thermostatically controlled loads. Energy Conversion and Management, 2013, 67: 297–308

19 Lu N, Zhang Y. Design considerations of a centralized load controller using thermostatically controlled appliances for continuous regulation reserves. IEEE Transactions on Smart Grid, 2013, 4(2): 914–921

20 Hu J, Cao J, Yong T, . Demand response load following of source and load systems. IEEE Transactions on Control Systems Technology, 2017, 25(5): 1586–1598

21 Kim Y J, Fuentes E, Norford L K. Experimental study of grid frequency regulation ancillary service of a variable speed heat pump. IEEE Transactions on Power Systems, 2016, 31(4): 3090–3099

22 Song M, Cao C W, Shahidehpour M, . Multi-time-scale modeling and parameter estimation of TCLs for smoothing out wind power generation variability. IEEE Transactions on Sustainable Energy, 2019, 10(1): 105–118

23 Malhame R, Chong C Y. Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system. IEEE Transactions on Automatic Control, 1985, 30(9): 854–860

24 Tindemans S H, Trovato V, Strbac G. Decentralized control of thermostatic loads for flexible demand response. IEEE Transactions on Control Systems Technology, 2015, 23(5): 1685–1700

25 Bashash S, Fathy H K. Modeling and control of aggregate air conditioning loads for robust renewable power management. IEEE Transactions on Control Systems Technology, 2013, 21(4): 1318–1327

26 Kamgarpour M, Ellen C, Soudjani S E Z, . Modeling options for demand side participation of thermostatically controlled loads. In: Bulk Power System Dynamics and Control- IX Optimization, Security and Control of the Emerging Power Grid (IREP), Rethymno, Greece, 2013

27 Song M, Gao C, Shahidehpour M, . State space modeling and control of aggregated TCLs for regulation services in power grids. IEEE Transactions on Smart Grid, 2019, 10(4): 4095–4106

28 Song M, Cao C, Yang J, . Novel aggregate control model of air conditioning loads for fast regulation service. IET Generation, Transmission & Distribution, 2017, 11(17): 4391–4401

29 Liu M, Shi Y. Model predictive control of aggregated heterogeneous second-order thermostatically controlled loads for ancillary services. IEEE Transactions on Power Systems, 2016, 31(3): 1963–1971

30 Hu J, Cao J, Chen M Z Q, . Load following of multiple heterogeneous TCL aggregators by centralized control. IEEE Transactions on Power Systems, 2017, 32(4): 3157–3167

31 Liu M, Shi Y, Liu X. Distributed MPC of aggregated heterogeneous thermostatically controlled loads in smart grid. IEEE Transactions on Industrial Electronics, 2016, 63(2): 1120–1129

32 Mathieu J L, Koch S, Callaway D S. State estimation and control of electric loads to manage real-time energy imbalance. IEEE Transactions on Power Systems, 2013, 28(1): 430–440

33 Lu N. An evaluation of the HVAC load potential for providing load balancing service. IEEE Transactions on Smart Grid, 2012, 3(3): 1263–1270

34 Esmaeil Zadeh Soudjani S, Abate A. Aggregation and control of populations of thermostatically controlled loads by formal abstractions. IEEE Transactions on Control Systems Technology, 2015, 23(3): 975–990

35 Li C, Chen Y, Luo F, . Real-time decision making model for thermostatically controlled load aggregators by natural aggregation algorithm. In: IEEE International Conference on Energy Internet, Beijing, China, 2017

36 Radaideh A, Vaidya U, Ajjarapu V. Sequential set-point control for heterogeneous thermostatically controlled loads through an extended markov chain abstraction. IEEE Transactions on Smart Grid, 2019, 10(1): 116–127

37 Bhattarai B P, de Cerio Mendaza I D, Myers K S, . Optimum aggregation and control of spatially distributed flexible resources in smart grid. IEEE Transactions on Smart Grid, 2018, 9(5): 5311–5322

38 Bashash S, Fathy H K. Modeling and control insights into demand-side energy management through setpoint control of thermostatic loads. In: Proceedings of the 2011 American Control Conference, San Francisco, CA, USA, 2011

39 Hao H, Sanandaji B M, Poolla K, . Aggregate flexibility of thermostatically controlled loads. IEEE Transactions on Power Systems, 2015, 30(1): 189–198

40 Ruelens F, Claessens B J, Vandael S, . Residential demand response applications using batch reinforcement learning. IEEE Transactions on Smart Grid, 2017, 8(5): 2149–2159

41 Vrettos E, Ziras C, Andersson G. Fast and reliable primary frequency reserves from refrigerators with decentralized stochastic control. IEEE Transactions on Power Systems, 2017, 32(4): 2924–2941

42 Molina-Garcia A, Bouffard F, Kirschen D S. Decentralized demand-side contribution to primary frequency control. IEEE Transactions on Power Systems, 2011, 26(1): 411–419

43 Guo D, Zhang W, Yan G, . Decentralized control of aggregated loads for demand response. In: 2013 American Control Conference (ACC), Washington D.C., USA, 2013

44 Meng K, Wang D, Dong Z Y, . Distributed control of thermostatically controlled loads in distribution network with high penetration of solar PV. CSEE Journal of Power and Energy Systems., 2017, 3(1): 53–62

45 Saker N, Petit M, Vannier J C, . Demand side management of electrical water heaters and evaluation of the cold load pick-up characteristics. In: 2011 IEEE Trondheim PowerTech, Trondheim, Norway, 2011

46 Perfumo C, Braslavsky J, Ward J K. A sensitivity analysis of the dynamics of a population of thermostatically-controlled loads. In: 2013 Australasian Universities Power Engineering Conference (AUPEC), Hobart, TAS, Australia, 2013

47 Gilvanejad M, Askarian Abyaneh H, Mazlumi K. Estimation of cold-load pickup occurrence rate in distribution systems. IEEE Transactions on Power Delivery, 2013, 28(2): 1138–1147

48 Wang D, Lu N, Miao W, . Performance evaluation of controlling thermostatically controlled appliances as virtual generators using comfort-constrained state-queueing models. IET Generation Transmission & Distribution, 2014, 8(4): 591–599

49 Mahdavi N, Braslavsky J H, Perfumo C. Mapping the effect of ambient temperature on the power demand of populations of air conditioners. IEEE Transactions on Smart Grid, 2018, 9(3): 1540–1550

50 Ruiz N, Cobelo I, Oyarzabal J. A direct load control model for virtual power plant management. IEEE Transactions on Power Systems, 2009, 24(2): 959–966

51 Trovato V, Tindemans S H, Strbac G. The leaky storage model for optimal multi-service allocation of thermostatic loads. IET Generation, Transmission & Distribution, 2016, 10(3): 585–593

52 Trovato V, Tindemans S H, Strbac G. Security constrained economic dispatch with flexible thermostatically controlled loads. In: IEEE PES Innovative Smart Grid Technologies, Istanbul, Turkey, 2014

53 Song M, Gao C, Yang J, . Energy storage modeling of inverter air conditioning for output optimizing of wind generation in the electricity market. CSEE Journal of Power & Energy Systems, 2018, 4(3): 305–315

54 Luo F, Dong Z Y, Meng K, . An operational planning framework for large-scale thermostatically controlled load dispatch. IEEE Transactions on Industrial Informatics, 2017, 13(1): 217–227

55 Zhao L, Zhang W, Hao H, . A geometric approach to aggregate flexibility modeling of thermostatically controlled loads. IEEE Transactions on Power Systems, 2017, 32(6): 4721–4731

56 Mathieu J L, Kamgarpour M, Lygeros J, . Arbitraging intraday wholesale energy market prices with aggregations of thermostatic loads. IEEE Transactions on Power Systems, 2015, 30(2): 763–772

57 Kurucz C N, Brandt D, Sim S. A linear programming model for reducing system peak through customer load control programs. IEEE Transactions on Power Systems, 1996, 11(4): 1817–1824

58 Yang H T, Huang K Y. Direct load control using fuzzy dynamic programming. IEE Proceedings–Generation, Transmission and Distribution, 1999, 146(3): 294–300

59 Lee T F, Cho M Y, Hsiao Y C, . Optimization and implementation of a load control scheduler using relaxed dynamic programming for large air conditioner loads. IEEE Transactions on Power Systems, 2008, 23(2): 691–702

60 Chu C M, Jong T L, Huang Y W. Mitigating DLC constraints of air-conditioning loads using a group-DLC method. In: 2007 IEEE Power Engineering Society General Meeting, Tampa, FL, USA, 2007

61 Wen Y, Li W, Huang G, . Frequency dynamics constrained unit commitment with battery energy storage. IEEE Transactions on Power Systems, 2016, 31(6): 5115–5125

62 Ning Y, Li X, Ma X, . Optimal schedule strategy of battery energy storage systems for peak load shifting based on interior point method. In: 2016 12th World Congress on Intelligent Control and Automation (WCICA), Guilin, China, 2016

63 Li N, Uckun C, Constantinescu E M, . Flexible operation of batteries in power system scheduling with renewable energy. IEEE Transactions on Sustainable Energy, 2016, 7(2): 685–696

64 Lujano-Rojas J M, Dufo-Lopez R, Bernal-Agustin J L, . Optimizing daily operation of battery energy storage systems under real-time pricing schemes. IEEE Transactions on Smart Grid, 2017, 8(1): 316–330

65 Hutchison G, Giaouris D, Gadoue S, . Non-invasive identification of turbo-generator parameters from actual transient network data. IET-Generation Transmission & Distribution, 2015, 9(11): 1129–1136

66 Mahdavi N, Braslavsky J H, Seron M M, . Model predictive control of distributed air-conditioning loads to compensate fluctuations in solar powe. IEEE Transactions on Smart Grid, 2017, 8(6): 3055–3065

67 Mathieu J L, Callaway D S. State estimation and control of heterogeneous thermostatically controlled loads for load following. In: 2012 45th Hawaii International Conference on System Sciences, Maui, HI, USA, 2012

68 Vanouni M, Lu N. A reward allocation mechanism for thermostatically controlled loads participating in intra-hour ancillary services. IEEE Transactions on Smart Grid, 2018, 9(5): 4209–4219

69 Renani Y K, Ehsan M, Shahidehpour M. Optimal transactive market operations with distribution system operators. IEEE Transactions on Smart Grid, 2018, 9(6): 6692–6701

70 Gregoratti D, Matamoros J. Distributed energy trading: the multiple-microgrid case. Industrial Electronics IEEE Transactions on Industrial Electronics, 2015, 62(4): 2551–2559

71 Liu Z, Wu Q, Shahidehpour M, . Transactive real-time electric vehicle charging management for commercial buildings with PV on-site generation. IEEE Transactions on Smart Grid, 2019, 10(5): 4939–4950