Evaluating Effectiveness and Economic Benefits of Meteorological Health Warning Systems: A Case Study of Stroke Warnings in Tianjin, China

Abstract

Meteorological health warning systems have received global attention for their role in climate health adaptation. However, existing evaluation studies rarely considered nonlinear and time-lagged relationships between meteorological factors and health outcomes. Calculations of economic benefits have not fully accounted for labor losses, nor the impact on other economic sectors. To develop a methodology for evaluating the effectiveness of meteorological health warning systems, we incorporated warning variable into the exposure-lag-response relationship between temperature and health outcomes such as hospital admissions. We also estimated savings in hospitalization expenses, economic benefits of avoiding labor losses, and impacts on other economic sectors. Using Tianjin’s stroke meteorological risk warning system as a case, the results show that the warnings have effectively alleviated burdens on insurance providers and patient households, and avoided labor losses. From January 2021 to September 2022, an average of 6.92% stroke hospital admissions were reduced in four warning periods. It resulted in savings of USD 2.66 million of the government and USD 849.9 thousand of residents. Through avoiding labor losses, four warnings generated economic benefit of USD 1.61 million. When the saved expenses and avoided labor losses were incorporated into the input-output model, scenario analysis suggested potential increase in economic gross output of USD 5.76 million, indicating extensive impacts on other economic sectors. Future refined effectiveness and economic benefits evaluation could facilitate further deployment and optimization of meteorological health warning systems.

Keywords

Early warning system / Meteorological health warning system / Stroke / Effectiveness of warning system / Economic benefits / Climate change and health

References

[1] Bouckaert M, Lemmens R, Thijs VReducing prehospital delay in acute stroke. Nature Reviews Neurology, 2009, 5(9): 477-483.

[2] Chau PH, Chan KC, Woo JHot weather warning might help to reduce elderly mortality in Hong Kong. International Journal of Biometeorology, 2009, 53(5): 461-468.

[3] Chiabai A, Spadaro JV, Neumann MBValuing deaths or years of life lost? Economic benefits of avoided mortality from early heat warning systems. Mitigation and Adaptation Strategies for Global Change, 2018, 23(7): 1159-1176.

[4] CMA (Conference of the Parties Serving as the Meeting of the Parties to the Paris Agreement). 2023. Glasgow-Sharm el-Sheikh work programme on the global goal on adaptation referred to in decision 7/CMA.3 draft decision -/CMA.5. Proposal by the president (FCCC/PA/CMA/2023/L.18). Dubai: CMA. https://hdl.handle.net/10986/35686. Accessed 8 Dec 2025.

[5] Dixon HG, Hill DJ, Karoly DJ, Jolley DJ, Aden SMSolar UV forecasts: A randomized trial assessing their impact on adults’ sun-protection behavior. Health Education & Behavior, 2007, 34(3): 486-502.

[6] Ebi KL, Teisberg TJ, Kalkstein LS, Robinson L, Weiher RFHeat watch/warning systems save lives: Estimated costs and benefits for Philadelphia 1995–98. Bulletin of the American Meteorological Society, 2004, 85(8): 1067-1073.

[7] Ebi KL, Vanos J, Baldwin JW, Bell JE, Hondula DM, Errett NA, Hayes K, Reid CE, et al.Extreme weather and climate change: Population health and health system implications. Annual Review of Public Health, 2021, 42: 293-315.

[8] Gasparrini A, Armstrong B, Kenward MGDistributed lag non-linear models. Statistics in Medicine, 2010, 29(21): 2224-2234.

[9] Golden CD, Childs ML, Mudele OE, Andriamizarasoa FA, Bouley TA, Nicola GD, Fontaine MA, Huybers PJ, et al.Climate-smart public health for global health resilience. Lancet Planetary Health, 2025, 9(8): Article 101293.

[10] Guo P, Zheng M, Feng W, Wu J, Deng C, Luo G, Wang L, Pan B, Liu HEffects of ambient temperature on stroke hospital admissions: Results from a time-series analysis of 104,432 stroke in Guangzhou, China. Science of the Total Environment, 2017, 580: 307-315.

[11] Hao T, Han S, Yao Q, Wang X, Fan W, Xin JMeteorological reasons for high hospitalization risk of stroke in Tianjin. Acta Meteorologica Sinica, 2022, 80(3): 392-402(in Chinese)

[12] Hao T, Wang X, Han S, Yao Q, Ding JInvestigating the impact of weather on stroke in summer. International Journal of Biometeorology, 2024, 68(10): 2015-2027.

[13] Hunt A, Ferguson J, Baccini M, Watkiss P, Kendrovski VClimate and weather service provision: Economic appraisal of adaptation to health impacts. Climate Services, 2017, 778-86.

[14] IHME (Institute for Health Metrics and Evaluation). 2024. Global burden of disease study 2021 (GBD 2021) years lived with disability, disability-adjusted life years, and healthy life expectancy 1990–2021. Seattle: IHME.https://ghdx.healthdata.org/record/ihme-data/gbd-2021-yld-daly-hale-1990-2021. Accessed 8 Dec 2025.

[15] Jimenez-Conde J, Ois A, Gomis M, Rodriguez-Campello A, Cuadrado-Godia E, Subirana I, Roquer JWeather as a trigger of stroke: Daily meteorological factors and incidence of stroke subtypes. Cerebrovascular Diseases, 2008, 26(4): 348-354.

[16] Katzenellenbogen JM, Vos T, Somerford P, Begg S, Semmens JB, Codde JPBurden of stroke in indigenous Western Australians: A study using data linkage. Stroke, 2011, 42(6): 1515-1521.

[17] Kien ND, My NHD, Thu DTA, Tri TTC, Son NH, Phong TK, Tin HC, Lan NH, et al.Valuation of a heatwave early warning system for mitigating risks associated with heat-related illness in central Vietnam. Sustainability, 2023, 15(21): Article 15342.

[18] Kim J, Ha JS, Jun S, Park TS, Kim HThe weather watch/warning system for stroke and asthma in South Korea. International Journal of Environmental Health Research, 2008, 18(2):117-127.

[19] Li Z, Wang X, Liu X, Ke J, Liu Y, Fu C, Liu Q, Gao J, et al.Evaluation of the effect of meteorological risk forecasting service intervention on acute onset and medical expenses of patients with COPD in Pudong New Area of Shanghai. Shanghai Journal of Preventive Medicine, 2024, 36(2): 197-202(in Chinese)

[20] Liu M, Zhou M, Liu S, Zeng X, Zhang H, Xu Z, Wang DAnalysis on mortality and disease burden of stroke in Tianjin in 1990 and 2015. Chinese Journal of Contemporary Neurology and Neurosurgery, 2018, 18(7): 520-526(in Chinese)

[21] Lopez A, Coughlan de Perez E, Bazo J, Suarez P, van den Hurk B, van Aalst MBridging forecast verification and humanitarian decisions: A valuation approach for setting up action-oriented early warnings. Weather and Climate Extremes, 2020, 27: Article 100167.

[22] Lowe D, Ebi KL, Forsberg BHeatwave early warning systems and adaptation advice to reduce human health consequences of heatwaves. International Journal of Environmental Research and Public Health, 2011, 8(12): 4623-4648.

[23] Mariet AS, Giroud M, Benzenine E, Cottenet J, Roussot A, Aho-Glélé LS, Tubert-Bitter P, Béjot Y, Quantin CHospitalizations for stroke in France during the COVID-19 pandemic before, during, and after the national lockdown. Stroke, 2021, 52(4): 1362-1369.

[24] Mason TG, Schooling CM, Ran JJ, Chan KP, Tian LDoes the AQHI reduce cardiovascular hospitalization in Hong Kong’s elderly population?. Environment International, 2020, 135Article 105344.

[25] Morabito M, Profili F, Crisci A, Francesconi P, Gensini GF, Orlandini SHeat-related mortality in the Florentine area (Italy) before and after the exceptional 2003 heat wave in Europe: An improved public health response?. International Journal of Biometeorology, 2012, 56(5): 801-810.

[26] Ouyang H, Jiang H, Huang J, Liu ZCOVID-19 pandemic brings challenges to the management of stroke – The differences between stroke cases admitted to a tertiary hospital before and during COVID-19 pandemic in China. Risk Management and Healthcare Policy, 2023, 162893-2905.

[27] Qiao Z, Guo Y, Yu W, Tong SAssessment of short- and long-term mortality displacement in heat-related deaths in Brisbane, Australia, 1996–2004. Environmental Health Perspective, 2015, 123(8): 766-772.

[28] Rao S, Chaudhary P, Budin-Ljøsne I, Sitoula S, Aunan K, Chersich M, De’ Donato F, Kazmierczak AEvaluating the socioeconomic benefits of heat-health warning systems. European Journal of Public Health, 2025, 35(1): 178-186.

[29] Richard P, West K, Ku LThe return on investment of a Medicaid tobacco cessation program in Massachusetts. PLOS One, 2012, 7(1): Article e29665.

[30] Robinson, L.A., and J.K. Hammitt. 2018. Valuing nonfatal health risk reductions in global benefit-cost analysis. Guidelines for benefit-cost analysis project working paper No. 2. Boston: Center for Health Decision Science, Harvard T.H. Chan School of Public Health. https://media.repository.chds.hsph.harvard.edu/static/filer_public/7a/e1/7ae1e5b1-1798-4faf-b471-b890db5b1198/2018_robinson_nonfat_hlth_risk_bca_prj_wp_32.pdf. Accessed 8 Dec 2025.

[31] Santhanam N, Kim HE, Rügamer D, Bender A, Muthers S, Cho CG, Alonso A, Szabo K, et al.Machine learning-based forecasting of daily acute ischemic stroke admissions using weather data. npj Digital Medicine, 2025, 8(1):Article 225.

[32] TBS (Tianjin Municipal Bureau of Statistics), and Office of the Leading Group of Tianjin Municipality for the Seventh National Population CensusTianjin population census yearbook 2020, 2022, Beijing: China Statistics Press(in Chinese)

[33] TBS (Tianjin Municipal Bureau of Statistics), and Survey Office of the NBS (National Bureau of Statistics) in TianjinTianjin statistical yearbook 2023, 2023, Beijing: China Statistics Press(in Chinese)

[34] TMB (Tianjin Meteorological Bureau). 2024. Classification criteria for meteorological risk warning levels of stroke (DB12/T 1308–2024). Tianjin: Tianjin Administration for Market Regulation. https://dbba.sacinfo.org.cn/stdDetail/c436aa5acce4a9ff0d7b0a05ddd42403805574149bc3e38ff1dd6b3e0986b6ce. Accessed 8 Dec 2025 (in Chinese).

[35] Toloo G, FitzGerald G, Aitken P, Verrall K, Tong SEvaluating the effectiveness of heat warning systems: Systematic review of epidemiological evidence. International Journal of Public Health, 2013, 58(5):667-681.

[36] UNISDR (United Nations International Strategy for Disaster Reduction). 2015. Sendai framework for disaster risk reduction 2015–2030. https://www.undrr.org/publication/sendai-framework-disaster-risk-reduction-2015-2030. Accessed 23 Mar 2026.

[37] Vanos J, Vecellio DJ, Kjellstrom TWorkplace heat exposure, health protection, and economic impacts: A case study in Canada. American Journal of Industrial Medicine, 2019, 62(12): 1024-1037.

[38] Wang Q, Li C, Guo Y, Barnett AG, Tong S, Phung D, Chu C, Dear K, et al.Environmental ambient temperature and blood pressure in adults: A systematic review and meta-analysis. Science of the Total Environment, 2017, 575: 276-286.

[39] Weinberger KR, Wu X, Sun S, Spangler KR, Nori-Sarma A, Schwartz J, Requia W, Sabath BM, et al.Heat warnings, mortality, and hospital admissions among older adults in the United States. Environment International, 2021, 157: Article 106834.

[40] Weinberger KR, Zanobetti A, Schwartz J, Wellenius GAEffectiveness of National Weather Service heat alerts in preventing mortality in 20 US cities. Environment International, 2018, 11630-38.

[41] Williams S, Nitschke M, Wondmagegn BY, Tong M, Xiang J, Hansen A, Nairn J, Karnon J, Bi PEvaluating cost benefits from a heat health warning system in Adelaide, South Australia. Australian and New Zealand Journal of Public Health, 2022, 46(2): 149-154.

[42] WMO (World Meteorological Organization). 2022. Early warnings for all: Executive action plan 2023–2027. Geneva: WMO. https://digitallibrary.un.org/record/4001006. Accessed 8 Dec 2025.

[43] World Bank. 2021. Investment in disaster management in Europe makes economic sense: Summary report. Washington DC: International Bank for Reconstruction and Development/The World Bank. https://hdl.handle.net/10986/35686. Accessed 23 Mar 2026.

[44] Yang Y, Nicholas S, Li S, Huang Z, Chen X, Ma Y, Shi XHealth care utilization for patients with stroke: A 3-year cross-sectional study of China’s two urban health insurance schemes across four cities. BMC Public Health, 2021, 21(1): Article 531.

[45] Zhang J, Wu Y, Yuan S, Yin Y, Wang W, Zhang L, Liu S, Jiang F, et al.Effect of meteorological environment warning forecast technology on quality of life in children with asthma. Chinese Journal of Practical Pediatrics, 2013, 28(3):189-194(in Chinese)

Rights & permissions

The Author(s)