‘Outbreak Gold Standard’ selection to provide optimized threshold for infectious diseases early-alert based on China Infectious Disease Automated-alert and Response System

Abstract

The China Infectious Disease Automated-alert and Response System (CIDARS) was successfully implemented and became operational nationwide in 2008. The CIDARS plays an important role in and has been integrated into the routine outbreak monitoring efforts of the Center for Disease Control (CDC) at all levels in China. In the CIDARS, thresholds are determined using the „Mean+2SD‟ in the early stage which have limitations. This study compared the performance of optimized thresholds defined using the „Mean +2SD‟ method to the performance of 5 novel algorithms to select optimal „Outbreak Gold Standard (OGS)‟ and corresponding thresholds for outbreak detection. Data for infectious disease were organized by calendar week and year. The „Mean+2SD‟, C1, C2, moving average (MA), seasonal model (SM), and cumulative sum (CUSUM) algorithms were applied. Outbreak signals for the predicted value (Px) were calculated using a percentile-based moving window. When the outbreak signals generated by an algorithm were in line with a Px generated outbreak signal for each week, this Px was then defined as the optimized threshold for that algorithm. In this study, six infectious diseases were selected and classified into TYPE A (chickenpox and mumps), TYPE B (influenza and rubella) and TYPE C [hand foot and mouth disease (HFMD) and scarlet fever]. Optimized thresholds for chickenpox (P₅₅), mumps (P₅₀), influenza (P₄₀, P₅₅, and P₇₅), rubella (P₄₅ and P₇₅), HFMD (P₆₅ and P₇₀), and scarlet fever (P₇₅ and P₈₀) were identified. The C1, C2, CUSUM, SM, and MA algorithms were appropriate for TYPE A. All 6 algorithms were appropriate for TYPE B. C1 and CUSUM algorithms were appropriate for TYPE C. It is critical to incorporate more flexible algorithms as OGS into the CIDRAS and to identify the proper OGS and corresponding recommended optimized threshold by different infectious disease types.

References

[1] XuM, LiSX. Analysis of good practice of public health emergency operations centers. Asian Pac J Trop Med, 2015, 8(8): 677-682

[2] HuHZ, MaoHJ, HuXH, et al.. Information dissemination of public health emergency on social networks and intelligent computation. Comput Intel Neurosc, 2015, 2015: 181038

[3] KeramarouM, EvansMR. Completeness of infectious disease notification in the United Kingdom: a systematic review. J Infect, 2012, 64(6): 555-564

[4] WardM, BrandsemaP V S, et al.. Electronic reporting improves timeliness and completeness of infectious disease notification, the Netherlands, 2003. Euro Surveill, 2005, 10(1): 27-30

[5] ReintjesR, BaumeisterHG, CoulombierD. Infectious disease surveillance in North Rhine-Westphalia: First steps in the development of an early warning system. Int J Hyg Environ Health, 2001, 203(3): 195-199

[6] XiongWY, LvJ, LiLM. A survey of core and support activities of communicable disease surveillance systems at operating level CDCs in China. BMC Public Health, 2010, 10(1): 704

[7] YangWZ, LiZJ, LaiSJ, et al.. Preliminary application on China infectious disease automated-alert and response system (CIDARS) between 2008 and 2010. Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2011, 32(5): 431-435

[8] YangWZ, LanYJ, LiZJ, et al.. The application of national outbreak automatic detection and response system, China. Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2010, 31(11): 1240-1244

[9] YangWZ, LiZJ, LanYJ, et al.. A nationwide web-based automated system for outbreak early detection and rapid response in China. Western Pac Surveill Response J, 2011, 2(1): 1-6

[10] LiZJ, LanY, LaiSJ, et al.. Comparison on the performance of both temporal and temporal-spatial models for outbreak detection through China infectious diseases automated-alert and response system (CIDARS). Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2011, 32(5): 436-441

[11] StraetemansM, AltmannD, EckmannsT, et al.. Automatic outbreak detection algorithm versus electronic reporting system. Emerg Infect Dis, 2008, 14(10): 1610-1612

[12] BuckeridgeDL. Outbreak detection through automated surveillance: a review of the determinants of detection. J Biomed Inform, 2007, 40(4): 370-379

[13] MaW, BosmanA, VanSE, et al.. Automated, laboratory-based system using the internet for disease outbreak detection, the Netherlands. Emerging Infectious Diseases, 2003, 9(9): 1046-1052

[14] KulldorffM. A spatial scan statistic. Commun Stat-Theor M, 2007, 26(6): 1481-1496

[15] YuF, ZhangH, LaiSJ, et al.. The effectiveness of China infectious disease automated alert and response system (CIDARS) in local regions. Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2011, 32(5): 446-449

[16] LiZJ, LaiSJ, ZhangHL, et al.. Hand, foot and mouth disease in China:evaluating an automated system for the detection of outbreaks. Bull World Health Organ, 2014, 92(9): 656-663

[17] YangW, XingHX, WangHZ, et al.. A research on early warning technology of control charts of seven infectious diseases. Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2011, 25(12): 1039-1041

[18] LiZJ, LaiSJ, BuckeridgeD, et al.. Adjusting outbreak detection algorithms for surveillance during epidemic and non-epidemic periods. J Am Med Inform Assoc, 2012, 19(1): e51-e53

[19] KuangJ, YangWZ, ZhouDL, et al.. Epidemic feature affecting the performance of outbreak detection algorithms. BMC Public Health, 2012, 12(1): 418

[20] LoriH, WilliamTG, MatthewS, et al.. The bioterrorism preparedness and response early aberration reporting system (EARS). J Urban Health, 2003, 80(2): i89-i96

[21] KatherineFS, MichaelG, SamanthaR, et al.. Global rise in human infectious disease outbreaks. J R Soc Interface, 2014, 11(101): 20140950

[22] WangXL, WangQY, LuanRS, et al.. Models for infectious diseases early warning. Modern Prev Med (Chinese), 2008, 35(22): 4339-4341

[23] LiisaR, SusanJB, MeredithP, et al.. How infectious disease outbreak affect community based primary care physicians: comparing the SARS and H1N1 epidemics. Can Fam Physician, 2014, 60(10): 917-925

[24] XuXQ, LuQB, WangZ, et al.. Evaluation on the performance of China infectious disease automated alert and response system (CIDARS) in Zhejiang Province. Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2011, 32(5): 442-445

[25] SunQ, LaiSJ, LiZJ, et al.. Comparison on the different thresholds on the 'moving percentile method' for outbreak detection. Zhong Hua Liu Xing Bing Xue Za Zhi (Chinese), 2011, 32(5): 450-453

[26] ChenJH, SchmitK, ChangH, et al.. Use of Medicaid prescription data for syndromic surveillance-New York. MMWR Morb Mortal Wkly Rep, 2005, 54: 31-34

[27] Galit ShmueliHB. Statistical challenges facing early outbreak detection in bio-surveillance. Technometrics, 2010, 52(1): 39-51

[28] ZhangHL, LaiSJ, WangLP, et al.. Improving the performance of outbreak detection algorithms by classifying the level of disease incidence. PloS One, 2013, 8(8): e71803

RIGHTS & PERMISSIONS

Huazhong University of Science and Technology