Establishment of the Psychometric Properties of a Disaster Resilience Measuring Tool for Healthcare Rescuers in China: A Cross-Sectional Study

Abstract

The aim of this study was to test the validity and reliability of a tool for measuring the disaster resilience of healthcare disaster rescuers. A cross-sectional study involving 936 healthcare disaster rescuers of the Sichuan Disaster Response Team was conducted to establish the psychometric properties of the disaster resilience measuring tool (DRMT). Item analysis, exploratory factor analysis, confirmatory factor analysis, and correlation analysis were adopted to analyze the data. Item analysis showed that all but three items had the critical ratio over 3, which indicates adequate discriminability for inclusion in the measuring tool. The exploratory factor analysis showed that 65.93% of the total variance was explained by four factors—self-efficacy, social support, positive growth, and altruism. The confirmatory factor analysis showed goodness of fit for the four-factor model: CMIN/DF (2.846), GFI (0.916 ≥ 0.90), CFI (0.949 ≥ 0.90), AGFI (0.891 ≥ 0.80), and RMSEA (0.063 ≤ 0.08). Criterion validity demonstrated significant associations of the DRMT and the Connor-Davidson Resilience Scale (P < 0.01, r = 0.566). Convergent validity was established by correlation with stress (P < 0.05, r = − 0.095), depression (P < 0.01, r = − 0.127), posttraumatic stress disorder-PCL-C (P < 0.05, r = − 0.100), compassion satisfaction (P < 0.01, r = 0.536), and burnout (P < 0.01, r = − 0.330). The DRMT demonstrated adequate internal consistency (Cronbach’s alpha > 0.84) and stability over the two-week study period (intraclass correlation coefficient > 0.85), and a cut-off point of 61 was suggested. The disaster resilience measuring tool has satisfactory psychometric properties and is a valid, reliable, and valuable instrument for assessing disaster resilience in healthcare rescue workers. The scale needs to be tested further among other populations and those from other cultures.

Keywords

China / Disaster resilience measuring tool / Healthcare rescuers / Factor analysis / Psychometrics

References

[1] Ali-Abadi, T., S. Talepasand, C. Boyle, and H.S. Nia. 2020. Psychometric properties of the Baruth Protective Factors Inventory among nursing students. PLoS ONE 15(6): Article e0233760.

[2] Arrogante O, Aparicio-Zaldivar E. Burnout and health among critical care professionals: The mediational role of resilience. Intensive and Critical Care Nursing, 2017, 42: 110-115

[3] Bensimon M. Elaboration on the association between trauma, PTSD and posttraumatic growth: The role of trait resilience. Personality and Individual Differences, 2012, 52(7): 782-787

[4] Bonanno GA, Brewin CR, Kaniasty K, La Greca AM. Weighing the costs of disaster: Consequences, risks, and resilience in individuals, families, and communities. Psychological Science in the Public Interest: A Journal of the American Psychological Society, 2010, 11(1): 1-49

[5] Britton, M., L. LaLonde, A. Oshio, and K. Taku. 2019. Relationships among optimism, pessimism, and posttraumatic growth in the US and Japan: Focusing on varying patterns of perceived stressfulness. Personality and Individual Differences 151: Article 109513.

[6] Bujang MA, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Archives of Orofacial Science, 2017, 12(1): 1-11.

[7] Burton CG. A validation of metrics for community resilience to natural hazards and disasters using the recovery from Hurricane Katrina as a case study. Annals of the Association of American Geographers, 2015, 105(1): 67-86

[8] Cai H, Lam NSN, Qiang Y, Zou L, Correll RM, Mihunov V. A synthesis of disaster resilience measurement methods and indices. International Journal of Disaster Risk Reduction, 2018, 31: 844-855

[9] Campbell-Sills L, Stein MB. Psychometric analysis and refinement of the Connor-Davidson Resilience Scale (CD-RISC): Validation of a 10-item measure of resilience. Journal of Traumatic Stress: Official Publication of The International Society for Traumatic Stress Studies, 2007, 20(6): 1019-1028

[10] Chao S-F. Social support, coping strategies and their correlations with older adults' relocation adjustments after natural disaster. Geriatrics & Gerontology International, 2017, 17(6): 1006-1014

[11] Connor K, Davidson J. Development of a new resilience scale: The Connor-Davidson Resilience Scale (CD-RISC). Depression and Anxiety, 2003, 18(2): 76-82

[12] Curran PJ, West SG, Finch JF. The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1996, 1(1): 16-29

[13] Cutter SL, Ahearn JA, Amadei B, Crawford P, Eide EA, Galloway GE, Goodchild MF, Kunreuther HC Disaster resilience: A national imperative. Environment, 2013, 55(2): 25-29.

[14] De La Rosa GM, Webb-Murphy JA, Johnston SL. Development and validation of a brief measure of psychological resilience: An adaptation of the response to stressful experiences scale. Military Medicine, 2016, 181(3): 202-208

[15] DeVellis RF. Scale development: Theory and applications, 2017 4 Los Angeles, CA: Sage Publishing

[16] Ferketich, S. 1991. Focus on psychometrics. Aspects of item analysis. Research in Nursing & Health 14(2): 165–168.

[17] Field A. Discovering statistics using IBM SPSS statistics, 2013, Los Angeles, CA: Sage Publishing

[18] Flaherty AJ, Gaviria MF, Pathak D, Mitchell T, Wintrob R, Richman JA, Birz S. Developing instruments for cross-cultural psychiatric research. The Journal of Nervous and Mental Disease, 1988, 176(5): 260-263

[19] Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 2005, 44(2): 227-239

[20] Iwasa, H., N. Moriyama, Y. Kuroda, C. Nakayama, M. Orui, T. Horiuchi, T. Nakayama, M. Sugita, et al. 2019. Recovery from radiation anxiety and posttraumatic growth among community dwellers after the nuclear disaster in Fukushima. Cogent Psychology 6(1). https://doi.org/https://doi.org/10.1080/23311908.2019.1602970.

[21] Javali, S.B., N.V. Gudaganavar, and S.M. Raj. 2011. Effect of varying sample size in estimation of coefficients of internal consistency. WebmedCentral 2(2): Article WMC001649.

[22] Johnson DC, Polusny MA, Erbes CR, King DW, King L, Litz B, Schnurr P, Friedman M Development and initial validation of the Response to Stressful Experiences Scale (RSES). Military Medicine, 2011, 176(2): 161-169

[23] Jungki L. Effects of perceived control upon self-efficacy and satisfaction among healthcare service customers. The Academy of Customer Satisfaction Management, 2019, 21(2): 79-100

[24] Kiliç, N., and N. Şimşek. 2019. The effects of psychological first aid training on disaster preparedness perception and self-efficacy. Nurse Education Today 83: Article 104203.

[25] King LA, King DW, Vogt DS, Knight J, Samper RE. Deployment risk and resilience inventory: A collection of measures for studying deployment-related experiences of military personnel and veterans. Military Psychology, 2006, 18(2): 89-120

[26] Kyriazos T. Applied psychometrics: Sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology, 2018, 9(8): 2207-2230

[27] Liu XS. Statistical power analysis for the social and behavioral sciences: Basic and advanced techniques, 2013, New York: Routledge

[28] MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychological Methods, 1999, 4(1): 84-99

[29] Malik, U.R., N. Atif, F.K. Hashmi, F. Saleem, H. Saeed, M. Islam, M. Jiang, M. Zhao, et al. 2020. Knowledge, attitude, and practices of healthcare professionals on COVID-19 and risk assessment to prevent the epidemic spread: A multicenter cross-sectional study from Punjab, Pakistan. International Journal of Environmental Research and Public Health 17(17): Article 6395.

[30] Mao X, Fung OW, Hu XY, Loke AY. Psychological impacts of disaster on rescue workers: A review of the literature. International Journal of Disaster Risk Reduction, 2018, 27: 602-617

[31] Mao X, Fung OW, Hu X, Loke AY. Characteristics of resilience among disaster rescue workers: A systematic review. Disaster Medicine and Public Health Preparedness, First View., 2020

[32] Mao, X., A.Y. Loke, O.W.M. Fung, and X. Hu. 2019. What it takes to be resilient: The views of disaster healthcare rescuers. International Journal of Disaster Risk Reduction 36: Article 101112.

[33] Mao X, Loke AY, Hu X. Developing a tool for measuring the disaster resilience of healthcare rescuers: A modified Delphi study. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 2020, 28(1): 1-12

[34] Mao, X., Z. Wang, X. Hu, and A.Y. Loke. 2020. A scoping review of resilience scales of adults to develop a prototype disaster resilience tool for healthcare rescuers. International Journal of Disaster Risk Reduction 49: Article 101678.

[35] Martin G, Copeland J, Gates P, Gilmour S. The Severity of Dependence Scale (SDS) in an adolescent population of cannabis users: Reliability, validity and diagnostic cut-off. Drug and Alcohol Dependence, 2006, 83(1): 90-93

[36] Masten, A.S. 2001. Ordinary magic: Resilience processes in development. American Psychologist 56(3): Article 227.

[37] McEntire DA. Disaster response and recovery: Strategies and tactics for resilience, 2014, Hoboken, NJ: John Wiley & Sons

[38] Moss, M., V.S. Good, D. Gozal, R. Kleinpell, and C.N. Sessler. 2016. A critical care societies collaborative statement: Burnout syndrome in critical care health-care professionals. A call for action. American Journal of Respiratory and Critical Care Medicine 194(1): 106–113.

[39] Nishi D, Kawashima Y, Noguchi H, Usuki M, Yamashita A, Koido Y, Matsuoka YJ. Resilience, post-traumatic growth, and work engagement among health care professionals after the Great East Japan Earthquake: A 4-year prospective follow-up study. Journal of Occupational Health, 2016, 58(4): 347-353

[40] Nunnally J. Psychometric methods, 1978, New York: McGraw-Hill

[41] Pendall R, Foster KA, Cowell M. Resilience and regions: Building understanding of the metaphor. Cambridge Journal of Regions, Economy and Society, 2010, 3(1): 71-84

[42] Perrin MA, DiGrande L, Wheeler K, Thorpe L, Farfel M, Brackbill R. Differences in PTSD prevalence and associated risk factors among World Trade Center disaster rescue and recovery workers. American Journal of Psychiatry, 2007, 164(9): 1385-1394

[43] Resnick B, Gwyther L, Roberto KA. Resilience in aging, 2011, Heidelberg: Springer

[44] Reyes AT, Andrusyszyn MA, Iwasiw C, Forchuk C, Babenko-Mould Y. Nursing students' understanding and enactment of resilience: A grounded theory study. Journal of Advanced Nursing, 2015, 71(11): 2622-2633

[45] Sarker MNI, Islam MS, Huq ME, Alam GM, Raihan ML. Islam MN. Big data-driven disaster resilience. Information and communication technologies for humanitarian services, 2020, London: The Institution of Engineering and Technology 165-185

[46] Scuri S, Petrelli F, Nguyen TTC, Grappasonni I. Training to improve resilience and coping to monitor PTSD in rescue workers. Journal of Preventive Medicine and Hygiene, 2019, 60(1): E58-E63.

[47] Shoukri MM, Asyali MH, Donner A. Sample size requirements for the design of reliability study: Review and new results. Statistical Methods in Medical Research, 2004, 13(4): 251-271

[48] Stamm, B.H. 2009. Professional quality of life: Compassion satisfaction and fatigue version 5 (ProQOL). https://proqol.org/. Accessed 2 Apr 2020.

[49] Stein, D.J., W.T. Chiu, I. Hwang, R.C. Kessler, N. Sampson, J. Alonso, G. Borges, E. Bromet, et al. 2010. Cross-national analysis of the associations between traumatic events and suicidal behavior: Findings from the WHO World Mental Health Surveys. PLoS ONE 5(5): Article e10574.

[50] Streiner DL, Norman GR, Cairney J. Health measurement scales: A practical guide to their development and use, 2015, Oxford, UK: Oxford University Press

[51] Tang, B., Y. Ge, Z. Liu, X. Liu, P. Kang, Y. Liu, and L. Zhang. 2015. Health-related quality of life for medical rescuers one month after Ludian earthquake. Health and Quality of Life Outcomes 13(1): Article 88.

[52] Tominaga Y, Goto T, Shelby J, Oshio A, Nishi D, Takahashi S. Secondary trauma and posttraumatic growth among mental health clinicians involved in disaster relief activities following the 2011 Tohoku earthquake and tsunami in Japan. Counselling Psychology Quarterly, 2020, 33(4): 427-447

[53] Tsai J, El-Gabalawy R, Sledge W, Southwick SM, Pietrzak RH. Post-traumatic growth among veterans in the USA: Results from the National Health and Resilience in Veterans Study. Psychological Medicine, 2015, 45(1): 165-179

[54] UNDRR (United Nations Office for Disaster Risk Reduction). 2019. Global platform preparatory days / World reconstruction conference. https://www.unisdr.org/conference/2019/globalplatform/home. Accessed 18 May 2019

[55] UNISDR (United Nations International Strategy for Disaster Reduction). 2015. Sendai framework for disaster risk reduction 2015–2030. https://www.unisdr.org/files/43291_sendaiframeworkfordrren.pdf. Accessed 15 May 2019.

[56] Wagnild GM, Young HM. Development and psychometric evaluation of the Resilience Scale. Journal of Nursing Measurement, 1993, 1(2): 165-178.

[57] Zerach G, Solomon Z, Cohen A, Ein-Dor T. PTSD, resilience and posttraumatic growth among ex-prisoners of war and combat veterans. Israel Journal of Psychiatry and Related Sciences, 2013, 50(2): 91-99.