Introduction
Although advances in diagnostic tools, such as serum galactomannan test and high-resolution computer tomography, have been achieved and new antifungal agents have been developed in the past few decades, invasive fungal disease (IFD) remains as a major infectious complication for patients with hematological malignancies undergoing chemotherapy and hematopoietic stem cell transplantation (HSCT) [
1,
2]. To address this problem, anti-fungal prophylaxis had been evaluated in multiple clinical trials [
3–
5], which confirmed that it reduced IFD incidence and IFD-related mortality. To realize an effective prophylaxis strategy, the specific risk of IFD must be predicted accurately to identify the patients with significantly increased incidence of IFD who are most likely to benefit from the intensive monitoring of IFD and antifungal prophylaxis [
6]. With regard to the optimal duration of antifungal therapy in patients with neutropenic fever, current guidelines recommend the empirical anti-fungal treatment for patients with persistent fever should last for 3–5 days after broad-spectrum antibiotic chemotherapy, whereas pre-emptive treatment was recommended as a diagnostic-driven therapy for patients with persistent fever together with diagnostic work-up showing suspicious findings prior to the initiation of antifungal treatment [
7]. Moreover, empirical treatment, which may induce side effects and may be costly due to over-treatment, is recommended only for high-risk but not low-risk patients, such as in cases of anticipated duration of neutropenia (<10 days), unless other findings indicate a suspected IFD [
8]. Therefore, these risk-based approaches are feasible only with the proper assessment of risk factors of IFD in patients undergoing chemotherapy with hematological malignancies.
Although numerous factors, including diseases such as acute myeloid leukemia (AML) and myelodysplasia syndrome (MDS) [
9], disease status (untreated or non-remission disease) [
10], prolonged neutropenia [
11], previous history of IFD [
12], age [
13], comorbidity such as diabetes and pulmonary disease [
14,
15], treatment with corticosteroid or other immune-suppression drugs [
15–
18], genetic factors related to host innate immunity [
19,
20], and environmental variables [
21,
22], have been reported as the main risk factors of IFD, the precise prediction of IFD incidence has remained difficult. In this study, we utilize the China Assessment of Antifungal Therapy in Hematological Diseases (CAESAR) Study database, which contain 4889 courses of chemotherapy in patients with hematological malignancies, to develop an objective risk score for proven or probable IFD [
23]. We established a weighted risk score for IFD that accurately discriminated a cohort of patients with low (<2%), intermediate (5%), and high (>10%) incidence of IFD. Moreover, the benefits of anti-fungal prophylaxis were evaluated in patients with different IFD risks.
Materials and methods
Study design
As previously reported, the CAESAR study was a nationwide multicenter, prospective, observational study conducted in China to evaluate the clinical and microbiological management and outcomes of IFD in patients treated with chemotherapy or HSCT. The diagnosis of IFD was classified as proven, probable, or possible on the basis of the 2008 criteria devised by the European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group. The collected data included baseline characteristics, hematological diagnosis, chemotherapy, clinical features, anti-fungal treatment, and the epidemiological and treatment-related potential risk factors of IFD.
The study was conducted in accordance with the Declaration of Helsinki, International Conference on Harmonization/Good Clinical Practice and nationally mandated ethical requirements. The study protocol and informed consent document were reviewed and approved by the ethics committee of all participating institutions.
Statistical analysis
The study cohort of 4889 chemotherapy courses on the CAESAR database was randomly split by simple random sampling at a ratio of 2.5:1 into two datasets, of which one served as the training set for model development (n = 3500) and the other served as the validation set for model verification (n = 1389). The patients’ characteristics of training and validation dataset were described and compared by t test for continuous variables or by c2 test for proportion variables.
To develop the risk score, we first identified the factors that were individually associated with proven and probable IFD by using univariate analysis with P<0.10. The factors that demonstrated an individual association were carry-forwarded in the multivariate logistic regression with the stepwise criteria of 0.05. Points were assigned for the variables that remained statistically significant (P<0.05) in the final logistic regression and were weighted approximately by the corresponding regression b-coefficients. For each variable, the regression coefficients were divided by the minimum absolute value of all coefficients in the final multivariable model, multiplied by 2, and rounded to the nearest whole number. Once the point values were defined, the score for each of the significant prognostic factors was summed as the total score for each individual chemotherapy course. Receiver operator curves (ROC) with 95% CI were calculated to evaluate the discrimination capacity of the risk score. We classified patients into different risk groups with corresponding incidences of IFD as<2%, ~5%, and>10%. Once the model was defined, it was tested using the independent validation dataset to confirm its performance in predicting the IFD incidence. All statistical analyses were performed using SAS 9.2 (SAS Institute, Cary, NC, USA).
Results
Study populations and incidence of IFD
The CAESAR study included 4889 chemotherapy courses from 4192 patients with variable hematological malignant diseases. The documented IFD episodes were 407, of which 19 were proven, 84 were probable, and 304 were possible IFD cases, and the overall incidence of proven/probable IFD was 2.1%. The documented pathogens consisted mostly of candida (
n = 31) and aspergillus (
n = 24), as well as a few cases of mucor (
n = 1) and
Cryptococcus neoformans (
n = 1). The overall mortality of all patients was 1.5%, which increased significantly in proven/probable (11.7%) and possible IFD (8.2%), as previously reported [
23].
A total of 3500 chemotherapy courses were selected from the CAESAR database by simple random sampling to form the training dataset, and the remaining 1389 courses comprised the independent validation dataset. The patients’ characteristics of both training and validation datasets were balanced in all aspects, as shown in Table 1.
Risk score associated with proven or probable IFD in training dataset
Univariate analysis (with P<0.10) of the training data identified 13 factors that were associated with IFD incidence, namely, age, gender, diagnosis of hematological disease, higher Eastern Cooperative Oncology Group (ECOG) performance score, history of previous IFD, occurrence of neutropenia, duration of neutropenia (<10, 11–14, and>14 days), concomitant diseases, hematological disease status (newly diagnosed disease, complete remission, partial remission, and relapse or disease progression), hepatic impairment, use of parenteral nutrition, type of chemotherapy (induction or re-induction chemotherapy and consolidation), and hypoalbuminemia after chemotherapy. The variables such as male patients, patients with central-venous catheter, history of previous IFD, hypoalbuminemia, chemotherapy for newly diagnosed or relapsed disease, neutropenia after chemotherapy (absolute neutrophils count, ANC<0.5 × 109/L), and prolonged neutropenia for>10 days or>14 days remained significant in the stepwise multivariate logistic regression analysis, and weighted points were assigned accordingly (Table 2).
On the basis of the multivariate logistic regression analysis, IFD risk scores ranging from 0 to 23 were generated (Table 3) and calculated for each chemotherapy course in the training dataset. The distribution of the risk scores and the cumulative incidence of proven or probable IFD were calibrated, as shown in Table 4. Overall, the patients with risk scores of 0–5 and 6–10 presented low incidences of IFD at 0.3% and 1.2%, respectively (P = 0.004), whereas those with risk scores of 11–15 manifested a significantly higher IFD incidence of 6.4% (P<0.001 and P = 0.003 vs. the groups with scores of 0–5 and 6–10, respectively). An overwhelmingly high IFD incidence of up to 17.5% was observed in the group of patients with risk score of>15 (P<0.001 vs. the groups with scores of 0–5, 6–10, and 11–15).
The discrimination capacity of the IFD risk scores was analyzed by the ROC with an area under the ROC curve (aROC) of 0.84 (95% CI: 0.80–0.89), as shown in Fig. 1 (left). We also tested the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of different cut-points of the risk score at 5, 10, and 15, as shown in Table S1 (Supplementary Material).
Confirmation of risk score associated with proven or probable IFD in the validation dataset
The IFD risk score was calculated for each chemotherapy course in the validation dataset, and the results confirmed a low IFD incidence of 0.4% and 1.4% in the patients with risk scores of 0–5 and 6–10 (P = 0.067), whereas those with risk scores of 11–15 presented a significantly increased IFD incidence of 5.0% (P<0.001 and P = 0.002 vs. the groups with scores of 0–5 and 6–10, respectively). The IFD incidence was overwhelmingly high (up to 21.4%) for patients with risk scores of>15, as shown in Table 4 (P<0.001 vs. the groups with scores of 0–5, 6–10, and 11–15).
The IFD risk scores in the validation set were also analyzed by the ROC with an area under the ROC (aROC) of 0.83 (95% CI: 0.76–0.90), as shown in Fig. 1 (right). The sensitivity, specificity, PPV, and NPV of different risk score cut-points (5, 10, and 15) were documented in the validation dataset, as shown in Table S2 (Supplementary Material).
Basing on these data, we classified the patients into three major groups: patients with risk scores of 0–10 were considered low-risk patients; those with risk scores of 11–15 were regarded as intermediate-risk patients, and those with risk scores of>15 were regarded as high-risk patients.
Impact of anti-fungal prophylaxis in patients with different risk scores
Overall, antifungal prophylaxis significantly reduced the incidence of IFD. However its benefit varied significantly in the different group of patients with different risk scores, as shown in Table 5. For low-risk patients (n = 3945), the IFD incidence was not reduced but was even increased from 0.6% to 2% (P = 0.004). For intermediate-risk patients (n = 745), the IFD incidence was reduced from 6.6% to 2.1% (P = 0.007) with anti-fungal prophylaxis. For high-risk patients (n = 199), the IFD incidence decreased significantly from 23.3% to 8.4% (P = 0.007).
Pre-chemotherapy risk score
Basing on the analysis, we demonstrated that a risk score is helpful in identifying the patients with high-risk of IFD and who may benefit most likely from anti-fungal prophylaxis. In the risk score model, four independent risk factors, namely, male patients, induction chemotherapy for patients with newly diagnosed or relapsed disease, central-venous catheter, and history of previous IFD, were pre-determined before chemotherapy, whereas development of neutropenia and neutropenia for>10 days were predicted at least partially based on the intensity of chemotherapy and the hematological toxicity of previous cycles of chemotherapy. The only factor that can neither be determined nor predicted was the hypoalbuminemia after chemotherapy thus making the evaluation of IFD unfeasible before the start of chemotherapy. To address this question, a new risk score was built-up that excluded all risk factors that were potentially related to IFD but were unpredicted before chemotherapy, such as hypoalbuminemia, liver function damage, and parenteral nutrition required after chemotherapy, in the multivariate logistic regression analysis. The new pre-chemo risk score included only six factors and a total score of 0–21, as shown in Table 6. Further analysis confirmed that the pre-chemo score could also differentiate patients into groups with increasing incidence of IFD: low-risk patients with pre-chemo risk scores of 0–9 (IFD 0%–1.3%), intermediate-risk patients with scores of 10–15 (IFD ~4.5%), and high-risk patients with scores of>15 (IFD>10%), as shown in Table 7. We verified that the prophylaxis was useful in the intermediate- and high-risk groups but not in the low-risk group even when a slightly increased IFD incidence was documented (Table 8).
Discussion
Fungal infection is one of the leading causes of lethal infectious complications in patients with hematological malignancy receiving either chemotherapy or HSCT [
10,
24,
25]. The incidence of IFD and potentially IFD-related mortality can be reduced by anti-fungal prophylaxis and early treatment [
3,
26,
27]. However, the significant benefits of antifungal prophylaxis was mostly observed in high-risk patients with IFD incidence of 10%–15%, whereas the benefit was minimal if the IFD incidence was<5% [
6,
28–
31]. Moreover, researchers argue whether empirical or pre-emptive therapy should be applied in cases of persistent fever in patients with prolonged neutropenia after chemotherapy. Although pre-emptive treatment definitely reduced the potentially unnecessary use of anti-fungal treatment, empirical antifungal treatment seems to guarantee a better outcome in terms of the reduced incidence of IFD and IFD-related mortality [
32]. Recent guidelines suggest a risk-based approach that recommends empirical therapy for high-risk patients and antifungal treatment for low-risk patients except in cases of additional findings that indicate a suspected IFD [
8]. Therefore, the starting point of an optimal anti-fungal strategy is a more reliable risk assessment of patient at high risk of IFD.
In the literature, numerous risk factors have been reported to be associated with IFD [
6,
9–
21]. The most commonly reported variables included hematological disease (AML/MDS vs. others), disease status (newly diagnosed and relapse/refractory vs. clinical remission), type of treatment (chemotherapy vs. transplantation or induction vs. consolidation chemotherapy), development of neutropenia and its duration, graft versus host diseases (GVHD) with steroid treatment in case of allogeneic HSCT, and previous history of IFD. Genetic factors related to host innate immunity and environmental variables have also been reported to be important [
33]. Therefore, the precise evaluation of IFD incidence has become extremely complex because all of these risk factors must be considered and weighed for each patient.
To overcome this challenge and make the assessment as simple as possible, a prognostic model or risk score can complement the clinical assessment by providing an objective summation of multiple risk factors to identify the patients with high risk of IFD and who are most likely to benefit from anti-fungal prophylaxis. In a previous study, Stanzani
et al. [
34] reported a single institution study that aimed to develop and validate an unconditional risk model for IFD in a heterogeneous population of patients with hematological malignancies undergoing both chemotherapy and allogeneic HSCT. The risk model included four major risk factors with a cut-off value of six identified patients with low vs. high risk of IFD. This study demonstrated that posaconazole prophylaxis was not associated with a reduced IFD in low-risk patients (scores<6), whereas benefits were documented in high-risk patients (scores>6). The major limitation of this study is the mixture of patients undergoing chemotherapy and allogeneic HSCT, which included patients with GVHD and corticosteroids treatment.
In this study, we utilized the multiple-center-based CAESAR study, which included 4192 patients, to perform a risk model study for IFD in patients with hematological malignancies undergoing chemotherapy only. The risk factors included in the analysis were routinely available in “real-life” clinical settings. After multivariate analysis, six variables, namely, age, diagnosis of disease, ECOG score, concomitant diseases, hepatic impairment, and use of parental nutrition, lost significance, thereby leaving seven clinical variables to be considered independently associated with IFD, as shown in Table 2. A score system was built up accordingly. We confirmed the discriminative performance of the IFD risk score system in both the training and validation datasets. The patients with scores of>10 predicted an IFD incidence of over 5%, whereas higher scores of>15 presented IFD of up to 20%. The patients with lower scores (6–10) were associated with a low IFD incidence of<2%, whereas those with scores of 0–5 presenting an extremely low risk of IFD (<0.5%).
The meta-analyses for the anti-fungal prophylaxis recommended the use of prophylaxis for patients with the highest risk of IFD, such as allogeneic HSCT recipients and those treated for acute leukemia or MDS, whose IFD incidence was likely to exceed 5% without prophylaxis, whereas the most significant benefit was recorded when the IFD incidence was above 10%–15% [
6,
28–
30]. Reports have shown that prophylaxis was not considered cost-effective if the baseline IFD incidence rate was assumed to be 3%; thus, a threshold of 5% was often used in the clinical decision-making process [
6,
35]. When these independent risk factors of IFD in patients undergoing chemotherapy were considered individually, few factors could identify a group of patients with an IFD incidence of above 5% without prophylaxis, and the benefit of prophylaxis was demonstrated only in patients with either hypoalbuminemia (
n = 544) or prolonged neutropenia (>14 days,
n = 195, Table 9).
Considering that our risk score system integrated multiple independent risk factors of IFD, we confirmed that a group of patients had an extremely low risk of IFD (<1%) and another group of patients (n = 944) had a high risk of IFD of above 5%. Moreover, the risk score also discriminated a group of patients (n = 199) with an extra high incidence of IFD above 15%. We also confirmed that the anti-fungal prophylaxis presented no significant benefits in the patients with low risk scores (0–10), whereas the benefits in the patients with intermediate (11–15) and high scores (>15) were prominent with reduction of the total IFD incidence at 4.5% and 15%, respectively. To maximize the risk score model in guiding the anti-fungal prophylaxis, we further established a pro-chemo risk score with risk factors that can be easily determined or predicted before chemotherapy. All of these data confirmed that by using the risk score, we could divide the patients into three groups of low, intermediate, and high risk of IFD with predictable IFD incidences of<1.5%, ~5%, and>10%, respectively. More importantly, the benefit of antifungal prophylaxis was documented in intermediate and particularly high-risk patients, thus making the risk score a suitable tool in evaluating the risk of IFD and guiding the anti-fungal prophylaxis in clinical settings.
Several interesting points remains to be clarified. In the patients with low-risk IFD (either by risk score 0–10 or patients undergoing consolidation chemotherapy or without hypoalbuminemia), anti-fungal prophylaxis led to an overall IFD incidence of around 2%, which was even higher than that of the patients without prophylaxis (0.6%). We further analyzed the outcome of anti-fungal prophylaxis in patients with respect to individual risk factors (Table 9). Although anti-fungal prophylaxis was beneficial in patients with prolonged neutropenia for more than 14 days or hypoalbuminemia, i.e., the patients who were considered to be of low risk for IFD with consolidation chemotherapy or without hypoalbuminemia or no neutropenia, the incidence of IFD was low (<1%) without prophylaxis but increased to around 2% with anti-fungal prophylaxis.
One possible explanation is the observational nature of the CAESAR study. The use of anti-fungal prophylaxis was based on the hematologists’ decision. The prevailing trend was to administer anti-fungal prophylaxis to patients with high-risk features, such as patients with previous history of IFD, elderly patients, or patients with decreased performance status, whereas prophylaxis was usually spared in younger, fit patients without previous IFD even if these patients satisfied the criteria of low risk based on the score system. For example, 48.7% (93/191) of the patients with previous documented or suspected IFD received anti-fungal prophylaxis, whereas only 14.5% with no previous IFD history received the treatment (Table 9) even though the impact of the previous history of IFD was significant particularly in patients with low risk scores. The other possible explanation is that key factors associated with IFD, were not selected by the analysis either due to statistic power or exclusion in the original design. For example, although the evaluation of IFD risk based on clinical variables is feasible and easy to perform in clinical settings, genetic immunological factors and environmental factors, such as patients receiving chemotherapy without high efficiency particulate air (HEPA) filtration or admission to the hospital with ongoing construction, were excluded as risk factors [
36–
38]. Environmental factors are significant when patients have few or no other IFD risk factors, whereas its impact on IFD may lose significance in patients with multiple prominent IFD risk factors, such as prolonged neutropenia, previous history of IFD, and hypoalbuminemia. In clinical settings, the prevailing trend was to administer anti-fungal prophylaxis to patients receiving chemotherapy in a high-risk environment, whereas prophylaxis was spared for patients in a more protective scenario. Although the underlying cause of the observation remains unclear, we may conclude based on our data that anti-fungal prophylaxis is not beneficial for patients with low risk of IFD.
Another interesting point is the impact of gender on the IFD incidence, which was not identified in previous studies [
13,
14,
34]. First, an imbalanced distribution of clinical features were observed between male and female patients in the CAESAR study, and the impact of any imbalance can be overcome by multivariate analysis. Secondary, the number of patients included in the score building-up procedure also exerts an impact. In our patients’ series based on more than 4000 patients (largest for an IFD study), gender had the smallest individual weights among all factors. The low-weighted factors can stand out only with a large number of patients, and a lower number of patients may lead to the loss of its statistical significance in multivariate analysis. Finally, we may speculate that the gender issue may be associated with smoking history or smoking exposure. Although no documentation is available for smoking as a risk factor of IFD, cases of pulmonary IFD due to smoking fungal-contaminated marijuana have been reported [
39,
40]. The other possibility is that patients with heavy smoking history may have more severe pulmonary diseases, which may contribute to the increased risk of IFD in hematological patients — which is beyond the scope of our study.
Conclusions
In conclusion, our study attempted for the first time to develop an IFD risk score system based on a large patient population that is specifically targeted for patients with hematological malignancies receiving chemotherapy only. We established an objective, weighted risk score for IFD that could reliably discriminate the incidence of IFD. The precise risk assessment of IFD may provide a basis for risk-based anti-fungal treatment in patients with hematological malignancies. The score system should be implemented with caution because some IFD-associated factors (such as environmental factors) were excluded, and further confirmation is required in prospective study particularly with well-defined diagnostic procedure and definite anti-fungal strategy.
Higher Education Press and Springer-Verlag GmbH Germany, part of Springer Nature