Discrepancies in breast cancer guideline recommendations despite similar Cochrane systematic review conclusions

Abstract

Aim: This study aims to describe the citation patterns of Cochrane systematic reviews (CSR) in guidelines for managing breast cancer.

Methods: We searched for systematic reviews on breast cancer in The Cochrane Library from the date of inception to November 15, 2023, and identified guidelines that cited them. We described how systematic reviews were cited by the guidelines in each database and each year. Additionally, we presented the relationships between the conclusions of the systematic reviews and guideline recommendations and compared the consistency of the recommendations on the same topic across different guidelines.

Results: A total of 64 systematic reviews and 228 guidelines were included in this study. The average number of the 64 systematic reviews cited by the guidelines was 5.91. We found that the guideline recommendations were irrelevant or inconsistent with the conclusions of the systematic reviews in 56 (38.36%) cited entries. We grouped recommendations on the same topic across different guidelines into one group, of which only 5 groups (15.15%) had completely consistent recommendations, and the other 28 groups (84.85%) had inconsistent recommendations.

Conclusion: The average number of citations for CSR on breast cancer in the guidelines was 5.91. There were also situations in which the guideline recommendations were inconsistent with the conclusions of the included systematic reviews, and recommendations on the same topic across different guidelines were inconsistent.

Keywords

breast cancer / guideline / systematic reviews

References

[1] Chen YL, Wang C, Shang HC, Yang KH, Norris SL. Clinical practice guidelines in China. BMJ. 2018; 360:j5158.

[2] Lindson-Hawley N, Heath L, Hartmann-Boyce J. Twenty years of the cochrane tobacco addiction group: past, present, and future. Nicotine Tob Res. 2018; 20(2): 147–153.

[3] Babic A, Tokalic R, Amílcar Silva Cunha J. Assessments of attrition bias in Cochrane systematic reviews are highly inconsistent and thus hindering trial comparability. BMC Med Res Method. 2019; 19(1): 76.

[4] Ebner N, Banach M, Anker SD, von Haehling S. From meta-analysis to Cochrane reviews. J Cachex, Sarcopen Muscle. 2018; 9(3): 441–443.

[5] Andersen MZ, Gülen S, Fonnes S, Andresen K, Rosenberg J. Half of Cochrane reviews were published more than 2 years after the protocol. J Clin Epidemiol. 2020; 124: 85–93.

[6] National Institute for Health and Care Excellence. Process and Methods Guides: The Guidelines Manual. NICE; 2012.

[7] Tew WP, Muss HB, Kimmick GG, Von Gruenigen VE, Lichtman SM. Breast and ovarian cancer in the older woman. J Clin Oncol. 2014; 32(24): 2553–2561.

[8] Sung H, Ferlay J, Siegel RL, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2021; 71(3): 209–249.

[9] Choi EK, Kim IR, Chang O, et al. Impact of chemotherapy-induced alopecia distress on body image, psychosocial well-being, and depression in breast cancer patients. Psychooncology. 2014; 23(10): 1103–1110.

[10] Chopra I, Kamal KM. A systematic review of quality of life instruments in long-term breast cancer survivors. Health Qual Life Outc. 2012; 10: 14.

[11] Pum J. A practical guide to validation and verification of analytical methods in the clinical laboratory. Adv Clin Chem. 2019; 90: 215–281.

[12] Alper BS, Price A, van Zuuren EJ, et al. Consistency of recommendations for evaluation and management of hypertension. JAMA Netw Open. 2019; 2(11):e1915975.

[13] Niell BL, Freer PE, Weinfurtner RJ, Arleo EK, Drukteinis JS. Screening for breast cancer. Radiol Clin North Am. 2017; 55(6): 1145–1162.

[14] Health AIMS. Clinical Appropriateness Guidelines: Radiation Oncology Brachytherapy, Intensity Modulated Radiation Therapy (IMRT), Stereotactic Body Radiation Therapy (SBRT) and Stereotactic Radiosurgery (SRS) Treatment Guidelines. AIM; 2019.

[15] Health AIMS. Clinical Appropriateness Guidelines: Radiation Oncology, Brachytherapy, Intensity modulated Radiation Therapy (IMRT), stereotactic body radiation therapy (SBRT) and Stereotactic Radiosurgery (SRS) Treatment Guidelines AIM Specialty Health. AIM; 2020.

[16] Cardoso F, Fallowfield L, Costa A, Castiglione M, Senkus E. Locally recurrent or metastatic breast cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2011; 22(6): 25–30.

[17] Wöckel A, Festl J, Stüber T, et al. Interdisciplinary screening, diagnosis, therapy and follow-up of breast cancer. Guideline of the DGGG and the DKG (S3-Level, AWMF Registry Number 032/045OL, December 2017)—part 2 with recommendations for the therapy of primary, recurrent and advanced breast cancer. Geburtshilfe Frauenheilkunde. 2018; 78(11): 1056–1088.

[18] De Villiers TJ, Pines A, Panay N, et al. Updated 2013 International Menopause Society recommendations on menopausal hormone therapy and preventive strategies for midlife health. Climacteric. 2013; 16(3): 316–337.

[19] Akl EA, Meerpohl JJ, Elliott J, Kahale LA, Schünemann HJ. Living systematic reviews: 4. Living guideline recommendations. J Clin Epidemiol. 2017; 91: 47–53.

[20] National Collaborating Centre for Cancer. Early Breast Cancer (Preventing Recurrence and Improving Survival): Adjuvant Bisphosphonates. NICE; 2017.

[21] National Collaborating Centre for Cancer. Advanced Breast Cancer: Diagnosis and Treatment. NICE; 2017.

[22] Chiang CE, Wang TD, Ueng KC, et al. 2015 guidelines of the Taiwan Society of Cardiology and the Taiwan Hypertension Society for the management of hypertension. J Chin Med Assoc: JCMA. 2015; 78(1): 1–47.

[23] Hickey BE, James ML, Lehman M, et al. Hypofractionated radiation therapy for early breast cancer. Cochrane Database Syst Rev. 2016; 2016(7):CD003860.

[24] Wagner AD, Thomssen C, Haerting J, Unverzagt S. Vascular-endothelial-growth-factor (VEGF) targeting therapies for endocrine refractory or resistant metastatic breast cancer. Cochrane Database Syst Rev. 2012(7):CD008941.

[25] Farquhar C, Marjoribanks J, Lethaby A, Azhar M. High-dose chemotherapy and autologous bone marrow or stem cell transplantation versus conventional chemotherapy for women with early poor prognosis breast cancer. Cochrane Database Syst Rev. 2016; 2016(5):CD003139.

[26] Barnes KL, Kirkham JJ, Clarke M, Williamson PR. Citation analysis did not provide a reliable assessment of core outcome set uptake. J Clin Epidemiol. 2017; 86: 153–159.

[27] Komoike Y, Inokuchi M, Itoh T, et al. Japan Breast Cancer Society clinical practice guideline for surgical treatment of breast cancer. Breast Cancer. 2015; 22(1): 37–48.

[28] Oeffinger KC, Fontham ET, Etzioni R, et al. Breast Cancer Screening for Women at Average Risk: 2015 Guideline Update from the American Cancer Society. JAMA. 2015; 314(15): 1599–1614.

[29] Paluch-Shimon S, Cardoso F, Partridge AH, et al. ESO-ESMO 4th International Consensus Guidelines for Breast Cancer in Young Women (BCY4). Ann Oncol. 2020; 31(6): 674–696.

[30] Migowski A, Azevedo e Silva G, Kneipp Dias MB, Estevez Diz MDP, Sant'Ana DR, Nadanovsky P. Guidelines for early detection of breast cancer in Brazil. II—New national recommendations, main evidence, and controversies. Cad Saude Publica. 2018; 34(6):e00074817.

[31] Carter HB, Albertsen PC, Barry MJ, et al. Early detection of prostate cancer: AUA Guideline. J Urol. 2013; 190(2): 419–426.

[32] Segura PP, Fombella JP, Lorenzo BP, Martín MR, Lopez PG. SEOM guide to primary and secondary prevention of cancer: 2014. Clin Transl Oncol. 2014; 16(12): 1072–1078.

[33] Royal Australian College of General Practitioners. National guide to a preventive health assessment for Aboriginal and Torres Strait Islander people: Evidence base (Third edition). 2018.

[34] Gültekin M, Fau DN, Aksan G, Ozgul N. Management of endometrial hyperplasia. Minerva Ginecol. 2010; 62: 433–445.

[35] Gøtzsche PC, Jørgensen KJ. Screening for breast cancer with mammography. Cochrane Database Syst Rev. 2013; 2013(6):CD001877.

[36] Chen YL, Yang KH. How to correctly understand, develop, and apply clinical practice guidelines. Med J PUMCH. 2018; 9(4): 367–373.

[37] Kreit E, Pindus D, Mullis R, Chowienczyk S, Mant J. Clinical practice guidelines for stroke rehabilitation and long-term management: similarities and differences in recommendations for mood, aphasia and cognitive deficits. Eur Stroke J. 2017; 2(1): 372.

[38] Ge L, Tian JH, Li YN, et al. Association between prospective registration and overall reporting and methodological quality of systematic reviews: a meta-epidemiological study. J Clin Epidemiol. 2018; 93: 45–55.

[39] Wang X, Chen Y, Yao L, et al. Reporting of declarations and conflicts of interest in WHO guidelines can be further improved. J Clin Epidemiol. 2018; 98: 1–8.

[40] ACCF/AHA. Methodology manual and policies from the ACCF/AHA task force on practice guidelines. 2010.

[41] AAN. Clinical practice guideline process manual. 2011.

[42] Rosenfeld RM, Shiffman RN. Clinical practice guideline development manual: a quality-driven approach for translating evidence into action. Otolaryngol—Head Neck Surg. 2009; 140(6): 1–43.

[43] Fukui T, Yamaguchi N. Morizane T, Yoshida M, Kojimahara N. (eds.). Minds handbook for guidelines development. Japan Council for Quality Health Care; 2014.

[44] SIGN. A guideline developer's handbook. 2015.

[45] Center MG. Minds handbook for guidelines development. 2014.

[46] Umscheid CA, Agarwal RK, Brennan PJ. Updating the guideline development methodology of the Healthcare Infection Control Practices Advisory Committee (HICPAC). Am J Infect Control. 2010; 38(4): 264–273.

[47] BHIVA. British HIV Association (BHIVA) guideline development manual. 2021.

[48] ESHRE. Manual for ESHRE guidelines handbook. 2017.

[49] ANZSN, KHA. KHA-CARI guidelines development manual. 2017.

[50] Zhou Q, Wang ZJ, Shi QL, et al. Clinical Epidemiology in China series. Paper 4: the reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: a systematic review. J Clin Epidemiol. 2021; 140: 189–199.

[51] Chen YL, Wang JJ, Zhang SY, et al. How to address conflicts of interest in clinical practice guidelines. Med J Peking Union Med Coll Hosp. 2019; 10(6): 685–691.

[52] Gao YT, Wang JJ, Luo XF, et al. Quality appraisal of clinical practice guidelines for diabetes mellitus published in China between 2007 and 2017 using the AGREE II instrument. BMJ Open. 2019; 9(9):e022392.

[53] Chen YL, Zhang XZ, Zhou Q, et al. Adaptation of clinical practice guidelines. Med J PUMCH. 2020; 11(1): 102–108.

RIGHTS & PERMISSIONS

2024 The Authors. Journal of Evidence-Based Medicine published by Chinese Cochrane Center, West China Hospital of Sichuan University and John Wiley & Sons Australia, Ltd.