Assessment of presentation quality of the results of clinical trials in accordance with the standards of CONSORT

Abstract

Randomized clinical trials (RCTs) are currently recognized as the gold standard for evaluating the efficacy and safety of medical interventions. However, often the presentation of the results of RCTs in reports and articles does not give a complete and reliable description of all the results of the test, which often leads to incorrect conclusions and guidelines. In order to comply with certain uniform requirements for reporting documents based on materials of the conducted RCT, a group of authors and editors of medical journals in the early 1990s came out with a proposal to the medical community about using common standards for presenting RCT results, which they called CONSORT (CONsolidated Standards Of Reporting). The first version of CONSORT, however, caused a lot of criticism from both authors and editors of journals. The accumulated critical comments were taken into account by the developers of the revised and published in 2010 version of CONSORT, which is currently accepted as a reference for presenting the results of RCT in the world's leading medical journals. CONSORT 2010 contains a statement, supplemented with a set of questions on the conducted RCT, requiring a clearly formalized answer, and a flowchart for visual presentation of the results. In addition, the CONSORT developers submitted a separate document to clarify the terms in order to clarify the cases of application of this methodology. It is important to understand that CONSORT does not include recommendations for developing, conducting and analyzing the trials. It contains only reports on what and how it was done, what was eventually established, and only indirectly affects the design and conduct of RCT. However, authors who are familiar with the requirements of CONSORT will strive to meet these requirements when planning and conducting RCTs. As an example, the article presents a case of assessing the quality of the presentation of one of the RCTs according to CONSORT 2010 standards.

Keywords

CONSORT / randomized clinical trials / evidence-based medicine

References

[1] Association of Clinical Research Organizations. http://acto-russia.org/index.php?option=com_content&task=view&id=184 (access date: 17.04.2019). (In Russ.)

[2] Москвичёва М.Г., Шишкина Е.В. Комплексное изу­чение дорожно-транспортного травматизма на территории Челябинской области. Пробл. социал. гигиены, здравоохр. и истории мед. 2015; (2): 7–11.

[3] Clinical trials in Russian Federation. http://clinical-rials.ru/about_trials.html (access date: 17.04.2019). (In Russ.)

[4] Шабунова А.А., Дуганов М.Д., Калашников К.Н. Преждевременная смертность как причина экономических потерь региона. Здравоохр. РФ. 2012; (3): 26–30.

[5] Jüni P., Altman D.G., Egger M. Systematic reviews in health care: Assessing the quality of controlled clinical trials. Brit. Med. J. 2001; 323: 42–46. DOI: 10.1136/bmj.323.7303.42.

[6] Боровиков В.Н., Семёнова В.Г., Хрупалов А.А. и др. Дорожно-транспортный травматизм как комплексная медико-социальная проблема потерь здоровья населения России. Травматология и ортопедия России. 2011; (3): 101–108.

[7] Chan A.W., Altman D.G. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005; 365: 1159–1162. DOI: 10.1016/S0140-6736(05)71879-1.

[8] Егизарян К.А., Черкасов С.Н., Аттоева Л.Ж. Мониторинг эффективности мероприятий, проводимых в рамках государственной политики в сфере профилактики травматизма в России. Применение современных технологий лечения в российской травматологии и ортопедии. Сборник тезисов международной конференции травматологов-ортопедов. М. 2016; 68–69.

[9] Glasziou P., Meats E., Heneghan C., Shepperd S. What is missing from descriptions of treatment in trials and reviews? Brit. Med. J. 2008; 336: 1472–1474. DOI: 10.1136/bmj.39590.732037.47.

[10] Clark D.E. Trauma system evaluation using the fatality analysis reporting system. J. Trauma. 2003; 54 (6): 1199–1204.

[11] Dwan K., Altman D.G., Arnaiz J.A. et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS ONE. 2008; 3: e3081. DOI: 10.1371/journal.pone.0003081.

[12] Lendrum R.A., Lockey D.J. Trauma system development. Anaesthesia. 2013; 68 (1): 30–39.

[13] A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. JAMA. 1994; 272: 1926–1931. DOI: 10.1001/jama.272.24.1926.

[14] Nathens A.B., Jurkovich G.J., Rivara F.P., Maier R.V. Effectiveness of state trauma systems in reducing injury-­related mortality: a national evaluation. J. Trauma. 2000; 48 (1): 25–30.

[15] Call for comments on a proposal to improve repor­ting of clinical trials in the biomedical literature. Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature. Ann. Intern. Med. 1994; 121: ­894–895. DOI: 10.7326/0003-4819-121-11-199412010-00015.

[16] Pigneri D.A., Beldowicz B., Jurkovich G.J. Trauma systems: Origins, evolution, and current challenges. Surg. Clin. North Am. 2017; 97 (5): 947–959. DOI: 10.1016/j.suc.2017.06.011.

[17] Rennie D. Reporting randomized controlled trials. An experiment and a call for responses from readers. JAMA. 1995; 273: 1054–1055. DOI: 10.1001/jama.273.13.1054.

[18] La Grone L., Riggle K., Joshipura M. et al. Uptake of the World Health Organization’s trauma care guidelines: a systematic review. Bulletin of the World Health Orga­nisation. 2016; 94 (8): 585–598. http://dx.doi.org/10.2471/BLT.15.162214 (access date: 03.02.2019).

[19] Begg C., Cho M., Eastwood S. et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996; 276: 637–639. DOI: 10.1001/jama.1996.03540080059030.

[20] Carr B.G., Nance M.L. Access to pediatric trauma care: alignment of providers and health systems. Curr. Opin. Pediatr. 2010; 22 (3): 326–331. DOI: 10.1097/ MOP.0b013e3283392a48.

[21] Altman D.G. Better reporting of randomized controlled trials: the CONSORT statement. Brit. Med. J. 1996; 313: 570–571. DOI: 10.1136/bmj.313.7057.570.

[22] Petrosyan M., Guner Y.S., Emami C.N., Ford H.R. Disparities in the delivery of pediatric trauma care. J. Trauma. 2009; 67 (2): 114–119. DOI: 10.1097/TA.0b013e3181ad3251.

[23] A standard method for reporting randomized me­dical scientific research; the Consolidation of the standards of reporting trials (CONSORT). Ned. Tijdschr. Geneeskd. 1998; 142: 1089–1091. PMID: 9623225.

[24] Зорин В.И., Жила Н.Г. Проблемы оказания помощи детям, пострадавшим при дорожно-транспортных происшествиях. Дальневосточный мед. ж. 2011; (3): 44–46.

[25] Huston P., Hoey J. CMAJ endorses the CONSORT statement. CONsolidation of Standards for Reporting Trials. CMAJ. 1996; 155: 1277–1282. PMID: 8911294.

[26] Кузьмин А.Г., Вишняков Н.И., Мартынова Н.А. Анализ исходов дорожно-транспортных происшествий с участием детей. Казанский мед. ж. 2011; (4); 599–561.

[27] Ausejo M., Saenz A., Moher D. CONSORT: an attempt to improve the quality of publication of clinical trials. Aten. Primaria. 1998; 21: 351–352. PMID: 9633133.

[28] Бережнова Т.А., Кулинцова Я.В. Современная диагностика неотложных состояний у детей, пострадавших в дорожно-транспортных происшествиях. Ж. научных статей здоровье и образование в XXI веке. 2016; (2): 426–429.

[29] Davidoff F. News from the International Committee of Medical Journal Editors. Ann. Intern. Med. 2000; 133: 229–231. DOI: 10.7326/0003-4819-133-3-200008010-00017.

[30] Болотников И.Ю., Галактионова Н.И. Совершенствование догоспитальной медицинской помощи в Астраханской области пострадавшим в результате дорожно-транспортных происшествий. Известия высших учебных заведений. Поволжский регион. Мед. науки. 2017; (1): 101–109. DOI: 10.21685/2072-3032-2017-1-11.

[31] Meinert C.L. Beyond CONSORT: need for improved reporting standards for clinical trials. Consolidated Standards of Reporting Trials. JAMA. 1998; 279: 1487–1489. DOI: 10.1001/jama.279.18.1487.

[32] Семёнова Ж.Б., Валиуллина С.А., Карасёва О.В. и др. Специализированная помощь, или «цепочка выживания» у детей с тяжёлой черепно-мозговой травмой. Мед. альманах. 2014; 5. https://elibrary.ru/download/elibrary_21500186_86327187.pdf (дата обращения: 03.02.2019).

[33] Moher D., Jones A., Lepage L. Use of the ­CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001; 285: 1992–1995. DOI: 10.1001/jama.285.15.1992.

[34] Bennett K.M., Vaslef S., Pappas T.N., Scarbo­rough J.E. The volume-outcomes relationship for United States Level I trauma centers. J. Surg. Res. 2011; 167 (1): 19–23.

[35] Moher D., Schulz K.F., Altman D. The ­CONSORT statement: revised recommendations for improving the qua­lity of reports of parallel-group randomized trials. JAMA. 2001; 285: 1987–1991. DOI: 10.1001/jama.285.15.1987.

[36] Kim Y.J. Relationship of trauma centre characte­ristics and patient outcomes: a systematic review. J. Clin. Nurs. 2014; 23 (3–4): 301–314. DOI: 10.1111/jocn.12129.

[37] Egger M., Juni P., Bartlett C. Value of flow diagrams in reports of randomized controlled trials. JAMA. 2001; 285: 1996–1999. DOI: 10.1001/jama.285.15.1996.

[38] Порханов В.А., Завражнов А.А., Афаунов А.А. и др. Анализ факторов, оказывающих влияние на уровень летальности, среди пациентов в остром периоде политравмы, госпитализированных в региональный многопрофильный стационар. Мед. вестн. Юга России. 2016; (4): 39–44.

[39] Moher D., Schulz K.F., Altman D.G. The ­CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. Ann. Intern. Med. 2001; 134: 657–662. DOI: 10.7326/0003-4819-134-8-200104170-00011.

[40] Шишкин Е.В. Анализ эффективности первых лет работы травматологического центра первого уровня на территории Челябинской области. Казанский мед. ж. 2015; 96 (1): 100–104.

[41] Moher D., Schulz K.F., Altman D.G. The ­CONSORT statement: revised recommendations for improving the qua­lity of reports of parallel-group randomised trials. Lancet. 2001; 357: 1191–1194. DOI: 10.1016/S0140-6736(00)04337-3.

[42] Порханов В.А., Барышев А.Г., Блаженко А.Н. и др. Результаты лечения больных с политравмой в многопрофильной клинике. Хирургия. Ж. им. Н.И. Пирогова. 2018; (12): 82–85. DOI: 10.17116/hirurgia201812182.

[43] Campbell M.K., Elbourne D.R., Altman D.G. ­CONSORT statement: extension to cluster randomised trials. Brit. Med. J. 2004; 328: 702–708. DOI: 10.1136/bmj.328.7441.702.

[44] Кирсанова А.А. Совершенствование организации медицинской помощи пострадавшим при дорожно-транспортных происшествиях в Хабаровском крае за январь-апрель 2017 г. Тихоокеанский мед. ж. 2017; (3): 83–84.

[45] CONSORT Transparent reporting of trials. http://www.consort-statement.org/about-consort (access date: 17.04.2019).

[46] Дементьев И.М., Гуров А.Н. Применение программного комплекса для паспортизации травматологических центров и контроля качества лечения пациентов, пострадавших при дорожно-транспортных происшествиях в Московской области. Врач. 2017; (3): 39–45.

[47] Schulz K.F., Altman D.G., Moher D. ­CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. Int. J. Surg. 2012; 9 (8): 672–677. DOI: 10.1016/j.ijsu.2011.09.004.

[48] Nathens A.B., Jurkovich G.J., Cummings P. et al. The effect of organized systems of trauma care on motor vehicle crash mortality. JAMA. 2000; 283 (15): 1990–1994. DOI: 10.1001/jama.283.15.1990.

[49] Schulz K.F., Altman D.G., Moher D. ­CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. J. Clin. Epidemiol. 2010; 63 (8): 834–840. DOI: 10.1016/j.jclinepi.2010.02.005.

[50] Claridge J.A., Allen D., Patterson B. et al. Regional collaboration across hospital systems to develop and implement trauma protocols saves lives within 2 years. Surgery. 2013; 154 (4): 875–882. DOI: 10.1016/j.surg.2013.07.013.

[51] Schulz K.F., Altman D.G., Moher D., Fergusson D. CONSORT 2010 changes and testing blindness in RCTs. Lancet. 2010; 375: 1144–1146. DOI: 10.1016/S0140-6736(10)60413-8.

[52] Gomez D., Haas B., Hemmila M. et al. Hips can lie: impact of excluding isolated hip fractures on external benchmarking of trauma center performance. J. Trauma. 2010; 69 (5): 1037–1041. DOI: 10.1097/TA.0b013e3181f65387.

[53] Moher D., Hopewell S., Schulz K.F. et al. ­CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int. J. Surg. 2012; 10 (1): 28–55. DOI: 10.1016/j.ijsu.2011.10.001.

[54] Nathens A.B., Xiong W., Shafi S. Ranking of trauma center performance: the bare essentials. J. Trauma. 2008; 65 (3): 628–635. DOI: 10.1097/TA.0b013e3181837994.

[55] Sologub T.V., Goryacheva L.G., Sukhanov D.S. et al. Study of pharmacotherapeutic efficacy, safety with an assessment of the risk of adverse outcomes of inclusion of remaxol in the treatment of chronic liver da­mage (based on multicenter randomized clinical trials). Vestnik Sankt-Peterburgskoy gosudarstvennoy meditsinskoy aka­demii im. I.I. Mechnikova. 2009; (2): 116–124. (In Russ.)

[56] Würdemann F.S., Smeeing D.P.J., Ferree S. et al. Differentiation in an inclusive trauma system: allocation of lower extremity fractures. World J. Emerg. Surg. 2018; 13: 18. DOI: 10.1186/s13017-018-0178-1.

[57] CONSORT Transparent reporting of trials. http://www.consort-statement.org/downloads/translations (access date: 17.04.2019).

[58] Alexandrescu R., O'Brien S.J., Lecky F.E. A review of injury epidemiology in the UK and Europe: some me­thodological considerations in constructing rates. BMC Public Health. 2009; 9: 226. DOI: 10.1186/1471-2458-9-226.

[59] Rosen H., Saleh F., Lipsitz S.R., Meara J.G. Lack of insurance negatively affects trauma mortality in US children. J. Pediatr. Surg. 2009; 44 (10): 1952–1957. DOI: 10.1016/j.jpedsurg.2008.12.026.

[60] Bener A. Strategy to improve road safety in deve­loping countries. Can. Med. J. 2003; 24: 447–452.

[61] Gabbe B.J., Lyons R.A., Fitzgerald M.C. et al. Reduced population burden of road transport-related major trauma after introduction of an inclusive trauma system. Ann. Surg. 2015; 261 (3): 565–572. DOI: 10.1097/SLA.0000000000000522.

[62] Moore L., Champion H., Tardif P.A., Kuimi B.L. Impact of trauma system structure on injury outcomes: A systematic review and meta-analysis. World J. Surg. 2018; 42 (5): 1327–1339. DOI: 10.1007/s00268-017-4292-0.

[63] Huseynova K., Xiong W., Ray J.G. et al. Venous thromboembolism as a marker of quality of care in trauma. J. Am. Coll. Surg. 2009; 208 (4): 547–552. DOI: 10.1016/j.jamcollsurg.2009.01.002.

[64] Shafi S., Barnes S., Nicewander D. et al. Health care reform at trauma centers — mortality, complications, and length of stay. J. Trauma. 2010; 69 (6): 1367–1371. DOI: 10.1097/TA.0b013e3181fb785d.

[65] Shafi S., de la Plata CM., Diaz-Arrastia R. et al. Ethnic disparities exist in trauma care. J. Trauma. 2007; 63 (5): 1138–1142. DOI: 10.1097/TA.0b013e3181568cd4.

[66] Агаджанян В.В. К вопросу о создании реестра политравмы в Российской Федерации. Политравма. 2018; (1): 4–9.

[67] Sobrino J., Barnes S.A., Dahr N. et al. Frequency of adoption of practice management guidelines at trauma centers. Proc. (Bayl. Univ. Med. Cent.). 2013; 26 (3): 256–261.

[68] Demetriades D., Martin M., Salim A. et al. The effect of trauma center designation and trauma volume on outcome in specific severe injuries. Ann. Surg. 2005; 242 (4): 512–517.

[69] Simon R., Stone M., Cucuzzo J. The impact of a new trauma center on an existing nearby trauma center. J. Trauma. 2009; 67 (3): 645–650. DOI: 10.1097/TA.0b013e31818cae0c.

[70] Gunning A.C., Lansink K.W.W., Balogh Z.J. et al. Demographic patterns and outcomes of patients in level I trauma centers in three international trauma systems. World J. Surg. 2015; 39 (11): 2677–2684. DOI: 10.1007/s00268-015-3162-x

[71] Shafi S., Parks J., Ahn C. et al. More operations, more deaths? Relationship between operative intervention rates and risk-adjusted mortality at trauma centers. J. Trauma. 2010; 69 (1): 70–77. DOI: 10.1097/TA.0b013e3181e28168.

RIGHTS & PERMISSIONS

Kisar’ L.V., Ziganshin A.U., Ziganshina L.E.