Identification of indicators used to assess needs for telemedicine consultations in various profiles of medical care

Abstract

BACKGROUND: A unified system for assessing the results and real contributions of telemedicine consultations to improving medical care quality in the healthcare system of the Russian Federation has not yet been developed.

AIM: To develop a system of indicators for differentiated assessment of the needs for telemedicine consultations in the provision of medical care.

MATERIALS AND METHODS: In the first stage, reports on the results of on-site activities of national medical research centers in regions of the Russian Federation and their annual public reports (2020–2022) were analyzed to identify indicators that determine the need for telemedicine consultations. The identified indicators were clarified and validated in an open interview with the representatives of the national medical research centers. In the second stage, the value of each indicator was determined based on the expert survey: 18 experts assessed each indicator on a scale of 1–5. Then, the weight coefficient of each indicator was calculated for their subsequent use in planning the coverage of telemedicine consultations.

RESULTS: Three groups of indicators that determined the need for telemedicine consultations for different medical care profiles were as follows: (1) indicators that affect the planned volumes of telemedicine consultations, (2) indicators that characterize the efficiency and effectiveness of telemedicine consultations, and (3) indicators that characterize the validity of requests for telemedicine consultations. Group 1 included indicators of lethality, disability, hospital mortality, frequency of emergency/urgent consultations, and frequency of consultations of patients requiring intensive care. Group 2 included indicators for assessing the effectiveness and efficiency of telemedicine consultations, both subjective (result satisfaction) and objective (number of positive and negative treatment and hospitalization outcomes for cases that received where telemedicine consultations). Group 3 included indicators that characterize the validity of requests for telemedicine consultations: thoroughness of a patient’s examination before a telemedicine consultation and accuracy of the diagnosis. The weight coefficients of group 1 indicators ranged from 0.05 to 1.61 and varied for different profiles.

CONCLUSION: A system of indicators was proposed for the differentiated assessment of the needs for telemedicine consultations when providing medical care.

Keywords

need for telemedicine consultations / effectiveness / national medical research centers / profile of medical care / indicator / weight coefficient

References

[1] Hsu M-H, Chu T-B, Yen J-C, et al. Development and implementation of a national telehealth project for long-term care: a preliminary study. Computer methods and programs in biomedicine. 2010;97(3):286–292. doi: 10.1016/j.cmpb.2009.12.008

[2] Hsu M.-H., Chu T.-B., Yen J.-C., et al. Development and implementation of a national telehealth project for long-term care: a preliminary study // Computer methods and programs in biomedicine. 2010. Vol. 97, N 3. P. 286–292. doi: 10.1016/j.cmpb.2009.12.008

[3] Hsu M-H, Chu T-B, Yen J-C, et al. Development and implementation of a national telehealth project for long-term care: a preliminary study. Computer methods and programs in biomedicine. 2010;97(3):286–292. doi: 10.1016/j.cmpb.2009.12.008

[4] Telemedicine Consultations for Patients in Long Term Care: A Review of Clinical Effectiveness, Cost-Effectiveness, and Guidelines. Ottawa: Canadian Agency for Drugs and Technologies in Health; 2015.

[5] Telemedicine Consultations for Patients in Long Term Care: A Review of Clinical Effectiveness, Cost-Effectiveness, and Guidelines. Ottawa : Canadian Agency for Drugs and Technologies in Health, 2015.

[6] Telemedicine Consultations for Patients in Long Term Care: A Review of Clinical Effectiveness, Cost-Effectiveness, and Guidelines. Ottawa: Canadian Agency for Drugs and Technologies in Health; 2015.

[7] Kern-Goldberger AR, Srinivas SK. Telemedicine in Obstetrics. Clinics in perinatology. 2020;47(4):743–757. doi: 10.1016/j.clp.2020.08.007

[8] Kern-Goldberger A.R., Srinivas S.K. Telemedicine in Obstetrics // Clinics in perinatology. 2020. Vol. 47, N 4. P. 743–757. doi: 10.1016/j.clp.2020.08.007

[9] Kern-Goldberger AR, Srinivas SK. Telemedicine in Obstetrics. Clinics in perinatology. 2020;47(4):743–757. doi: 10.1016/j.clp.2020.08.007

[10] Narasimha S, Madathil KC, Agnisarman S, et al. Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies. Telemedicine journal and e-health. 2017;23(6):459–472. doi: 10.1089/tmj.2016.0178

[11] Narasimha S., Madathil K.C., Agnisarman S., et al. Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies // Telemedicine journal and e-health. 2017. Vol. 23, N 6. P. 459–472. doi: 10.1089/tmj.2016.0178

[12] Narasimha S, Madathil KC, Agnisarman S, et al. Designing Telemedicine Systems for Geriatric Patients: A Review of the Usability Studies. Telemedicine journal and e-health. 2017;23(6):459–472. doi: 10.1089/tmj.2016.0178

[13] Wolf TG, Schulze RKW, Ramos-Gomez F, et al. Effectiveness of Telemedicine and Teledentistry after the COVID-19 Pandemic. International journal of environmental research and public health. 2022;19(21). doi: 10.3390/ijerph192113857

[14] Wolf T.G., Schulze R.K.W., Ramos-Gomez F., et al. Effectiveness of Telemedicine and Teledentistry after the COVID-19 Pandemic // International journal of environmental research and public health. 2022. Vol. 19, N 21. doi: 10.3390/ijerph192113857

[15] Wolf TG, Schulze RKW, Ramos-Gomez F, et al. Effectiveness of Telemedicine and Teledentistry after the COVID-19 Pandemic. International journal of environmental research and public health. 2022;19(21). doi: 10.3390/ijerph192113857

[16] Omboni S, McManus RJ, Bosworth HB, et al. Evidence and Recommendations on the Use of Telemedicine for the Management of Arterial Hypertension: An International Expert Position Paper. Hypertension. 2020;76:1368–1383. doi: 10.1161/HYPERTENSIONAHA.120.15873

[17] Omboni S., McManus R.J., Bosworth H.B., et al. Evidence and Recommendations on the Use of Telemedicine for the Management of Arterial Hypertension: An International Expert Position Paper // Hypertension. 2020. Vol. 76. P. 1368–1383. doi: 10.1161/HYPERTENSIONAHA.120.15873

[18] Omboni S, McManus RJ, Bosworth HB, et al. Evidence and Recommendations on the Use of Telemedicine for the Management of Arterial Hypertension: An International Expert Position Paper. Hypertension. 2020;76:1368–1383. doi: 10.1161/HYPERTENSIONAHA.120.15873

[19] Chirra M, Marsili L, Wattley L, et al. Telemedicine in Neurological Disorders: Opportunities and Challenges. Telemedicine journal and e-health: the official journal of the American Telemedicine Association. 2019;25(7):541–550. doi: 10.1089/tmj.2018.0101

[20] Chirra M., Marsili L., Wattley L., et al. Telemedicine in Neurological Disorders: Opportunities and Challenges // Telemedicine journal and e-health: the official journal of the American Telemedicine Association. 2019. Vol. 25, N 7. P. 541–550. doi: 10.1089/tmj.2018.0101

[21] Chirra M, Marsili L, Wattley L, et al. Telemedicine in Neurological Disorders: Opportunities and Challenges. Telemedicine journal and e-health: the official journal of the American Telemedicine Association. 2019;25(7):541–550. doi: 10.1089/tmj.2018.0101

[22] Jackson LE, Edgil TA, Hill B, et al. Telemedicine in rheumatology care: A systematic review. Seminars in arthritis and rheumatism. 2022;56:152045. doi: 10.1016/j.semarthrit.2022.152045

[23] Jackson L.E., Edgil T.A., Hill B., et al. Telemedicine in rheumatology care: A systematic review // Seminars in arthritis and rheumatism. 2022. Vol. 56. P. 152045. doi: 10.1016/j.semarthrit.2022.152045

[24] Jackson LE, Edgil TA, Hill B, et al. Telemedicine in rheumatology care: A systematic review. Seminars in arthritis and rheumatism. 2022;56:152045. doi: 10.1016/j.semarthrit.2022.152045

[25] Rubin MN, Demaerschalk BM. The use of telemedicine in the management of acute stroke. Neurosurgical focus. 2014;36(1):E4. doi: 10.3171/2013.11.FOCUS13428

[26] Rubin M.N., Demaerschalk B.M. The use of telemedicine in the management of acute stroke // Neurosurgical focus. 2014. Vol. 36, N 1. P. E4. doi: 10.3171/2013.11.FOCUS13428

[27] Rubin MN, Demaerschalk BM. The use of telemedicine in the management of acute stroke. Neurosurgical focus. 2014;36(1):E4. doi: 10.3171/2013.11.FOCUS13428

[28] Drapkina OM, Shepel RN, Vakhovskaya TV, et al. Evaluation of the effectiveness of telemedicine consultations conducted by experts of National Medical Research Center for Therapy and Preventive Medicine. Profilakticheskaya Meditsina. 2020;23(6):7–14. doi: 10.17116/profmed2020230617

[29] Драпкина О.М., Шепель Р.Н., Ваховская Т.В., и др. Оценка эффективности телемедицинских консультаций, проводимых экспертами ФГБУ «НМИЦ ТПМ» Минздрава России // Профилактическая медицина. 2020. Т. 23, № 6. С. 7–14. doi: 10.17116/profmed2020230617

[30] Drapkina OM, Shepel RN, Vakhovskaya TV, et al. Evaluation of the effectiveness of telemedicine consultations conducted by experts of National Medical Research Center for Therapy and Preventive Medicine. Profilakticheskaya Meditsina. 2020;23(6):7–14. doi: 10.17116/profmed2020230617

[31] Chekhonadsky II, Skripov VS, Semenova NV, Shvedova AA, Malyshko LV. Capabilities of telemedicine consultations of patients with mental disorders. Profilakticheskaya Meditsina. 2021;24(9):74–78. doi: 10.17116/profmed20212409174

[32] Чехонадский И.И., Скрипов В.С., Семенова Н.В., Шведова А.А., Малышко Л.В. Возможности телемедицинских консультаций пациентов, страдающих психическими расстройствами // Профилактическая медицина. 2021. Т. 24, № 9. С. 74–78. doi: 10.17116/profmed20212409174

[33] Chekhonadsky II, Skripov VS, Semenova NV, Shvedova AA, Malyshko LV. Capabilities of telemedicine consultations of patients with mental disorders. Profilakticheskaya Meditsina. 2021;24(9):74–78. doi: 10.17116/profmed20212409174

[34] Skripov VS, Chekhonadsky II, Kochorova LV, Shvedova AA, Semenova NV. Results of interaction with regional services in the framework of telemedicine consultations on psychiatry and narcology. V.M. Bekhterev review of psychiatry and medical psychology. 2019;(3):73–77. doi: 10.31363/2313-7053-2019-3-73-77

[35] Скрипов В.С., Чехонадский И.И., Кочорова Л.В., Шведова А.А., Семенова Н.В. Результаты взаимодействия с региональными службами в рамках телемедицинских консультаций по психиатрии и наркологии // Обозрение психиатрии и медицинской психологии имени ВМ Бехтерева. 2019. № 3. С. 73–77. doi: 10.31363/2313-7053-2019-3-73-77

[36] Skripov VS, Chekhonadsky II, Kochorova LV, Shvedova AA, Semenova NV. Results of interaction with regional services in the framework of telemedicine consultations on psychiatry and narcology. V.M. Bekhterev review of psychiatry and medical psychology. 2019;(3):73–77. doi: 10.31363/2313-7053-2019-3-73-77

[37] Skripov VS, Semenova NV, Kochorova LV, Shvedova AA, Chekhonadsky II. Experience in consulting with the use of telemedicine technologies in psychiatry and narcology. Bulletin of the Russian military medical academy. 2019;2(66):188–190.

[38] Скрипов В.С., Семенова Н.В., Кочорова Л.В., Шведова А.А., Чехонадский И.И. Опыт проведения консультаций с применением телемедицинских технологий в психиатрии и наркологии // Вестник Российской Военно-медицинской академии. 2019. Т. 2, № 66. С. 188–190.

[39] Skripov VS, Semenova NV, Kochorova LV, Shvedova AA, Chekhonadsky II. Experience in consulting with the use of telemedicine technologies in psychiatry and narcology. Bulletin of the Russian military medical academy. 2019;2(66):188–190.

[40] Chukhrayov AM, Khodzhaev NS, Kechin EV. Analysis of the structure of telemedicine consultations in ophthalmology in the Russian Federation. Health care of the Russian Federation. 2020;64(1):22–28. doi: 10.18821/0044-197X-2020-64-1-22-28

[41] Чухраёв А.М., Ходжаев Н.С., Кечин Е.В. Анализ структуры телемедицинских консультаций по профилю «офтальмология» в Российской Федерации // Здравоохранение Российской Федерации. 2020. Т. 64, № 1. С. 22–28. doi: 10.18821/0044-197X-2020-64-1-22-28

[42] Chukhrayov AM, Khodzhaev NS, Kechin EV. Analysis of the structure of telemedicine consultations in ophthalmology in the Russian Federation. Health care of the Russian Federation. 2020;64(1):22–28. doi: 10.18821/0044-197X-2020-64-1-22-28

[43] Potievskaya VI, Kononova EV, Shaputko NV, et al. Telehealth consultations in cardio-oncology. Cardiovascular Therapy and Prevention. 2022;21(2):60–71. doi: 10.15829/1728-8800-2022-3164

[44] Потиевская В.И., Кононова Е.В., Шапутько Н.В., и др. Телемедицинские консультации в кардиоонкологии // Кардиоваскулярная терапия и профилактика. 2022. Т. 21, № 2. С. 60–71. doi: 10.15829/1728-8800-2022-3164

[45] Potievskaya VI, Kononova EV, Shaputko NV, et al. Telehealth consultations in cardio-oncology. Cardiovascular Therapy and Prevention. 2022;21(2):60–71. doi: 10.15829/1728-8800-2022-3164

[46] Gautier SV, Khomyakov SM. Planning of remote consultations with the use of telemedicine technologies on the profile “transplantation”. Russian Journal of Transplantology and Artificial Organs. 2019;21(S):9–10. (In Russ).

[47] Готье С.В., Хомяков С.М. Планирование дистанционных консультаций с применением телемедицинских технологий по профилю «трансплантация» // Вестник трансплантологии и искусственных органов. 2019. Т. 21, № S. С. 9–10.

[48] Gautier SV, Khomyakov SM. Planning of remote consultations with the use of telemedicine technologies on the profile “transplantation”. Russian Journal of Transplantology and Artificial Organs. 2019;21(S):9–10. (In Russ).

[49] Pyregov AV, Kholin AM, Yurova MV, Khamo AA. Analysis of the effectiveness of telemedicine consultations in obstetrics in the profile “Anesthesiology and resuscitation” on the example of two-year experience of the National Research Center. Akusherstvo i ginekologiya. 2020(1):155–162. (In Russ). doi: 10.18565/aig.2020.1.155-162

[50] Пырегов А.В., Холин А.М., Юрова М.В., Хамо А.А. Анализ эффективности телемедицинских консультаций в акушерстве по профилю «Анестезиология и реаниматология» на примере двухлетнего опыта Национального исследовательского центра // Акушерство и гинекология. 2020. № 1. С. 155–162. doi: 10.18565/aig.2020.1.155-162

[51] Pyregov AV, Kholin AM, Yurova MV, Khamo AA. Analysis of the effectiveness of telemedicine consultations in obstetrics in the profile “Anesthesiology and resuscitation” on the example of two-year experience of the National Research Center. Akusherstvo i ginekologiya. 2020(1):155–162. (In Russ). doi: 10.18565/aig.2020.1.155-162

[52] Sukhikh GT, Shuvalova MP, Kan NE, Prialukhin IA. The role of the National Medical Research Center in the quality and safety of maternity services in the regions of the Russian Federation. Vestnik Roszdravnadzora. 2023;(1):20–27.

[53] Сухих Г.Т., Шувалова М.П., Кан Н.Е., Прялухин И.А. Роль национального медицинского исследовательского центра в обеспечении качества и безопасности медицинской деятельности службы родовспоможения в субъектах Российской Федерации // Вестник Росздравнадзора. 2023. № 1. С. 20–27.

[54] Sukhikh GT, Shuvalova MP, Kan NE, Prialukhin IA. The role of the National Medical Research Center in the quality and safety of maternity services in the regions of the Russian Federation. Vestnik Roszdravnadzora. 2023;(1):20–27.

[55] Alekseeva NYu, Rudenko NYu, Syagaev RA. Analysis of the use of telemedicine technologies in the provision of medical care to the pediatric population of the Irkutsk region. Sistema menedzhmenta kachestva: opyt i perspektivy. 2022;(11):266–269. (In Russ).

[56] Алексеева Н.Ю., Руденко Н.Ю., Сягаев Р.А. Анализ применения телемедицинских технологий при оказании медицинской помощи детскому населению Иркутской области // Система менеджмента качества: опыт и перспективы. 2022. № 11. С. 266–269.

[57] Alekseeva NYu, Rudenko NYu, Syagaev RA. Analysis of the use of telemedicine technologies in the provision of medical care to the pediatric population of the Irkutsk region. Sistema menedzhmenta kachestva: opyt i perspektivy. 2022;(11):266–269. (In Russ).

[58] Gorshkov MK, Sheregi FE. Applied Sociology: Methodology and Methods. Moscow: Al’fa-M: INFRA-M; 2009. (In Russ).

[59] Горшков М.К., Шереги Ф.Э. Прикладная социология: методология и методы. Москва : Альфа-М: ИНФРА-М, 2009.

[60] Gorshkov MK, Sheregi FE. Applied Sociology: Methodology and Methods. Moscow: Al’fa-M: INFRA-M; 2009. (In Russ).

[61] Willerman B. The adaptation and use of Kendall’s coefficient of concordance (W) to sociometric-type rankings. Psychol Bull. 1955;52(2):132–133. doi: 10.1037/h0041665

[62] Willerman B. The adaptation and use of Kendall’s coefficient of concordance (W) to sociometric-type rankings // Psychol Bull. 1995. Vol. 52, N 2. P. 132–133. doi: 10.1037/h0041665

[63] Willerman B. The adaptation and use of Kendall’s coefficient of concordance (W) to sociometric-type rankings. Psychol Bull. 1955;52(2):132–133. doi: 10.1037/h0041665

[64] Khanal S, Burgon J, Leonard S, et al. Recommendations for the Improved Effectiveness and Reporting of Telemedicine Programs in Developing Countries: Results of a Systematic Literature Review. Telemedicine journal and e-health. 2015;21(11):903–915. doi: 10.1089/tmj.2014.0194

[65] Khanal S., Burgon J., Leonard S., et al. Recommendations for the Improved Effectiveness and Reporting of Telemedicine Programs in Developing Countries: Results of a Systematic Literature Review // Telemedicine journal and e-health. 2015. Vol. 21, N 11. P. 903–915. doi: 10.1089/tmj.2014.0194

[66] Khanal S, Burgon J, Leonard S, et al. Recommendations for the Improved Effectiveness and Reporting of Telemedicine Programs in Developing Countries: Results of a Systematic Literature Review. Telemedicine journal and e-health. 2015;21(11):903–915. doi: 10.1089/tmj.2014.0194

[67] Alami H, Gagnon MP, Wootton R, Fortin JP, Zanaboni P. Exploring factors associated with the uneven utilization of telemedicine in Norway: a mixed methods study. BMC medical informatics and decision making. 2017;17(1):180. doi: 10.1186/s12911-017-0576-4

[68] Alami H., Gagnon M.P., Wootton R., Fortin J.P., Zanaboni P. Exploring factors associated with the uneven utilization of telemedicine in Norway: a mixed methods study // BMC medical informatics and decision making. 2017. Vol. 17, N 1. P. 180. doi: 10.1186/s12911-017-0576-4

[69] Alami H, Gagnon MP, Wootton R, Fortin JP, Zanaboni P. Exploring factors associated with the uneven utilization of telemedicine in Norway: a mixed methods study. BMC medical informatics and decision making. 2017;17(1):180. doi: 10.1186/s12911-017-0576-4

RIGHTS & PERMISSIONS

Eco-Vector