Functionality and feasibility of cognitive function training via mobile health application among youth at risk for psychosis

Abstract

Aim: Mobile health applications (MHAs) have been rapidly designed and urgently need evaluation. Existing evaluation methods, such as platform, development, and subjective overall user observations, are mostly based on application (app) design. This study aimed to evaluate the functionality and feasibility of an MHA to train cognitive function in youth at clinical high risk (CHR) for psychosis with a tool that allows a comprehensive user experience evaluation of mobile apps from multiple dimensions.

Methods: Eighty participants with CHR for psychosis were recruited and randomly assigned to the intervention and the group control. Participants in the intervention group used the Specific Memory Attention Resource and Training (SMART) app for three months. MHA’s functionality and feasibility were measured by the mobile app rating scale (MARS) and qualitative tools.

Results: Participants in the SMART group report that the form and design of this app are simple to operate, and the content is trustworthy. They reported improvement in cognitive function and more motivation to seek help to improve their cognitive function. They also pointed out areas of improvement.

Conclusions: SMART usability and functionality were measured by a multidimensional tool. It shows promise in improving CHR memory and attention and demonstrates appropriate usability and functionality.

Keywords

User interface design / mobile health application / serious games / mental health / user willingness

References

[1] Lindberg B, Nilsson C, Zotterman D, Söderberg S, Skär L. Using information and communication technology in home care for communication between patients, family members, and healthcare professionals: a systematic review. Int J Telemed Appl. 2013; 2013:461829.

[2] Lang A, Edwards N, Fleiszer A. Safety in home care: a broadened perspective of patient safety. Int J Qual Health Care. 2008; 20:130-5.

[3] The state of mobile internet connectivity report 2023 [Internet]. GSM Association; c2024 [cited 2023 Apr 5]. Available from:https://www.gsma.com/r/somic/

[4] Fernandez-Gonzalo S, Turon M, Jodar M, Pousa E, Hernandez Rambla C, García R, et al. A new computerized cognitive and social cognition training specifically designed for patients with schizophrenia/schizoaffective disorder in early stages of illness: a pilot study. Psychiatry Res. 2015; 228:501-9.

[5] Firth J, Cotter J, Torous J, Bucci S, Firth JA, Yung AR. Mobile phone ownership and endorsement of “mHealth” among people with psychosis: a meta-analysis of cross-sectional studies. Schizophr Bull. 2016; 42:448-55.

[6] Liu G, Henson P, Keshavan M, Pekka-Onnela J, Torous J. Assessing the potential of longitudinal smartphone based cognitive assessment in schizophrenia: a naturalistic pilot study. Schizophr Res Cogn. 2019; 17:100144.

[7] Number of smartphone users worldwide from 2013 to 2028 [Internet].Statista; c2024 [cited 2023 Feb 1]. Available from:https://www.statista.com/forecasts/1143723/smartphone-users-in-the-world

[8] Hooker CI, Carol EE, Eisenstein TJ, Yin H, Lincoln SH, Tully LM, et al. A pilot study of cognitive training in clinical high risk for psychosis: initial evidence of cognitive benefit. Schizophr Res. 2014; 157:314-6.

[9] Li H. Mental health literacy, stigma, and early intervention. Asian J Psychiatr. 2012; 5:209-10.

[10] Grist R, Porter J, Stallard P. Mental health mobile apps for preadolescents and adolescents: a systematic review. J Med Internet Res. 2017; 19:e176.

[11] Ahmed A, Ali N, Giannicchi A, Abd-alrazaq AA, Ahmed MAS, Aziz S, et al. Mobile applications for mental health self-care: a scoping review. Comput Methods Programs Biomed Update. 2021; 1:100041.

[12] Li H, Yang S, Chi H, Xu L, Zhang T, Singleton G, et al. Enhancing attention and memory of individuals at clinical high risk for psychosis with mHealth technology. Asian J Psychiatr. 2021; 58:102587.

[13] Schlosser DA, Campellone TR, Truong B, Etter K, Vergani S, Komaiko K, et al. Efficacy of PRIME, a mobile app intervention designed to improve motivation in young people with schizophrenia. Schizophr Bull. 2018; 44:1010-20.

[14] Eisner E, Bucci S, Berry N, Emsley R, Barrowclough C, Drake RJ. Feasibility of using a smartphone app to assess early signs, basic symptoms and psychotic symptoms over six months: a preliminary report. Schizophr Res. 2019; 208:105-13.

[15] Akin-Sari B, Inozu M, Haciomeroglu AB, Trak E, Tufan D, Doron G. Cognitive training using a mobile app as a coping tool against COVID-19 distress: a crossover randomized controlled trial. J Affect Disord. 2022; 311:604-13.

[16] Vaidyam A, Halamka J, Torous J. Enabling research and clinical use of patient-generated health data (the mindlamp platform): digital phenotyping study. JMIR Mhealth Uhealth. 2022; 10:e30557.

[17] Kwon S, Firth J, Joshi D, Torous J. Accessibility and availability of smartphone apps for schizophrenia. Schizophrenia (Heidelb). 2022; 8:98.

[18] Ventola CL. Mobile devices and apps for health care professionals: uses and benefits. P T. 2014; 39:356-64.

[19] Mackey R, Gleason A, Ciulla R. : development study. JMIR Mhealth Uhealth. 2022; 10:e32643.

[20] Jake-Schoffman DE, Silfee VJ, Waring ME, Boudreaux ED, Sadasivam RS, Mullen SP, et al. Methods for evaluating the content, usability, and efficacy of commercial mobile health apps. JMIR Mhealth Uhealth. 2017; 5:e190.

[21] Kelly PJ, Beck AK, Deane FP, Larance B, Baker AL, Hides L, et al. Feasibility of a mobile health app for routine outcome monitoring and feedback in SMART recovery mutual support groups: stage 1 mixed methods pilot study. J Med Internet Res. 2021; 23:e25217.

[22] Ragheb SM, Chudyk A, Kent D, Dave MG, Hiebert B, Schultz ASH, et al. Use of a mobile health application by adult non-congenital cardiac surgery patients: a feasibility study. PLOS Digit Health. 2022; 1:e0000055.

[23] Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the mobile application rating scale (uMARS). JMIR Mhealth Uhealth. 2016; 4:e72.

[24] Ahram T, Karwowski W. Human systems integration modeling using systems modeling language. Proc Hum Factors Ergon Soc Annu Meet. 2009; 53:1849- 53.

[25] Kalinich M, Ebrahim S, Hays R, Melcher J, Vaidyam A, Torous J. Applying machine learning to smartphone based cognitive and sleep assessments in schizophrenia. Schizophr Res Cogn. 2022; 27:100216.

[26] IBM. IBM SPSS statistics. Version 26.0 [software]. 2019 Feb 22 [cited 2023 Jul 21]. Available from:https://www.ibm.com/products/spss-statistics

[27] Deniz-Garcia A, Fabelo H, Rodriguez-Almeida AJ, Zamora-Zamorano G, Castro-Fernandez M, Alberiche Ruano MDP, et al. ; WARIFA Consortium. Quality, usability, and effectiveness of mhealth apps and the role of artificial intelligence: current scenario and challenges. J Med Internet Res. 2023; 25:e44030.

[28] Wu P, Zhang R, Zhu X, Liu M. Factors influencing continued usage behavior on mobile health applications. Healthcare (Basel). 2022; 10:208.

[29] Zhang J, Gai M, Ignatov AV, Dyakov SA, Wang J, Gippius NA, et al. Stimuli-responsive microarray films for real-time sensing of surrounding media, temperature, and solution properties via diffraction patterns. ACS Appl Mater Interfaces. 2020; 12:19080-91.

[30] Gusev NA, Vetoshko PM, Kuzmichev AN, Chepurnova DA, Samoilova EV, Zvezdin AK, et al. Ultra-sensitive vector magnetometer for magnetocardiographic mapping. Biomed Eng. 2017; 51:157-61.

[31] Sternickel K, Braginski AI. Biomagnetism using SQUIDs: status and perspectives. Supercond Sci Technol. 2006; 19:S160.

[32] Papageorgiou A, Strigkos M, Politou E, Alepis E, Solanas A, Patsakis C. Security and privacy analysis of mobile health applications: the alarming state of practice. IEEE Access. 2018; 6:9390-403.

[33] Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Privacy and security in mobile health apps: a review and recommendations. J Med Syst. 2015; 39:181.

[34] Fan S, Jain RC, Kankanhalli MS. A comprehensive picture of factors affecting user willingness to use mobile health applications. arXiv:2305.05962v1 [Preprint].2023 [cited 2023 Sep 19]. Available from:https://doi.org/10.48550/arXiv.2305.05962