Development of an evaluation index system for the quality of clinical practice education in Master of Nursing Specialist Programs

Abstract

Objective To establish an evaluation framework for clinical practice teaching quality in Master of Nursing Science (MNS) programs, providing an assessment tool for cultivating high-level nursing professionals.

Methods Through literature review, semi-structured interviews, and two rounds of expert consultation, the ordinal ranking method was employed to calculate indicator weights.

Results A final framework comprising 4 primary indicators, 13 secondary indicators, and 42 tertiary indicators was established, covering practice base structure and resources, teaching process and management, teaching effectiveness and evaluation, and feedback and improvement. Expert scoring indicated mean indicator importance > 4.0, coefficient of variation < 0.25, expert authority coefficient of 0.84, and statistically significant increases in Kendall's W value across rounds (p <.05), demonstrating the system's scientific rigor and stability.

Conclusions This evaluation system is comprehensive in content and well-structured. It provides a quantitative basis for assessing the quality of clinical practice teaching, facilitating instructional improvements, and fostering competency development among MNS graduate students. It also serves as a reference for reforming domestic nursing graduate education and cultivating high-level talent.

Keywords

Clinical practice / Delphi / Master of nursing / Teaching evaluation indicators / Teaching quality

References

[1] Abu-Qamar MZ, Vafeas C, Ewens B, et al. Postgraduate nurse education and the implications for nurse and patient outcomes: A systematic review. Nurse Educ Today. 2020; 92: 104489. PMid:32653811 https://doi.org/10.1016/j.nedt.2020.104489

[2] Zou H, Li Z, Arthur D.Graduate nursing education in China. Nurs Outlook. 2012; 60(3): 116-20, 20.e1. PMid:21684563 https://doi.org/10.1016/j.outlook.2011.04.001

[3] Li S, Wei Z, Shang S, et al. Current situation and development suggestions for the cultivation of master of nursing specialist students. Chin J Nurs Educ. 2024; 21(8): 962-968.

[4] Huang BY. New Era for the Development of Professional Degree Graduate Education. Acad Degrees Grad Educ. 2010; 10: 1-7.

[5] Ministry of Education of the People’s Republic of China. Notice on issuing the schemes for setting up 19 professional degree programs including the Master of Nursing[Internet]. Beijing: Ministry of Education of the People’s Republic of China; 2010 May 13 [cited 2026 Jan 13]. Available from: http://www.moe.gov.cn/srcsite/A22/moe_833/201005/t20100513_92739.html

[6] Xu H, Dong C, Yang Y, et al. Developing a professional competence framework for the master of nursing specialist degree program in China: A modified Delphi study. Nurse Educ Today. 2022; 118: 105524. PMid:36084450 https://doi.org/10.1016/j.nedt.2022.105524

[7] Billett S. Practice-based learning and professional education:pursuing quality outcomes and sustainability[Internet]. In: Practice-based education: perspectives and strategies. Rotterdam: Sense Publishers; 2012 [cited 2026 Jan 13]. p. 101-112. https://doi.org/10.1007/978-94-6209-128-3_8

[8] Li Y, Jiao J, Zhu C, et al. Review on the research progress of clinical training on Master of Nursing Specialist in China. Chin Nurs Manag. 2019; 19(11): 1673-1677.

[9] Ministry of Education of the People’s Republic of China; National Health Commission of the People’s Republic of China. Notice on carrying out the construction of national clinical teaching and training demonstration centers. Beijing: Ministry of Education of the People’s Republic of China; 2018 May 2 [cited 2026 Jan 13]. Available from: http://www.moe.gov.cn/srcsite/A08/moe_740/s3864/201805/t20180509_335476.html

[10] General Office of the State Council of the People’s Republic of China. Guiding opinions on accelerating innovation in medical education development. Beijing: State Council of the People’s Republic of China; 2020 Sep 17 [cited 2026 Jan 13]. Available from: http://www.moe.gov.cn/jyb_xxgk/moe_1777/moe_1778/202009/t20200923_490164.html

[11] Li P, Yang L, Wu B, et al. Status quo and countermeasures of graduate education of nursing master degree in China. Chin Nurs Res. 2017; 31(21): 2568-2572.

[12] Luo C, Sun J, Jia J, et al. Survey of clinical practice status quo of master degree in nursing students. Chin Nurs Res. 2018; 32(2): 289-292.

[13] Zhang G. Construction and improvement of internal control evaluation system of state-owned enterprises. Enterp Reform Manag. 2019; (9): 14-20.

[14] Yang J, Fan W, Ren L, et al. Study on the evaluation index system and training method of master of nursing specialists graduate students’ clinical practice ability. J Med Health Sci. 2023; 1(4): 35-44. https://doi.org/10.62517/jmhs.202305409

[15] Zeng J. Research on clinical practice training model of master of nursing specialist degree [dissertation]. Chongqing: Third Military Medical University; 2014.

[16] Chen J, Zhou Y, Cheng L, et al. The current status and enlightenment of education for cultivation in the Master of Nursing Specialist program in Australia. J Nurs Sci. 2024; 39(5): 70-74.

[17] Wheeler KJ, Miller M, Pulcini J, et al. Advanced Practice Nursing Roles, Regulation, Education, and Practice: A Global Study. Ann Glob Health. 2022; 88(1): 42. PMid:35755314 https://doi.org/10.5334/aogh.3698

[18] Li M, Zhou L, Gu S. The current jointing status of Master of Nursing Specialist education and the professional qualification in USA. Chin Nurs Manag. 2013; 13(6): 48-51.

[19] Li M, Zhou L, Gu S. Comparative Research on the Relationship between the Education of the Master of Science in Nursing and the Licensing System of Nursing in United States,Australia and United Kingdom. Mil Nurs J Chin PLA. 2013; 30(9): 1-4, 22.

[20] Ellis P, Halstead J. Understanding the Commission on Collegiate Nursing Education Accreditation Process and the Role of the Continuous Improvement Progress Report. Journal of Professional Nursing. 2012; 28(1): 18-26. PMid:22261601 https://doi.org/10.1016/j.profnurs.2011.10.004

[21] Commission on Collegiate Nursing Education. Standards for Accreditation of Baccalaureate and Graduate Nursing Programs: Amended 2024 [Internet]. Washington (DC): Commission on Collegiate Nursing Education; 2024 [cited 2026 Jan 13]. Available from: https://www.aacnnursing.org/Portals/0/PDFs/CCNE/CCNE-Education-Standards-2024.pdf

[22] Wit RF, de Veer AJE, Batenburg RS, et al. International comparison of professional competency frameworks for nurses: a document analysis. BMC Nurs. 2023; 22(1): 343. PMid:37770894 https://doi.org/10.1186/s12912-023-01514-3

[23] Billings DM, Halstead JA. Teaching in nursing:a guide for faculty[Internet]. 7th ed. Philadelphia (PA): Elsevier; 2023 [cited 2026 Jan 13]. Available from: https://shop.elsevier.com/books/teaching-in-nursing/billings/978-0-323-84668-4

[24] Miller CL. The work, preparation and development of nursing clinical teachers[Internet]. Melbourne (VIC): Victoria University; 2012. Doctor of Education thesis [cited 2026 Jan 13]. Available from: https://vuir.vu.edu.au/25824/1/Clive%20Leslie%20Miller.pdf

[25] Wei J, Fang X, Qiao J, et al. Construction on teaching quality evaluation indicator system of multi-disciplinary team (MDT) clinical nursing practice in China: A Delphi study. Nurse Educ Pract. 2022; 64: 103452. PMid:36152471 https://doi.org/10.1016/j.nepr.2022.103452

[26] Cant R, Gazula S, Ryan C. Predictors of nursing student satisfaction as a key quality indicator of tertiary students’ education experience: An integrative review. Nurse Educ Today. 2023; 126: 105806. PMid:37060777 https://doi.org/10.1016/j.nedt.2023.105806

[27] Shen L, Yang J, Jin X, et al. Based on Delphi method and Analytic Hierarchy Process to construct the Evaluation Index system of nursing simulation teaching quality. Nurse Educ Today. 2019; 79: 67-73. PMid:31103843 https://doi.org/10.1016/j.nedt.2018.09021

[28] Wang Q, Wang J, Xu G, et al. Construction of evaluation index system of nursing undergraduate clinical practice teaching quality. Chin Gen Pract. 2023; 21(6): 1044-1047.

[29] Yang L, Wu Y, Zhou C, et al. Construction of evaluation index system for clinical practice effect of Master of Nursing Specialist students. J Nurs. 2023; 30(3): 40-44.

[30] Hu L, Wang Q, Song Y, et al. Construction of hierarchical evaluation index system of TCM nursing talents based on Delphi method. Chin Nurs Res. 2021; 35(1): 7-14.

[31] Qu J, Zhu Y, Qu B. The Delphi method and its application in medical education research. Chin J Med Educ. 2019; 39(3): 227-230.

[32] Nie S, Wang L. Constructing an evaluation index system for clinical nursing practice teaching quality using a Delphi method and analytic hierarchy process-based approach. BMC Med Educ. 2024; 24(1): 772. PMid:39030603 https://doi.org/10.1186/s12909-024-05770-y

[33] Guo Y, Li X, Li J, et al. Construction of admission and competency evaluation index system for mentors of master of nursing specialist. Chin J Nurs Educ. 2021; 18(8): 695-700.

[34] Cheng D, Shang L. Qualitative study on role expectation of clinical practice tutors of nursing postgraduates. Chin Nurs Res. 2021; 35(22): 4106-4109.

[35] Sun H. Study on the Evaluation Index system of clinical practice process assessment for Master of Nursing Specialist postgraduates [master’s thesis]. Taiyuan: Shanxi Medical University; 2020.

[36] Chen L, Wang X, Cai X, et al. Study on the Status and Influencing Factors of Clinical Abilities of Graduates of Master of Nursing Specialist. Health Vocat Educ. 2024; 42(9): 89-92.

[37] Yu Y, Luo H, Wang Z, et al. Construction of clinical practice ability evaluation index for master of nursing specialist graduate students of integrated traditional Chinese and western medicine. China Mod Med. 2023; 30(28): 135-138.

[38] Kim SM, Kim JH, Kwak JM. Psychometric Properties of the Korean Version of the Nursing Profession Self-Efficacy Scale. J Nurs Res. 2022; 30(2): e197. PMid:35323133 https://doi.org/10.1097/jnr.0000000000000481

[39] Tang X, Zhou Y, Tan Y, et al. Construction of the evaluation index system of clinical practice competencies for master of science in advanced practice nursing. Chin Nurs Manag. 2013; 13(9): 42-45.