Reliability and Validity of the Canadian Agility and Movement Skill Assessment when Assessed in Real-Time: A Study in Primary and Secondary Children

Abstract

Purpose

This study aimed at identifying the reliability and validity of the Canadian Agility and Movement Skill Assessment (CAMSA), when assessed in real-time.

Method

A sample of 70 primary and 356 secondary students participated voluntarily. Anthropometric variables, CAMSA, 10 × 5-m shuttle run test and 10 × 4-m shuttle run test results of all participants were analysed.

Results

Higher internal consistency values were observed among secondary children (α: 0.737–0.864) compared to primary students (α: 0.360–0.762). Absolute and relative reliability values were in general low, with only the CAMSA-S demonstrating fair reliability (ICC: 0.717). A fair significant association between CAMSA-S and agility measured by the 10 × 4-m and 10 × 5-m shuttle tests (Rho = 0.422) was found. This association was moderate in primary students (Rho = 0.649) and fair in secondary students (Rho = 0.382). A fair association with the time component of CAMSA (Rho = 0.402), and a weaker fair association with the skill component (Rho = 0.260) was observed.

Conclusion

The CAMSA demonstrated low test-retest reliability and fair validity when assessed in real-time, in a sample of primary and secondary children.

Keywords

Adolescent / Child / Exercise / Physical Fitness / Testing

References

[1] Adam C, Klissouras M, Ravazollo R, Renson W, Tuxworth WEUROFIT: European test of physical fitness, 1988Rome, ItalyCouncil of Europe, Committee for the Development of Sport

[2] Ayán Pérez C, Álvarez Pérez S, González Baamonde S, de Martínez Ó. Influence of the Box dimensions on the reliability and validity of the Sit and Reach in preschoolers. J Strength Conditioning Res, 2020, 34(9): 2683-92

[3] Brand C, Sehn AP, Lemes VB, Todendi PF, Valim ARM, Reuter CP. Genetic predisposition to obesity among adolescents: the moderator role of agility and speed. Sci Sports, 2024, 39(3): 267-73

[4] Canadian Assessment of Physical Literacy. Literacy manual for test administration. Healthy Active Living and Obesity Research group. 2nd ed. 2017. https://www.activehealthykids.org/wp-content/uploads/2022/04/capl-2-manual-en.pdf.

[5] Cao Y, Zhang C, Guo R, Zhang D, Wang S. Performances of the Canadian agility and Movement Skill Assessment (CAMSA), and validity of timing components in comparison with three commonly used agility tests in Chinese boys: an exploratory study. PeerJ. 2020;8:e8784. https://doi.org/10.7717/peerj.8784.

[6] Chang J, Yong L, Yan H, Wang J, Song N. Measurement Properties of Canadian Agility and Movement Skill Assessment for Children Aged 9–12 years using Rasch Analysis. Front Public Health, 2021, 9(December): 1-10

[7] Colley RC, Clarke J, Doyon CY, Janssen I, Lang JJ, Timmons BW, Tremblay MS. Trends in physical fitness among Canadian children and youth. Health Rep, 2019, 30(10): 3-13

[8] Corbin CB, Pangrazi RP, Franks BD. Definitions: Health, Fitness, and physical activity. President’s Council Phys Fit Sports Res Digest, 2000, 3: 1-11

[9] Cossio-Bolaños M, Vidal- Espinoza R, Albornoz CU, Fuentes-Lopez J, Sánchez-Macedo L, Andruske CL, Sulla-Torres J, Campos RG. Relationship between the body mass index and the ponderal index with physical fitness in adolescent students. BMC Pediatr, 2022, 22(1): 1-9

[10] Dania A, Kaioglou V, Venetsanou F. Validation of the Canadian Assessment of physical literacy for Greek children: understanding assessment in response to culture and pedagogy. Eur Phys Educ Rev, 2020, 26(4): 1-17

[11] Dewar R, Claus AP, Tucker K, Ware R, Johnston LM. Reproducibility of the balance evaluation systems Test (BESTest) and the Mini-BESTest in school-aged children. Gait Posture, 2017, 55(April): 68-74

[12] Draper N, Jusary R, Marshall H. The validity and reliability of video assessment for the Dragon Challenge. Int J Spa Wellness, 2019, 2(3): 154-65

[13] Elsborg P, Melby PS, Kurtzhals M, Tremblay MS, Nielsen G, Bentsen P. Translation and validation of the Canadian assessment of physical literacy-2 in a Danish sample. BMC Public Health, 2021, 21(1): 1-9

[14] Fernandez Santos J, Ruiz J, Gonzalez-Montesinos J, Castro-Piñero J. Reliability and validity of field-based tests to assess upper-body muscular strength in children aged 6–12 years. Pediatr Exerc Sci, 2016, 28(2): 331-40

[15] Fiori F, Bravo G, Parpinel M, Messina G, Malavolta R, Lazzer S. Relationship between body mass index and physical fitness in Italian prepubertal schoolchildren. PLoS ONE, 2020, 15(5): 1-16

[16] Flansbjer UB, Holmbäck AM, Downham D, Patten C, Lexell J. Reliability of gait performance tests in men and women with hemiparesis after stroke. J Rehabil Med, 2005, 37(2): 75-82

[17] Gentier I, Augustijn M, Deforche B, Tanghe A, De Bourdeaudhuij I, Lenoir M, D’Hondt E. A comparative study of performance in simple and choice reaction time tasks between obese and healthy-weight children. Res Dev Disabil, 2013, 34(9): 2635-41

[18] Giuriato M, Codella R, Lovecchio N, Pellino C, Vandoni V, Nevill AM. Speed agility trends in children according to growth: a new approach to evaluate speed agility in children. Ann Hum Biol, 2021, 48(4): 271-9

[19] Haynes J, Miller J. Preparing pre-service primary school teachers to assess fundamental motor skills: two skills and two approaches. Phys Educ Sport Pedagogy, 2015, 20(4): 397-408

[20] Iglesias-Soler E, Rúa-Alonso M, Rial-Vázquez J, Lete-Lasa JR, Clavel I, Giráldez-García MA, Rico-Díaz J, Corral MR, Del, Carballeira-Fernández E, Dopico-Calvo X. Percentiles and principal component analysis of physical fitness from a big sample of children and adolescents aged 6–18 years: the DAFIS Project. Front Psychol. 2021;12:627834. https://doi.org/10.3389/fpsyg.2021.627834.

[21] Lander N, Morgan PJ, Salmon J, Logan SW, Barnett LM. The reliability and validity of an authentic motor skill assessment tool for early adolescent girls in an Australian school setting. J Sci Med Sport, 2017, 20(6): 590-4

[22] Lloyd RS, Read P, Oliver JL, Meyers RW, Nimphius S, Jeffreys I. Considerations for the development of agility during childhood and adolescence. Strength Conditioning J, 2013, 35(3): 2-11

[23] Longmuir PE, Boyer C, Lloyd M, Borghese MM, Knight E, Saunders TJ, Boiarskaia E, Zhu W, Tremblay MS. Canadian agility and Movement Skill Assessment (CAMSA): validity, objectivity, and reliability evidence for children 8–12 years of age. J Sport Health Sci, 2017, 6(2): 231-40

[24] Marston L. Introductory Statistics for Health and nursing using SPSS. Los Angeles: SAGE Publications Ltd; 2010.

[25] Martins C, Romo-Perez V, Webster EK, Duncan M, Lemos LF, Staiano AE, Okely A, Magistro D, Carlevaro F, Bardid F, Magno F, Nobre G, Estevan I, Mota J, Ning K, Robinson LE, Lenoir M, Quan M, Valentini NC, Barnett LM. Motor competence and body Mass Index in the Preschool years: a pooled cross-sectional analysis of 5545 children from eight countries. Sports Med, 2024, 54(2): 505-16

[26] Mello JB, Rodríguez-Rodríguez F, Gracia-Marco L, Teodoro JL, Gaya AR, Gaya ACA. Speed, agility, and musculoskeletal fitness are independently associated with areal bone mineral density in children. Front Physiol, 2023, 14(February): 1-8

[27] Menescardi C, Villarrasa-Sapiña I, Lander N, Estevan I. Canadian Agility Movement Skill Assessment (CAMSA) in a Spanish context: evidences of reliability and validity. Meas Phys Educ Exerc Sci, 2022, 26(3): 245-55

[28] Niewiadomska M, Radziejewska M, Horodnicka-Józwa A, Petriczko E. Agility in treatment of children with type 1 diabetes-pilot study. Pediatr Endocrinol Diabetes Metabolism, 2010, 16(2): 89-93

[29] Opstoel K, Pion J, Elferink-Gemser M, Hartman E, Willemse B, Philippaerts R, Visscher C, Lenoir M. Anthropometric characteristics, physical fitness and motor coordination of 9 to 11 year old children participating in a wide range of sports. PLoS ONE, 2015, 10(5): 1-16

[30] Ortega FB, Artero EG, Ruiz JR, España-Romero V, Jiménez-Pavón D, Vicente-Rodriguez G, Moreno LA, Manios Y, Béghin L, Ottevaere C, Ciarapica D, Sarri K, Dietrich S, Blair SN, Kersting M, Molnar D, González-Gross M, Gutiérrez Á, Sjöström M, Castillo MJ. Physical fitness levels among European adolescents: the HELENA study. Br J Sports Med, 2011, 45(1): 20-9

[31] Ortega FB, Leskošek B, Blagus R, Gil-Cosano JJ, Mäestu J, Tomkinson GR, Ruiz JR, Mäestu E, Starc G, Milanovic I, Tammelin TH, Sorić M, Scheuer C, Carraro A, Kaj M, Csányi T, Sardinha LB, Lenoir M, Emeljanovas A, Jurak G. European fitness landscape for children and adolescents: updated reference values, fitness maps and country rankings based on nearly 8 million test results from 34 countries gathered by the FitBack network. Br J Sports Med, 2023, 57(5): 299-310

[32] Portney LG, Watkins MPart IV Data Analysis: correlation. Foundations of Clinical Research. Applications to practice, 20002Upper Saddle RiverPrentice Hall Health

[33] Rey E, Carballo-Fazanes A, Varela-Casal C, Abelairas-Gómez C. Reliability of the test of gross motor development: a systematic review. PLoS ONE, 2020, 15(7 July): 1-26

[34] Rintala P, Sääkslahti A, Iivonen S. Reliability Assessment of scores from Video-recorded TGMD-3 performances. J Motor Learn Dev, 2017, 5(1): 59-68

[35] Rogers D, McKeown I, Parfitt G, Burgess D, Eston RG. Inter- and intra-rater reliability of the athletic ability assessment in Subelite Australian rules football players. J Strength Conditioning Res. 2019;33(1):125–38.

[36] Shi P, Feng X. Motor skills and cognitive benefits in children and adolescents: relationship, mechanism and perspectives. Front Psychol, 2022, 13(November): 1-14

[37] Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull, 1979, 86(2): 420-8

[38] Stearns J, Wohlers B, McHugh T, Kuzik N. Reliability and validity of the PLAY fun tool with children and youth in Northern Canada. Meas Phys Educ Exerc Sci, 2019, 1: 47-57

[39] Tomkinson GR, Carver KD, Atkinson F, Daniell ND, Lewis LK, Fitzgerald JS, Lang JJ, Ortega FB. European normative values for physical fitness in children and adolescents aged 9–17 years: results from 2 779 165 eurofit performances representing 30 countries. Br J Sports Med, 2018, 52(22): 1445-56

[40] Tomkinson GR, Lang JJ, Blanchard J, Léger LA, Tremblay MS. The 20-m shuttle run: Assessment and interpretation of data in relation to youth aerobic fitness and health. Pediatr Exerc Sci, 2019, 31(2): 152-63

[41] Vicente-Rodríguez G, Rey-López JP, Ruíz JR, Jiménez-Pavón D, Bergman P, Ciarapica D, Heredia JM, Molnar D, Gutierrez A, Moreno LA, Ortega FB. Interrater reliability and time measurement validity of speed–agility field tests in adolescents. J Strength Conditioning Res, 2011, 25(7): 2059-63

[42] Ward B, Thornton A, Lay B, Chen N, Rosenberg M. Can proficiency criteria be accirately identified during real-time fundamental movement skill assessment. Res Q Exerc Sport. 2019;91(1):64–72. https://doi.org/10.1080/02701367.2019.1646852

RIGHTS & PERMISSIONS

Beijing Sport University