Reliability and Validity of the Canadian Agility and Movement Skill Assessment when Assessed in Real-Time: A Study in Primary and Secondary Children

Abstract

Purpose

This study aimed at identifying the reliability and validity of the Canadian Agility and Movement Skill Assessment (CAMSA), when assessed in real-time.

Method

A sample of 70 primary and 356 secondary students participated voluntarily. Anthropometric variables, CAMSA, 10 × 5-m shuttle run test and 10 × 4-m shuttle run test results of all participants were analysed.

Results

Higher internal consistency values were observed among secondary children (α: 0.737–0.864) compared to primary students (α: 0.360–0.762). Absolute and relative reliability values were in general low, with only the CAMSA-S demonstrating fair reliability (ICC: 0.717). A fair significant association between CAMSA-S and agility measured by the 10 × 4-m and 10 × 5-m shuttle tests (Rho = 0.422) was found. This association was moderate in primary students (Rho = 0.649) and fair in secondary students (Rho = 0.382). A fair association with the time component of CAMSA (Rho = 0.402), and a weaker fair association with the skill component (Rho = 0.260) was observed.

Conclusion

The CAMSA demonstrated low test-retest reliability and fair validity when assessed in real-time, in a sample of primary and secondary children.

References

[1] AdamC, KlissourasM, RavazolloR, RensonW, TuxworthW. EUROFIT: European test of physical fitness, 1988 Rome, Italy Council of Europe, Committee for the Development of Sport

[2] Ayán PérezC, Álvarez PérezS, González BaamondeS, de MartínezÓ. Influence of the Box dimensions on the reliability and validity of the Sit and Reach in preschoolers. J Strength Conditioning Res, 2020, 34(9): 2683-92

[3] BrandC, SehnAP, LemesVB, TodendiPF, ValimARM, ReuterCP. Genetic predisposition to obesity among adolescents: the moderator role of agility and speed. Sci Sports, 2024, 39(3): 267-73

[4] Canadian Assessment of Physical Literacy. Literacy manual for test administration. Healthy Active Living and Obesity Research group. 2nd ed. 2017. https://www.activehealthykids.org/wp-content/uploads/2022/04/capl-2-manual-en.pdf.

[5] Cao Y, Zhang C, Guo R, Zhang D, Wang S. Performances of the Canadian agility and Movement Skill Assessment (CAMSA), and validity of timing components in comparison with three commonly used agility tests in Chinese boys: an exploratory study. PeerJ. 2020;8:e8784. https://doi.org/10.7717/peerj.8784.

[6] ChangJ, YongL, YanH, WangJ, SongN. Measurement Properties of Canadian Agility and Movement Skill Assessment for Children Aged 9–12 years using Rasch Analysis. Front Public Health, 2021, 9(December): 1-10

[7] ColleyRC, ClarkeJ, DoyonCY, JanssenI, LangJJ, TimmonsBW, TremblayMS. Trends in physical fitness among Canadian children and youth. Health Rep, 2019, 30(10): 3-13

[8] CorbinCB, PangraziRP, FranksBD. Definitions: Health, Fitness, and physical activity. President’s Council Phys Fit Sports Res Digest, 2000, 3: 1-11

[9] Cossio-BolañosM, Vidal- EspinozaR, AlbornozCU, Fuentes-LopezJ, Sánchez-MacedoL, AndruskeCL, Sulla-TorresJ, CamposRG. Relationship between the body mass index and the ponderal index with physical fitness in adolescent students. BMC Pediatr, 2022, 22(1): 1-9

[10] DaniaA, KaioglouV, VenetsanouF. Validation of the Canadian Assessment of physical literacy for Greek children: understanding assessment in response to culture and pedagogy. Eur Phys Educ Rev, 2020, 26(4): 1-17

[11] DewarR, ClausAP, TuckerK, WareR, JohnstonLM. Reproducibility of the balance evaluation systems Test (BESTest) and the Mini-BESTest in school-aged children. Gait Posture, 2017, 55(April): 68-74

[12] DraperN, JusaryR, MarshallH. The validity and reliability of video assessment for the Dragon Challenge. Int J Spa Wellness, 2019, 2(3): 154-65

[13] ElsborgP, MelbyPS, KurtzhalsM, TremblayMS, NielsenG, BentsenP. Translation and validation of the Canadian assessment of physical literacy-2 in a Danish sample. BMC Public Health, 2021, 21(1): 1-9

[14] Fernandez SantosJ, RuizJ, Gonzalez-MontesinosJ, Castro-PiñeroJ. Reliability and validity of field-based tests to assess upper-body muscular strength in children aged 6–12 years. Pediatr Exerc Sci, 2016, 28(2): 331-40

[15] FioriF, BravoG, ParpinelM, MessinaG, MalavoltaR, LazzerS. Relationship between body mass index and physical fitness in Italian prepubertal schoolchildren. PLoS ONE, 2020, 15(5): 1-16

[16] FlansbjerUB, HolmbäckAM, DownhamD, PattenC, LexellJ. Reliability of gait performance tests in men and women with hemiparesis after stroke. J Rehabil Med, 2005, 37(2): 75-82

[17] GentierI, AugustijnM, DeforcheB, TangheA, De BourdeaudhuijI, LenoirM, D’HondtE. A comparative study of performance in simple and choice reaction time tasks between obese and healthy-weight children. Res Dev Disabil, 2013, 34(9): 2635-41

[18] GiuriatoM, CodellaR, LovecchioN, PellinoC, VandoniV, NevillAM. Speed agility trends in children according to growth: a new approach to evaluate speed agility in children. Ann Hum Biol, 2021, 48(4): 271-9

[19] HaynesJ, MillerJ. Preparing pre-service primary school teachers to assess fundamental motor skills: two skills and two approaches. Phys Educ Sport Pedagogy, 2015, 20(4): 397-408

[20] Iglesias-Soler E, Rúa-Alonso M, Rial-Vázquez J, Lete-Lasa JR, Clavel I, Giráldez-García MA, Rico-Díaz J, Corral MR, Del, Carballeira-Fernández E, Dopico-Calvo X. Percentiles and principal component analysis of physical fitness from a big sample of children and adolescents aged 6–18 years: the DAFIS Project. Front Psychol. 2021;12:627834. https://doi.org/10.3389/fpsyg.2021.627834.

[21] LanderN, MorganPJ, SalmonJ, LoganSW, BarnettLM. The reliability and validity of an authentic motor skill assessment tool for early adolescent girls in an Australian school setting. J Sci Med Sport, 2017, 20(6): 590-4

[22] LloydRS, ReadP, OliverJL, MeyersRW, NimphiusS, JeffreysI. Considerations for the development of agility during childhood and adolescence. Strength Conditioning J, 2013, 35(3): 2-11

[23] LongmuirPE, BoyerC, LloydM, BorgheseMM, KnightE, SaundersTJ, BoiarskaiaE, ZhuW, TremblayMS. Canadian agility and Movement Skill Assessment (CAMSA): validity, objectivity, and reliability evidence for children 8–12 years of age. J Sport Health Sci, 2017, 6(2): 231-40

[24] Marston L. Introductory Statistics for Health and nursing using SPSS. Los Angeles: SAGE Publications Ltd; 2010.

[25] MartinsC, Romo-PerezV, WebsterEK, DuncanM, LemosLF, StaianoAE, OkelyA, MagistroD, CarlevaroF, BardidF, MagnoF, NobreG, EstevanI, MotaJ, NingK, RobinsonLE, LenoirM, QuanM, ValentiniNC, BarnettLM. Motor competence and body Mass Index in the Preschool years: a pooled cross-sectional analysis of 5545 children from eight countries. Sports Med, 2024, 54(2): 505-16

[26] MelloJB, Rodríguez-RodríguezF, Gracia-MarcoL, TeodoroJL, GayaAR, GayaACA. Speed, agility, and musculoskeletal fitness are independently associated with areal bone mineral density in children. Front Physiol, 2023, 14(February): 1-8

[27] MenescardiC, Villarrasa-SapiñaI, LanderN, EstevanI. Canadian Agility Movement Skill Assessment (CAMSA) in a Spanish context: evidences of reliability and validity. Meas Phys Educ Exerc Sci, 2022, 26(3): 245-55

[28] NiewiadomskaM, RadziejewskaM, Horodnicka-JózwaA, PetriczkoE. Agility in treatment of children with type 1 diabetes-pilot study. Pediatr Endocrinol Diabetes Metabolism, 2010, 16(2): 89-93

[29] OpstoelK, PionJ, Elferink-GemserM, HartmanE, WillemseB, PhilippaertsR, VisscherC, LenoirM. Anthropometric characteristics, physical fitness and motor coordination of 9 to 11 year old children participating in a wide range of sports. PLoS ONE, 2015, 10(5): 1-16

[30] OrtegaFB, ArteroEG, RuizJR, España-RomeroV, Jiménez-PavónD, Vicente-RodriguezG, MorenoLA, ManiosY, BéghinL, OttevaereC, CiarapicaD, SarriK, DietrichS, BlairSN, KerstingM, MolnarD, González-GrossM, GutiérrezÁ, SjöströmM, CastilloMJ. Physical fitness levels among European adolescents: the HELENA study. Br J Sports Med, 2011, 45(1): 20-9

[31] OrtegaFB, LeskošekB, BlagusR, Gil-CosanoJJ, MäestuJ, TomkinsonGR, RuizJR, MäestuE, StarcG, MilanovicI, TammelinTH, SorićM, ScheuerC, CarraroA, KajM, CsányiT, SardinhaLB, LenoirM, EmeljanovasA, JurakG. European fitness landscape for children and adolescents: updated reference values, fitness maps and country rankings based on nearly 8 million test results from 34 countries gathered by the FitBack network. Br J Sports Med, 2023, 57(5): 299-310

[32] PortneyLG, WatkinsM. Part IV Data Analysis: correlation. Foundations of Clinical Research. Applications to practice, 2000 2 Upper Saddle River Prentice Hall Health

[33] ReyE, Carballo-FazanesA, Varela-CasalC, Abelairas-GómezC. Reliability of the test of gross motor development: a systematic review. PLoS ONE, 2020, 15(7 July): 1-26

[34] RintalaP, SääkslahtiA, IivonenS. Reliability Assessment of scores from Video-recorded TGMD-3 performances. J Motor Learn Dev, 2017, 5(1): 59-68

[35] Rogers D, McKeown I, Parfitt G, Burgess D, Eston RG. Inter- and intra-rater reliability of the athletic ability assessment in Subelite Australian rules football players. J Strength Conditioning Res. 2019;33(1):125–38.

[36] ShiP, FengX. Motor skills and cognitive benefits in children and adolescents: relationship, mechanism and perspectives. Front Psychol, 2022, 13(November): 1-14

[37] ShroutPE, FleissJL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull, 1979, 86(2): 420-8

[38] StearnsJ, WohlersB, McHughT, KuzikN. Reliability and validity of the PLAY fun tool with children and youth in Northern Canada. Meas Phys Educ Exerc Sci, 2019, 1: 47-57

[39] TomkinsonGR, CarverKD, AtkinsonF, DaniellND, LewisLK, FitzgeraldJS, LangJJ, OrtegaFB. European normative values for physical fitness in children and adolescents aged 9–17 years: results from 2 779 165 eurofit performances representing 30 countries. Br J Sports Med, 2018, 52(22): 1445-56

[40] TomkinsonGR, LangJJ, BlanchardJ, LégerLA, TremblayMS. The 20-m shuttle run: Assessment and interpretation of data in relation to youth aerobic fitness and health. Pediatr Exerc Sci, 2019, 31(2): 152-63

[41] Vicente-RodríguezG, Rey-LópezJP, RuízJR, Jiménez-PavónD, BergmanP, CiarapicaD, HerediaJM, MolnarD, GutierrezA, MorenoLA, OrtegaFB. Interrater reliability and time measurement validity of speed–agility field tests in adolescents. J Strength Conditioning Res, 2011, 25(7): 2059-63

[42] Ward B, Thornton A, Lay B, Chen N, Rosenberg M. Can proficiency criteria be accirately identified during real-time fundamental movement skill assessment. Res Q Exerc Sport. 2019;91(1):64–72. https://doi.org/10.1080/02701367.2019.1646852