Curriculum-based measurement for early writing struggles in kindergartena systematic review
-
1
Universidad de La Laguna
info
- 2 Universidad de Talca, Chile
ISSN: 1135-755X
Year of publication: 2024
Volume: 30
Issue: 2
Pages: 101-110
Type: Article
More publications in: Psicología educativa
Abstract
Early detection and intervention play a crucial role in the prognosis of children with specific learning disabilities. Due to the complexity of the writing process and its persistence into adulthood, tools for early detection are essential. Curriculum-based measures (CBMs) are quick, reliable, and evidence-based tools used for early assessments. This systematic review aims to summarize the technical features of CBM in writing for kindergarten students following the PRISMA guidelines. A total of 311 articles from PsycINFO, SCOPUS, ERIC, and WOS were examined, and five studies met the inclusion criteria. Production measures and transcription skills were the most studied. The reviewed tasks demonstrated criterion validity, reliability, sensitivity to the timing of assessment, or diagnostic accuracy in at least one of their measures, with a greater presence of the dependent production measures. The findings emphasize the scarcity of evidence-based tools for identifying early writing difficulty, underscoring the need for rigorous research in early childhood education.
Bibliographic References
- American Psychiatric Association. (2013). DSM-5. Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association.
- Ardoin, S. P. (2006). The response in response to intervention: Evaluating the utility of assessing maintenance of intervention effects. Psychology in the Schools, 43(6), 713-725. https://doi.org/10.1002/PITS.20181
- Arfé, B., Dockrell, J. E., & De Bernardi, B. (2016). The effect of language specific factors on early written composition: The role of spelling, oral language and text generation skills in a shallow orthography. Reading and Writing, 29 (3), 501-527. https://doi.org/10.1007/s11145-015-9617-5
- Arrimada, M., Fidalgo, R., & Torrance, M. (2022). Evaluación de la composición escrita: una revisión de medidas e instrumentos. In M. Arrimada, R. Fidalgo, & M. Torrance (Coords.), ¿Cómo prevenir las dificultades de aprendizaje en la escritura?: la respuesta a la intervención como marco de referencia (pp. 149-179). Pirámide. https://dialnet.unirioja.es/servlet/articulo?codigo=8861198
- Arrimada, M., Torrance, M., & Fidalgo, R. (2020). El modelo de respuesta a la intervención en escritura: revisión de medidas de evaluación y prácticas instruccionales. Papeles Del Psicólogo, 41 (1), 54-65. https://doi.org/10.23923/PAP.PSICOL2020.2918
- Belur, J., Tompson, L., Thornton, A., & Simon, M. (2021). Interrater reliability in systematic review methodology: Exploring variation in coder decision-making. Sociological Methods & Research, 50 (2), 837-865. https://doi.org/10.1177/0049124118799372
- Berninger, V. W. (2000). Development of language by hand and its connections with language by ear, mouth, and eye. Topics in Language Disorders, 20(4), 65-84. https://doi.org/10.1097/00011363-200020040-00007
- Berninger, V. W., Abbott, R. D., Abbott, S. P., Graham, S., & Richards, T. (2002). Writing and reading: Connections between language by hand and language by eye. Journal of Learning Disabilities, 35 (1), 39-56. https://doi.org/10.1177/002221940203500104
- Berninger, V. W., & Amtmann, D. (2003). Preventing written expression disabilities through early and continuing assessment and intervention for handwriting and/or spelling problems: Research into practice. In H. L. Swanson, K. R. Harris, & S. Graham (Eds.). Handbook of learning disabilities (pp. 345-363). The Guilford Press. https://psycnet.apa.org/record/2003-02238-020
- Berninger, V. W., Nielsen, K. H., Abbott, R. D., Wijsman, E., & Raskind, W. (2008). Writing problems in developmental dyslexia: Under-recognized and under-treated. Journal of School Psychology, 46(1), 1-21. https://doi.org/10.1016/J.JSP.2006.11.008
- Berninger, V. W., & Swanson, H. L. (1994). Modifying Hayes and Flower’s model of skilled writing to explain beginning and developing writing. In E. C. Butterfield & J. S. Carlson (Eds.), Advances in cognition and educational practice. Children’s writing: Toward a process theory of the development of skilled writing (Vol. 2, pp. 57-81). JAI Press.
- Berninger, V. W., & Winn, W. (2006). Implications of advancements in brain research and technology for writing development, writing instruction, and educational evolution. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 96–114).
- Blanco Pérez, M., & Bermejo, V. (2009). El efecto Mateo en niños con dificultades específicas de aprendizaje de las matemáticas. Escritos de Psicología/Psychological Writings, 3(1), 30-36. https://doi.org/10.24310/ESPSIESCPSI.V3I1.13332
- Bosch, R., Pagerols, M., Rivas, C., Sixto, L., Bricollé, L., Español-Martín, G., Prat, R., Ramos-Quiroga, J. A., & Casas, M. (2021). Neurodevelopmental disorders among Spanish school-age children: Prevalence and sociodemographic correlates. Psychological Medicine, 1-11. https://doi.org/10.1017/S0033291720005115
- Cappa, C., Giulivi, S., Schilirò, A., Bastiani, L., Muzio, C., & Meloni, F. (2015). A screening on specific learning disorders in an Italian speaking high genetic homogeneity area. Research in Developmental Disabilities, 45-46, 329-342. https://doi.org/10.1016/J.RIDD.2015.07.011
- Coker, D. (2006). Impact of first-grade factors on the growth and outcomes of urban schoolchildren’s primary-grade writing. Journal of Educational Psychology, 98(3), 471-488. https://doi.org/10.1037/0022-0663.98.3.471
- Coker, D. L., & Ritchey, K. D. (2010). Curriculum-based measurement of writing in kindergarten and first grade: An investigation of production and qualitative scores. Exceptional Children, 76(2), 175-193. https://doi.org/10.1177/001440291007600203
- Defior, S., Jiménez-Fernández, G., & Serrano, F. (2009). Complexity and lexicality effects on the acquisition of Spanish spelling. Learning and Instruction, 19 (1), 55-65. https://doi.org/10.1016/J.LEARNINSTRUC.2008.01.005
- Defior, S., Serrano, F., & Gutiérrez, N. (2015). Dificultades específicas de aprendizaje. Editorial Síntesis.
- De León, S. C., Jiménez, J. E., García, E., & Gutiérrez, N. (2021a). Identification of Spanish third graders at risk of math problems: Usefulness of number sense based screening measures. Psychology in the Schools, 58(7), 1416-1431. https://doi.org/10.1002/PITS.22525
- De León, S. C., Jiménez, J. E., García, E., Gutiérrez, N., & Gil, V. (2021b). Universal screening in mathematics for Spanish students in first grade. Learning Disability Quarterly, 44 (2), 123 -135. https://doi.org/10.1177/0731948720903273
- Deno, S., Marston, D., Mirkin, P., Lowry, L., Sindelar, P., & Jenkins, J. (1982).The use of standard tasks to measure achievement in reading, spelling, and written expression: A normative and developmental study (Research Rpt. 87). Institute for Research on Learning Disabilities.
- Ehri, L. C. (1986). Sources of difficulty in learning to spell and read.Advances in Developmental & Behavioral Pediatrics, 7, 121-195.
- Faber, I. R., Bustin, P. M. J., Oosterveld, F. G. J., Elferink-Gemser, M. T., & Nijhuis-Van der Sanden, M. W. G. (2015). Assessing personal talent determinants in young racquet sport players: A systematic review. Journal of Sports Sciences, 34 (5), 395-410. https://doi.org/10.1080/02640414.2015.1061201
- Flower, L., & Hayes, J. R. (1981). A cognitive process theory of writing. College Composition and Communication, 32 (4), 365-387. https://doi.org/10.2307/356600
- Fortes, I. S., Paula, C. S., Oliveira, M. C., Bordin, I. A., de Jesus Mari, J., & Rohde, L. A. (2016). A cross-sectional study to assess the prevalence of DSM-5 specific learning disorders in representative school samples from the second to sixth grade in Brazil. European Child and Adolescent Psychiatry, 25(2), 195-207. https://doi.org/10.1007/S00787-015-0708-2/TABLES/4
- Fuchs, D., & Fuchs, L. S. (2006). Introduction to response to intervention: What, why, and how valid is it? Reading Research Quarterly, 41 (1), 93-99. https://doi.org/10.1598/RRQ.41.1.4
- Fuchs, L. S., & Fuchs, D. (2007). A model for implementing responsiveness to intervention. Exceptional Children, 39(5), 14-20. https://doi.org/10.1177/004005990703900503
- Gansle, K. A., Noell, G. H., VanDerHeyden, A. M., Naquin, G. M., & Slider, N. J. (2002). Moving beyond total words written: The reliability, criterion validity, and time cost of alternate measures for curriculum-based measurement in writing. School Psychology Review, 31 (4), 477-497. https://doi.org/10.1080/02796015.2002.12086169
- Gansle, K. A., VanDerHeyden, A. M., Noell, G. H., Resetar, J. L., & Williams, K. L. (2006). The technical adequacy of curriculum-based and rating-based measures of written expression for elementary school students. School Psychology Review, 35 (3), 435-450. https://doi.org/10.1080/02796015.2006.12087977
- Gil, V., & Jiménez, J.E. (2019). Evaluación basada en el currículo dentro del modelo RtI: elemento crítico para su implementación. In J. E. Jiménez (Coord.), Modelo de respuesta a la intervención: un enfoque preventivo para el abordaje de las dificultades específicas de aprendizaje (pp. 85-105). Ediciones Pirámide.
- Graham, S., Berninger, V. W., Abbott, R. D., Abbott, S. P., & Whitaker, D. (1997). Role of mechanics in composing of elementary school students: A new methodological approach. Journal of Educational Psychology, 89(1), 170-182. https://doi.org/10.1037/0022-0663.89.1.170
- Graham, S., Collins, A. A., & Rigby-Wills, H. (2017). Writing characteristics of students with learning disabilities and typically achieving peers: A meta-analysis. Exceptional Children, 83 (2), 199-218. https://doi.org/10.1177/0014402916664070
- Graham, S., Gillespie, A., & Mckeown, D. (2013). Writing: Importance, development, and instruction. Reading and Writing, 26 (1), 1-15. https://doi.org/10.1007/s11145-012-9395-2
- Graham, S., & Hall, T. E. (2016). Writing and writing difficulties from primary grades to college. Learning Disability Quarterly, 39 (1), 3-4. https://doi.org/10.1177/0731948715592154
- Graham, S., & Harris, K. R. (2005). Improving the writing performance of young struggling writers: Theoretical and programmatic research from the center on accelerating student learning. The Journal of Special Education, 39 (1), 19-33. https://doi.org/10.1177/00224669050390010301
- Graham, S., & Perin, D. (2007). A meta-analysis of writing instruction for adolescent students. Journal of Educational Psychology, 99 (3), 445-476. https://doi.org/10.1037/0022-0663.99.3.445
- Gutiérrez, N., Jiménez, J. E., & de León, S. C. (2021). Reading curriculum-based measures for Universal Screening in monolingual Spanish first graders. Early Education and Development, 33(6), 1036 -1060. https://doi.org/10.1080/10409289.2021.1935537
- Hampton, D. D., Lembke, E. S., Lee, Y. S., Pappas, S., Chiong, C., & Ginsburg, H. P. (2012). Technical adequacy of early numeracy curriculum-based progress monitoring measures for kindergarten and first-grade students. Assessment for Effective Intervention, 37 (2), 118 -126.https://doi.org/10.1177/1534508411414151
- Hooper, S. R., Costa, L.-J., Mcbee, M., Anderson, K. L., Yerby, D. C., Knuth, S. B., Childress, A., Hooper, S. R., Anderson, Á. K. L., Yerby, Á. D. C., Costa, L.-J., Knuth, Á. S. B., Childress, Á. A., Mcbee, M., & Graham, F. P. (2011). Concurrent and longitudinal neuropsychological contributors to written language expression in first and second grade students. Reading and Writing, 24 (2), 221-252. https://doi.org/10.1007/s11145-010-9263-x
- Hosp, M. K., Hosp, J. L., & Howell, K. W. (2007).The ABCs of CBM: A practical guide to curriculum-based measurement. www.kansasmtss.org
- Jewell, J., & Malecki, C. K. (2005). The utility of CBM written language indices: An investigation of production dependent, production-independent, and accurate-production scores. School PsychologyReview, 34(1), 27-44. https://doi.org/10.1080/02796015.2005.12086273
- Jiménez, J. E. (2018). Early Grade Writting Assessment: A report on development of an instrument. United Nations Educational, Scientific, and Cultural Organization.
- Jiménez, J. E., De León, S. C., & Gutiérrez, N. (2021). Piloting the response to intervention model in the Canary Islands: Prevention of reading and math learning disabilities. Spanish Journal of Psychology, 24 . https://doi.org/https://doi.org/10.1017/SJP.2021.25
- Jiménez, J. E., & García De La Cadena, C. (2007). Learning disabilities in Guatemala and Spain: A cross-national study of the prevalence and cognitive processes associated with reading and spelling disabilities. Learning Disabilities Research & Practice, 22 (3), 161 -169. https://doi.org/https://doi.org/10.1111/j.1540-5826.2007.00247.x
- Johnson, E., Mellard, D. F., Fuchs, D., & McKnight, M. A. (2006). Responsiveness to Intervention (RTI): How to do it. RTI manual. National Research Center on Learning Disabilities. www.nrcld.org
- Juel, C., Griffith, P. L., & Gough, P. B. (1986). Acquisition of literacy. A longitudinal study of children in first and second grade. Journal of Educational Psychology, 78 (4), 243-255. https://doi.org/10.1037/0022-0663.78.4.243
- Justi, C. N. G., Cunha, N., & Justi, F. R. dos R. (2020). Letter-name knowledge: Predicting reading and writing difficulties. Estudos de Psicologia (Campinas), 37(3). https://doi.org/10.1590/1982-0275202037e180173
- Katusic, S. K., Colligan, R. C., Weaver, A. L., & Barbaresi, W. J. (2009). The forgotten learning disability: Epidemiology of written-language disorder in a population-based birth cohort (1976-1982), Rochester, Minnesota. Pediatrics, 123 (5), 1306-1313. https://doi.org/10.1542/peds.2008-2098
- Keller-Margulis, M. A., Ochs, S., Reid, E. K., Faith, E. L., & Schanding, Jr. G.T. (2019). Validity and diagnostic accuracy of early written expression screeners in kindergarten. Journal of Psychoeducational Assessment, 37(5), 539-552. https://doi.org/10.1177/0734282918769978
- Kent, S., Wanzek, J., Petscher, Y., al Otaiba, S., Kim, Y.-S., Kent, S., Wanzek, J., Kim, Y.-S., Petscher, Y., & al Otaiba, S. (2014). Writing fluency and quality in kindergarten and first grade: The role of attention, reading, transcription, and oral language. Reading and Writing, 27 , 1163-1188. https://doi.org/10.1007/s11145-013-9480-1
- Kim, Y. S., Al Otaiba, S., Puranik, C., Folsom, J. S., Greulich, L., & Wagner, R. K. (2011). Componential skills of beginning writing: An exploratory study. Learning and Individual Differences, 21(5), 517-525. https://doi.org/10.1016/J.LINDIF.2011.06.004
- Kirby, M. S., Spencer, T. D., & Chen, Y.-J. I. (2021). Oral narrative instruction improves kindergarten writing. Reading and Writing Quarterly, 37(6), 574-591. https://doi.org/10.1080/10573569.2021.1879696
- Landerl, K., & Moll, K. (2010). Comorbidity of learning disorders: Prevalence and familial transmission. Journal of Child Psychology and Psychiatry, 51(3), 287-294. https://doi.org/10.1111/J.1469-7610.2009.02164.X
- Landis, J. R, & Koch, G. K. (1977). The measurement of observer agreement for categorical data. Biometrics, 33 (1), 159-74. https://doi.org/10.2307/2529310
- Law, M., Stewart, D., Pollock, N., Bosch, J., & Westmorland, M. (1998). Guidelines for critical review form - quantitative studies. CanChild, Research Centre of McMaster University.
- Lembke, E., Deno, S. L., & Hall, K. (2016). Identifying an indicator of growth in early writing proficiency for elementary school students. Assessment for Effective Intervention, 28 (34), 23-35. https://doi.org/10.1177/073724770302800304
- Leonardi, M. M., Domenico, F., Blasi, D., Savelli, E., & Buono, S. (2021). Reading and spelling disorders in a school-based population screening in Sicily (Italy). Dyslexia, 27 (4), 452-467. https://doi.org/10.1002/dys.1694
- Lonigan, C., Schatschneider, C., & Westberg, L. (2008). Identification of children’s skills and abilities linked to later outcomes in reading, writing, and spelling. Developing early literacy: Report of the National Early Literacy Panel, 55-106.
- MacArthur, C. A., & Philippakos, Z. A. (2013). Self-regulated strategy instruction in developmental writing: A design research project. Community College Review, 41 (2), 176-195. https://doi.org/10.1177/0091552113484580
- Mandrekar, J. N. (2010). Receiver operating characteristic curve in diagnostic test assessment. Journal of Thoracic Oncology, 5 (9), 1315-1316. https://doi.org/10.1097/JTO.0b013e3181ec173d
- McCutchen, D. (2006). Cognitive factors in the development of children’s writing. In C. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 115-130). The Guilford Press.
- McMaster, K. L., & Espin, C. (2007). Technical features of curriculum-based measures for beginning writers: A literature review. The Journal of Special Educatior, 42 (2), 68-84. https://doi.org/10.1177/00224669070410020301
- McMaster, K. L., Ritchey, K. D., & Lembke, E. (2011). Curriculum-based measurement for beginning writers: Recent developments and future directions. Advances in Learning and Behavioral Disabilities, 24, 111–148. https://doi.org/10.1108/S0735-004X(2011)0000024008
- Moll, K., Kunze, S., Neuhoff, N., Bruder, J., & Schulte-Kö Rne, G. (2014). Specific learning disorder: Prevalence and gender differences. PLoS ONE, 9(7), Article 103537. https://doi.org/10.1371/journal.pone.0103537
- National Academies of Sciences, Engineering, and Medicine. (2017). Promoting the educational success of children and youth learning English. Promising futures. The National Academic Press. https://doi.org/10.17226/24677
- National Center on Response to Intervention. (2010). Information brief: Developing an RTI guidance document.https://files.eric.ed.gov/fulltext/ED578037.pdf
- O’Brien, B. A., Habib Mohamed, M. B., Arshad, N. A., & Lim, N. C. (2020). The impact of different writing systems on children’s spelling error profiles: Alphabetic, Akshara, and Hanzi cases.Frontiers in Psychology, 11. https://doi.org/10.3389/FPSYG.2020.00870
- Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016). Rayyan-a web and mobile app for systematic reviews. Systematic Reviews, 5 (1), 1-10. https://doi.org/10.1186/S13643-016-0384-4/FIGURES/6
- Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., ... Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372, Article 71. https://doi.org/10.1136/BMJ.N71
- Puranik, C. S., & Lonigan, C. J. (2012). Name-writing proficiency, not length of name, is associated with preschool children’s emergent literacy skills. Early Childhood Research Quarterly, 27(2), 284 -294. https://doi.org/10.1016/J.ECRESQ.2011.09.003
- Parker, D. C., Burns, M. K., McMaster, K. L., & Shapiro, E. S. (2012). Extending curriculum-based assessment to early writing. Learning Disabilities Research & Practice, 27 (1), 33-43. https://doi.org/10.1111/j.1540-5826.2011.00348.x
- Parker, R., Tindal, G., & Hasbrouck, J. (2009). Countable indices of writing quality: Their suitability for screening- eligibility decisions. Exceptionality: A Special Education Journal, 2 (1), 1-17. https://doi.org/10.1080/09362839109524763
- Puranik, C. S., Patchan, M. M., Sears, M. M., & McMaster, K. L. (2017). Examining alphabet writing fluency in kindergarten: Exploring the issue of time on task. Assessment for Effective Intervention, 42(2), 81-96. https://doi.org/10.1177/1534508416665324
- Ritchey, K. D., Coker, D. L., & McCraw, S. B. (2010). A comparison of metrics for scoring beginning spelling. Assessment for Effective Intervention,35(2), 78-88. https://doi.org/10.1177/1534508409336087
- Ritchey, K. D., McMaster, K. L., Al Otaiba, S., Puranik, C. S., Kim, Y. S. G., Parker, D. C., & Ortiz, M. (2015). Indicators of fluent writing in beginning writers. In K. D. Cummings & Y. Petscher (Eds.), The fluency construct: Curriculum-based measurement concepts and applications (pp. 21-66). https://doi.org/10.1007/978-1-4939-2803-3_2
- Rodríguez, C., Jiménez, J. E., & Balade, J. (2024). The impact of oral language and transcription skills on early writing production in kindergarteners: Productivity and quality. Early Childhood Education Journal, 1 -11. https://doi.org/10.1007/S10643-024-01670-4
- The National Center on Intensive Intervention. (2021, July).National Center on Intensive Intervention at the American Institutes for Research. Academic Screening Tools Chart. https://charts.intensiveintervention.org/ascreening
- Tolchinsky, L. (2006). The emergence of writing. In L. Tolchisky (Ed.), Handbook of writing research (pp. 83-95).
- Tortorelli, L. S., Gerde, H. K., Rohloff, R., & Bingham, G. E. (2022). Ready, set, write: Early learning standards for writing in the common core era. Reading Research Quarterly, 57 (2), 729–752. https://doi.org/10.1002/RRQ.436
- United Nations Educational, Scientific, and Cultural Organization (UNESCO, 1977). UNESCO Thesaurus. Vocabulary Information. https://vocabularies.unesco.org/browser/thesaurus/en/?clang=en
- Vélez Calvo, X. M. (2017). Análisis de la inclusión educativa a través de indicadores de prevalencia de dificultades de aprendizaje, actitudes del profesorado y condiciones de accesibilidad en los centros de la ciudad de Cuenca (Ecuador). Universitat de València.
- Videen, J., Deno, S., & Marston, D. (1982). Correct word sequences: A valid indicator of proficiency in written expression (Rsch. Rpt., No. 84).
- Van Der Heyden, A. M., Witt, J. C., Naquin, G., & Noell, G. (2001). The reliability and validity of curriculum-based measurement readiness probes for kindergarten students. School Psychology Review, 30 (3),363 -382. https://doi.org/10.1080/02796015.2001.12086121
- Von Aster, M., Schweiter, M., & Zulauf, M. W. (2010). Rechenstörungenbei Kindern Vorläufer, Prävalenz und psychische Symptome. Journal of Child Psychology and Psychiatry, 51 (3), 287-294. https://doi.org/10.1026/0049-8637.39.2.85
- Whitaker, D., Berninger, V., Johnston, J., & Lee Swanson, H. (1994). Intraindividual differences in levels of language in intermediate grade writers: Implications for the translating process. Learning and Individual Differences, 6 (1), 107-130. https://doi.org/10.1016/1041-6080(94)90016-7