Reading Assessment Research Articles

Beyond English centrality: integrating expansive conceptions of language for literacy programming into IEPs

This article addresses the English centrality in reading policy, assessment, and instructional practices in the U.S. and its implications for the educational programing for emerging bilingual students (EBs) with disabilities. A recent review of the state of practice as it relates to EBs with disabilities reveals concerns that have endured for nearly six decades: biased assessment, disproportionality issues in special education, and teachers’ lack of understanding of language acquisition and students’ potential. These concerns demonstrate a need for the field to prioritize multilingual lenses for both the identification of and programming for EBs with disabilities. We propose attention to conceptions of language that expand beyond the structuralist standpoint that prevails in the current science of reading reform. We offer guiding principles for IEP development grounded in sociocultural perspectives when designing bilingual instructional practices, which can be applied to the educational programming for EBs with disabilities. Within a sociocultural view of bilingualism and biliteracy, language, and literacy are understood by multiplicities in use, practice, form, and function, in which all communicators draw from expansive meaning-making repertoires, whether in listening, speaking, reading, writing, viewing, and multimodally representing. By expanding conceptions of a student’s linguistic repertoire, we honor their use of language as one, holistic system in which their named languages plus a multitude of linguistic practices intersect and interact.

Examining One-Way Dual Language Elementary Latinx Bilingual Learners’ Trajectory on a State Standardized Reading Assessment

ABSTRACT The U.S. population has become more racially and ethnically diverse over time. The Latinx population growth makes Spanish the most common language encountered in non-native English-speaking populations such as Texas. The research objective of this study was to examine if implementing a One-Way Dual Language Education (DLE) Program could result in positive outcomes on the reported reading performance of Latinx bilinguals as indicated by the State of Texas Assessment of Academic Readiness (STAAR) standardized assessment. This study aimed to investigate the possible impact the one-way dual language program may have on bilingual learners’ (BLs) reading assessment scores compared to other second language learners in Texas. The study analyzed the standardized state assessment reading scores in both English and Spanish of over 1100 BLs in a one-way DLE program and found that the BLs in the dataset demonstrated a positive trajectory in the mean scale scores as they progressed through elementary grades. The results provide a significant contribution to the research that supports the effectiveness of DLE programs, especially for Latinx BLs.

From spelling to reading: An intervention program with children at risk of reading failure

This study aimed to assess the impact of an interactive spelling program on reading acquisition of children at risk of developing reading difficulties as well as to assess its effect on spelling and phonemic awareness. From an initial pool of 144 first-grade children attending four Portuguese primary schools, 53 children with low performances in letter knowledge and phonemic awareness tasks, and considered by their teachers to be at risk of developing reading difficulties, were selected. These children were randomly assigned to three groups: an experimental group that underwent an interactive spelling program, a comparison group that underwent a phonological awareness program, and a control group that underwent a copying program. The programs, conducted in pairs, comprised 12 sessions lasting 20 to 30 min twice a week. The pretest and posttest included word reading, word spelling, and phonemic awareness assessments. Data analysis showed that the spelling group significantly outperformed the other groups across all measures except in the phonemic awareness task, where there were no differences with the phonological group. The word copying group consistently yielded the lowest results. Unlike the other two groups, the posttest results of the experimental group also reached the class average in word reading. For ethical reasons, after the final assessments the control group underwent a version of the interactive spelling program. This study suggests that spelling activities can contribute significantly to reading acquisition and can serve as a valuable pedagogical tool to proactively address challenges in learning to read.

Rapid online assessment of reading and phonological awareness (ROAR-PA)

Phonological awareness (PA) is at the foundation of reading development: PA is introduced before formal reading instruction, predicts reading development, is a target for early intervention, and is a core mechanism in dyslexia. Conventional approaches to assessing PA are time-consuming and resource intensive: assessments are individually administered and scoring verbal responses is challenging and subjective. Therefore, we introduce a rapid, automated, online measure of PA—The Rapid Online Assessment of Reading—Phonological Awareness—that can be implemented at scale without a test administrator. We explored whether this gamified, online task is an accurate and reliable measure of PA and predicts reading development. We found high correlations with standardized measures of PA (CTOPP-2, r = .80) for children from Pre-K through fourth grade and exceptional reliability (α = .96). Validation in 50 first and second grade classrooms showed reliable implementation in a public school setting with predictive value of future reading development.

Interacting adult-child relationships and school adjustment: Findings from growing up in Ireland

Although children's relationships with their parents and teachers contribute to their school adjustment and achievement, few studies have examined interactions between these relationships, particularly for father-child relationships. Using the Growing Up in Ireland birth cohort (N = 7507, 50.3% male), we examined child-adult relationship quality – rated by parents at age 3 and by teachers at age 5 – as predictors of teacher-rated behavioural adjustment and academic achievement at age 9 (indexed by self-reported academic self-concepts and performance on formal reading assessments). Controlling for prior levels of problem behaviours, verbal ability, and family SES, our results indicated that children's relationships with parents and teachers showed small and comparable independent effects on school adjustment and achievement. For mothers and teachers, moderation analyses showed a cumulative risk pattern for conflictual relationships and a compensatory pattern for close relationships. Children are likely to benefit from improving closeness and reducing conflict in adult-child relationships as well as interventions that involve mothers, fathers, and teachers.

Design and Validation of Structural Causal Model: A focus on SENSE-EGRA Datasets

Designing and validation of causal model correctness from a dataset whose background knowledge is gotten from a research process is not a common phenomenon. In fact, studies have shown that in many critical areas such as healthcare and education, researchers develop models from direct acyclic graphs without testing them. This phenomenon is worrisome and is bound to cast a dark shadow on the inference estimates that many arise from such models. In this study, we have design a novel application-based SCM for the first time using the background knowledge gotten from the American university of Nigeria (AUN), Yola, on the letter identification subtask of Early Grade reading Assessment (EGRA) program on Strengthen Education in Northeast Nigeria (SENSE-EGRA) project dataset, which was sponsored by the USAID. We employed the conditional independence test (CIT) criteria for the model’s correctness validation testing, and the results shows a near perfect SCM.

The Effectiveness of Early Grade Reading Assessment (EGRA) Method on Elementary Students’ Reading Fluency

Along with the evolution of time, individuals were required to learn quickly, especially in mastering new things. Therefore, it became the main reason reading is considered a fundamental skill that should be mastered from a young age. Several methods have been created to enhance reading fluency, including the Early Grade Reading Assessment (EGRA). This research aims to determine the EGRA method's effectiveness on students' reading fluency. A quantitative approach with a quasi-experimental method and a nonrandomized pretest-posttest control group design was employed. Thirty-seven fourth-grade elementary school students at SDN X Cikarang Regency participated. Eight (8) elements of EGRA were used as treatment materials, namely: (a) letter identification; (b) distinguishing initial sound; (c) nonword reading; (d) read aloud/oral reading; (e) reading comprehension; (f) listening comprehension; (g) Indonesian vocabulary; and (h) dictation. As for analyzing the data, the researcher employed Mann-Whitney U to compare the pretest and posttest scores of the control and experimental groups. The results showed that The EGRA method significantly improved reading fluency in fourth-grade elementary school students (p < 0.05). Thus, the EGRA method can help educators teach elementary school students to read more fluently.

Appropriacy of Supplementary Reading Assessment Tools and Materials Used In Public Elementary Schools

Given this substantial and transformative shift in teaching and learning paradigms, teachers serving as frontline encounter numerous challenges. These challenges are particularly pertinent in the context of the appropriacy of supplementary reading assessment tools and materials used in public elementary schools. This study employed a descriptive-evaluative research method to determine the appropriacy of the supplementary reading assessment tools and materials used in public elementary schools in the Division of Ozamiz City, School Year 2022-2023. Participants of this study were the Grade-4 reading teachers and pupils. The study underscored the need for enhancements in selecting and appropriating these materials for Grade 4 learners. A notable discrepancy was observed between the intended grade levels of the materials and the actual reading performance of the students. It is imperative to align materials with learners’ reading abilities to provide an appropriate level of challenge conducive to learning. Consequently, there is a pressing need for comprehensive reviews and revisions of reading assessment tools and materials used in Grade 4 classrooms. Additionally, offering professional development programs and workshops to augment teachers’ competencies in selecting and utilizing suitable reading materials is essential for addressing these challenges effectively and promoting better literacy outcomes among pupils.

Can Artificial Intelligence Identify Reading Fluency and Level? Comparison of Human and Machine Performance

This study examined whether an artificial intelligence-based automatic speech recognition system can accurately assess students’ reading fluency and reading level. Participants were 120 fourth-grade students attending public schools in Türkiye. Students read a grade-level text out loud while their voice was recorded. Two experts and the artificial intelligence-based automatic speech recognition system analyzed the recordings for reading errors. Following the analysis, a word error rate was calculated for both the experts and the artificial intelligence-based automatic speech recognition system. Word error rates were converted into reading accuracy rate scores. Inter-rater agreement and linear regression analyses were used to compare the raters’ reading fluency scores, and logistic regression analyses were used to compare the classification of readers according to their reading levels. Results showed that the difference between the scores of the artificial intelligence-based automatic speech recognition system and the expert scores was minimal. This is because there was a very high level of agreement between the artificial intelligence-based automatic speech recognition system and the experts scores. Linear regression analyses showed that the artificial intelligence-based automatic speech recognition system significantly predicted the scores of experts. According to the logistic regression analysis results, the artificial intelligence-based automatic speech recognition system was at least 93% as successful as human raters in classifying readers as poor and good. These results give us hope that reading assessments at classroom, school, regional, national, and even international levels can be conducted more accurately and economically by using artificial intelligence-based systems in the coming years.

Reflective thinking and self-assessment: A model for the architectural design studio

Developing, experimenting, and sharing critical pedagogical approaches is becoming increasingly important in architectural education, which supposedly superposes theory and practice. In this article, the authors reveal and reflect on an enriching pedagogical approach to the traditional architectural design studio. It is acknowledged that students develop comprehensive examination and internalization abilities by developing reflective thinking and self-evaluation abilities that complement each other. Based on the pioneer educational theory of John Dewey, the researchers' selected instructional interventions. Using the action research method, four additional modes conceptualized towards disciplinary literacy -reading, mapping, discussion, and peer assessment- were injected into the traditional studio process during a semester of architectural design course. The pedagogical approach is built on questioning the two basic creativity-based abilities of learners: reflective thinking and self-assessment. The fundamental questions are: How can a reading-discussion setup designed to nurture disciplinary literacy in the design studio be a factor in developing reflective thinking ability? How can the systematic peer assessment exercise be a factor in the students' self-assessment and reflective thinking skills as a learning outcome? The results argue for the effects on students' intangible skills. The model studio setup exhibited two remarkable findings, showing that (i) the reading-discussion mode is more effective in generating reflective thinking and (ii) the systematic peer review exercise is more effective in gaining self-assessment ability. The aim is to contribute to the theory of education by making the model application in the field of architectural design studio accessible and reflective for other educators.

Evaluating English-language morphological awareness assessments.

Many studies have shown that morphological knowledge has effects on reading comprehension separate from other aspects of language knowledge. This has implications for reading instruction and assessment: it suggests that children could have reading comprehension difficulties that are due to a lack of morphological knowledge, and thus, that explicit instruction of morphology might be helpful for them, indeed for all children. To find children who might especially benefit from specific instruction in morphology, we would need good tests of morphological knowledge. We evaluated a set of morphological awareness assessments to determine whether they conclusively tapped into morphological knowledge, and found that it was not possible to be certain that they were accurately targeting morphological knowledge.

The Interplay between Metacognitive Knowledge, L2 Language Proficiency, and Question Formats in Predicting L2 Reading Test Scores

In the context of L2 academic reading, teachers tend to use a variety of question formats to assess students’ reading comprehension. Studies have revealed that not only question formats but also L2 language proficiency might affect how students use metacognitive strategies. Moreover, studies have determined that students’ L2 reading comprehension is positively influenced by their metacognitive knowledge, though whether this positive influence is reflected in students’ test scores is still under debate. This study therefore adopted path analyses to investigate the relationship between metacognitive knowledge, L2 reading proficiency, L2 reading test scores, and question formats. A total of 108 ESL students took English reading tests in multiple-choice and short-answer question formats and completed a reading strategy survey to measure their metacognitive knowledge of three types of strategies: global, problem-solving, and supporting. In both question formats, path analyses indicated that (1) metacognitive knowledge contributed to L2 reading test scores and (2) students’ L2 reading proficiency mediated the impact of metacognitive knowledge on their test performance. Moreover, path analyses revealed that question formats might play an important role in altering the impact of metacognitive knowledge on L2 reading test scores. Implications for instruction and L2 reading assessment are discussed.

Effect of a Comprehensive School-Based Health Center on Academic Growth in K-8th Grade Students

ObjectiveSchool-based health centers (SBHCs) improve health care access, but associations with educational outcomes are mixed and limited for elementary and middle school students. We investigated whether students enrolled in a comprehensive SBHC demonstrated more growth in standardized math and reading assessments over 4 school years versus nonenrolled students. We also explored changes in absenteeism. MethodsParticipants were students enrolled in 2 co-located Title I schools from 2015–19 (1 elementary, 1 middle, n = 2480). Analysis of math and reading was limited to students with baseline and postbaseline scores (math n = 1622; reading n = 1607). Longitudinal regression models accounting for within-subject clustering were used to estimate the association of SBHC enrollment with academic scores and daily absenteeism, adjusting for grade, sex, body mass index category, health conditions, baseline outcomes (scores or absenteeism), and outcome pretrends. ResultsMore than 70% of SBHC-enrolled students had math (1194 [73.6%]) and reading 1186 [73.8%]) scores. Enrollees were more likely than nonenrollees to have asthma (39.7% vs 19.6%) and overweight/obesity (42.4% vs 33.6%). Adjusted baseline scores were significantly lower in math and reading for enrollees. Mean change from baseline for enrollees exceeded nonenrollees by 3.5 points (95% confidence interval [CI]: 2.2, 4.8) in math and 2.1 points (95% CI: 0.9, 3.3) in reading. The adjusted rate of decrease in daily absenteeism was 10.8% greater for enrollees (incident rate ratio 0.772 [95% CI: 0.623, 0.956]) than nonenrollees (incident rate ratio 0.865 [95% CI: 0.696, 1.076]). ConclusionsSBHC enrollees had greater health and educational risk but demonstrated more growth in math and reading and less absenteeism than nonenrollees.

Accomplishing feedback through inscription during reading assessment interaction

This paper examines the role of writing in sequences of oral feedback during formal formative reading assessment in an elementary school classroom. Previous research indicates that writing-in-interaction is central to the interactional accomplishment of feedback. The limitations of writing-in-interaction research on feedback for the study of formal formative reading assessment lies in its preoccupation with the planned-use of written inscriptions. Without presuming that inscriptions are planned as resources for feedback, the study asks ‘what role does inscription play in the accomplishment of feedback during formal formative reading assessment interaction?’ Analyzing a single case using ethnomethodologically-inspired conversation analysis, the current study demonstrates how writing done initially to record a student's reading performance emerges later, unplanned, as resource for sequences of diagnostic and instructional interaction. The paper contributes to an understanding of inscription as a practical technology for formative assessment, and demonstrates how the formal assessment of reading performance is interactionally accomplished.

Effectiveness of Contextualized Marungko Approach-Based Supplementary Reading Material

Acquiring solid reading skills is significant in education as it is the cornerstone for academic success and lifelong learning. This sequential explanatory mixed-methods study investigates the effectiveness of a contextualized Marungko approach-based supplementary reading material in improving the reading performance of Grade 1 pupils. In the pre-experimental phase the Early Grade Reading Assessment (EGRA) tool was utilized to measure the reading skills of the twenty four (24) Grade 1 pupils in terms of identifying letter sounds, identifying initial sounds, reading familiar words, reading invented words, and reading oral passages before and after the implementation of the contextualized Marungko approach-based supplementary reading material. Findings revealed a significant improvement in the early reading skills of Grade 1 pupils after using the supplementary reading material. This indicated that the reading material effectively enhanced the Grade 1 pupils’ reading performance. The responses of the five (5) participants in the qualitative phase, which were examined following Braun and Clark (2013) analysis, yielded two (2) themes. It is recommended that educational institutions and policymakers should consider incorporating the Marungko Approach into their reading instruction programs to enhance alphabet knowledge, phonemic awareness, word recognition, decoding, and oral reading fluency.

L2 Reading Assessment from a Sociocultural Theory Perspective: The Contributions of Dynamic Assessment

Our understanding of assessing L2 reading has significantly expanded in recent years, including both theoretical and practical aspects. There is a growing consensus that reading comprehension involves multiple skills and subskills. Classroom-based assessment practices reflecting such conceptualizations have also become widely utilized. This article explores the Vygotskyan sociocultural theory (SCT) and its implications for L2 reading assessment, with a specific focus on dynamic assessment as an effective classroom-based approach for L2 reading and literacy instruction. We will review the research that has applied DA principles to the assessment and teaching of L2 reading. We conclude by outlining potential avenues for future DA research and L2 reading instruction.

Utilizing Text-Generative AI for Creating Oral Reading Fluency Probes

Oral reading fluency probes are essential for reading assessment, intervention, and progress monitoring. Due to the limited options for choosing oral reading fluency probes, it is important to utilize all available resources such as generative artificial intelligence (AI) like ChatGPT to create oral reading fluency probes. The purpose of this article is to describe how to use AI through ChatGPT to create customizable reading passages comparable with that of oral reading fluency probes. Using readability estimates, the ChatGPT-generated passages can be tailored to suit for specific grade levels, similar to how current publishers design oral reading fluency probes for the market. The implication of ChatGPT-generated passages is that researchers and practitioners alike could use ChatGPT to be able to create a seemingly unlimited amount of reading passages tailored to the skill level and interests of the learner for intervention material and potentially assessment material, while reducing cost and time investment.

What matters the most, the assessment method or individual skills in marketing research learning?

PurposeThe purpose of this study is to generate knowledge about assessment methods in blended business education, which have become increasingly important to establish sustainable assessment practices that support knowledge acquisition for undergraduate students in business administration at a Colombian university.Design/methodology/approachFor the analysis, a two groups comparison was performed using a nonequivalent control group design with a sample of 420 students. As this study wants to find insights to improve the knowledge on assessment topics in marketing research (MR) education, it was focused on the students from the business administration program. This study also uses individual scores from the state test as prior cognitive scores and the high school classification provided by the National Ministry of Education in Colombia (2012).FindingsIt was found that the variables that best predict performance on the MR course examinations were the mathematics skills and reading comprehension scores on the state test. The study also showed a better performance of female students on both assessment methods. There were no significant differences between the assessment methods or among the high school levels.Research limitations/implicationsOne of the limitations of this study is the limited number of items on the tests. Additionally, the authors recommend conducting an analysis of the differences between the testing items to provide a detailed explanation of students’ performance when comparing computer-based testing and paper-and-pencil testing.Practical implicationsFurther design of teaching material and assessments online and offline, based on local and regional marketing problems, is suggested. As the current text and readings are more oriented to the English-speaking contexts, most of the problems presented are oriented to multinational companies and brands.Social implicationsInsights into the skills required for future jobs provide valuable guidance (World Economic Forum, 2020). Essential skills for emerging roles, like data scientists, can find robust support within the MR course. To further enrich in-class and online exercises with Excel and SPSS, Colombian educators can leverage data sets obtained from sources like the national statistics office and international market intelligence databases available through the university’s library, including Passport and Statista. Engaging with authentic data sets provides students with a more profound understanding of practical applications in MR.Originality/valueThis approach facilitates the identification of key variables, such as assessment and cognitive abilities in math and reading, which predict students’ knowledge acquisition in MR. It not only offers insights into the relevant factors influencing learning in MR but also provides valuable feedback. Additionally, it suggests potential avenues for future research in this field.

Differentiating less-prepared from more-prepared college readers

ABSTRACT This study was conducted to better understand the difficulties faced by underprepared college readers, including those enrolled in Developmental Education (DE) programs. The Reading Systems Framework was used as a theoretical motivation. Participants (n = 258) completed a measure of component reading skills (Study Aid and Reading Assessment, word recognition/decoding, vocabulary, morphology, sentence processing) and a think-aloud measure wherein they produced written responses while reading texts. Responses were scored based on evidence of the use of inference strategies (bridging and elaboration). Cumulative links mixed-effects models were used to assess the extent to which proficiency in component reading skills and DE enrollment were differentially related to the use of inferencing. Results indicated that vocabulary was a positive predictor of bridging and elaboration scores. DE enrollment was a negative predictor of elaboration scores, suggesting that DE readers were less likely to produce elaborations. Implications for theory and practice are discussed.

How curriculum and assessment policies affect the role of reading in an assessment culture: a New Zealand case study

ABSTRACT Reading assessment is a critical feature of education systems. The aim of this study is to explore reading assessment policy in the New Zealand (NZ) assessment culture. We reviewed research publications, national policy documents and test protocols on reading for year levels 6–9 (ages 9–13). We found that assessment data are broadly conceptualised and used for multiple purposes, that the representation of reading assessment data is located in an improvement-oriented environment and that the use of reading assessment for improvement purposes involves multiple actors and organisation levels. We discuss to what extent reading assessment policy supports student learning and teacher professional learning.