Technical Adequacy Of Curriculum-based Measures Research Articles

Technical Adequacy of Curriculum-Based Measures in Writing in Grades 1–3

The purpose of this study was to investigate evidence of reliability, criterion validity, and grade-level differences of curriculum-based measures of writing (CBM-W) with 612 students in grades 1–3. Four scoring procedures (words written, words spelled correctly, correct word sequences, and correct minus incorrect word sequences) were used with two CBM-W tasks (picture–word and story prompt) during fall, winter, and spring of one academic year. A subsample of participants (n = 244) were given a criterion measure in spring of the academic year. Pearson’s r coefficients were calculated to determine evidence of alternate form reliability and criterion validity, and a MANOVA was used to detect significant growth within and across grade levels. Results indicated that scores on both CBM-W tasks had adequate reliability and validity coefficients in grades 2–3 and mixed results in grade 1. Significant growth was detected within and across all grades at each time point on each task. Implications for research and practice are discussed.

Developing and evaluating a kindergarten to third grade CBM mathematics assessment

The present study examined the technical adequacy of curriculum-based measurement (CBM) measure of early numeracy for kindergarten through third grade students. Our CBM measures were developed to reflect broad and theoretically derived categories of mathematical thinking: quick retrieval, written computation, and number sense. The mastery of these three categories comprises the larger construct of numeracy proficiency for the early elementary grades. Approximately 300 students in each grade (Kindergarten to Grade 3) were administered a standardized measure, WJ-III, and the following timed measures: kindergarten—counting, missing number, number identification, quantity discrimination; Grade 1—counting, missing number, next number, number facts, number identification, quantity discrimination; Grades 2 and 3—computation, concepts, missing number, number facts, quantity discrimination. Alpha and test–retest reliabilities were assessed, and construct validity and criterion validity were examined for the CBM measures developed in the study. Overall, the results indicated that the measures were reliable and showed evidence to support both construct and concurrent validity. Methods to improve the measures are discussed.

Curriculum-Based Measurement in Science Learning

The technical adequacy of curriculum-based measures in the form of short and simple vocabulary-matching probes to predict students’ performance and progress in science at the secondary level was investigated. Participants were 198 seventh-grade students from 10 science classrooms. Curriculum-based measurements (CBM) were 5-min vocabulary-matching probes administered once weekly over a period of 14 weeks. Criterion measures were knowledge pre- and posttests, the science subtest of the Iowa Test of Basic Skills (ITBS), and course grades. Alternate-form reliability coefficients ranged from r = .64 to .84. Coefficients increased over time and by combining scores across probes. Correlations between scores on the vocabulary-matching and criterion measures ranged from r = .55 to .76. The estimated mean group growth rate on the vocabulary-matching measure was .63 correct matches per week, which was significantly different from zero. The measures produced significant interindividual differences in growth rates, and growth on the measures was related to performance on the ITBS, course grades, and pre–post gains on the knowledge test. Results provide initial support for the technical adequacy of vocabulary-matching as an indicator of performance and progress in science.

Item-Level and Construct Evaluation of Early Numeracy Curriculum-Based Measures

The present study examined the technical adequacy of curriculum-based measures (CBMs) of early numeracy. Six 1-min early mathematics tasks were administered to 137 kindergarten and first-grade students, along with an omnibus test of early mathematics. The CBM measures included Count Out Loud, Quantity Discrimination, Number Identification, Missing Number, Next Number, and Number Facts. Alpha and split-half reliabilities were assessed, and construct validity and criterion validity (both concurrent and predictive) were examined. In addition, an item analysis was conducted for each measure using classical test theory and item response theory approaches, specifically using a Rasch model. Results indicated that the measures produced moderately strong reliability coefficients, satisfactory item difficulty and discrimination, evidence to support both concurrent and predictive validity with the standardized early mathematics test, and the tasks appeared to be measuring the construct of early numeracy proficiency.

Investigating the Technical Adequacy of Curriculum-Based Measurement in Written Expression for Students Who Are Deaf or Hard of Hearing

This study investigated the technical adequacy of curriculum-based measures of written expression (CBM-W) in terms of writing prompts and scoring methods for deaf and hard-of-hearing students. Twenty-two students at the secondary school-level completed 3-min essays within two weeks, which were scored for nine existing and alternative curriculum-based measurement (CBM) scoring methods. The technical features of the nine scoring methods were examined for interrater reliability, alternate-form reliability, and criterion-related validity. The existing CBM scoring method--number of correct minus incorrect word sequences--yielded the highest reliability and validity coefficients. The findings from this study support the use of the CBM-W as a reliable and valid tool for assessing general writing proficiency with secondary students who are deaf or hard of hearing. The CBM alternative scoring methods that may serve as additional indicators of written expression include correct subject-verb agreements, correct clauses, and correct morphemes.

Curriculum-based measures of writing across grade levels

This study compared the technical adequacy of curriculum-based measures in written expression across diverse grade levels. Students ( n = 484) completed two narrative writing samples in response to story starters. Samples were scored for the number of words written (TW), the number of correct word sequences (CWS), and the number of correct minus incorrect word sequences (CWS-ICWS). Alternate-form reliability and criterion-related validity coefficients of the curriculum-based measures were examined to determine differences between the coefficients according to grade level. Results indicated moderate to strong alternate-form reliability coefficients and variable criterion-related validity coefficients. The data from this study support the need for curriculum-based measures of writing to become more complex as students age and become more skilled.

Technical Adequacy of the Maze Task for Curriculum-Based Measurement of Reading Growth

The purpose of the present study was to examine the technical adequacy of curriculum-based measurement (CBM) for assessing student growth over time. Participants were 43 second graders whose reading performance was measured monthly over 1 school year with the maze task. Technical characteristics of the CBM maze task were examined in terms of reliability, sensitivity, and validity for assessing student growth. Results showed that the maze task had good alternate-form reliability, with a mean coefficient of .81 and 1- to 3-month intervals between testing. The maze task also sensitively reflected improvement of student performance over a school year and revealed interindividual differences in growth rates. Finally, growth rates estimated on repeated maze scores were positively related to later reading performance on a standardized reading test; in addition, although a significant difference was not found, general education students appeared to develop reading proficiency faster than remedial education students. Results support the use of the maze task as a reliable, sensitive, and valid data collection procedure for assessing reading growth.

Exploring the Technical Adequacy of Curriculum-Based Measurement in Reading for Children Who Use Manually Coded English

We explored the validity and reliability of curriculum-based measurement reading procedures for progress monitoring purposes with students who are deaf or hard of hearing and who use manually coded English. Results indicate that interjudge and alternative form reliability was very acceptable. However, Pearson product moment correlations between the curriculum-based measurement procedures (e.g., reading passages via signing, identifying idea units, and words retold) and a standardized reading test that was normed with students who were deaf or hard of hearing were lower than expected. Implications for using curriculum-based measurement with students who are deaf and hard of hearing and for assessment of these students are discussed.

Technical Adequacy of Curriculum-Based Measurement for Braille Readers

The reliability and validity of curriculum-based measurement (CBM) for Braille readers was evaluated. Passage sample lengths of 1-, 2-, and 3-minutes were examined for 15 students in Grades 3 throu...