Abstract
ABSTRACTAn experiment was designed that varied cutting score procedures, instructions, and types of judges in order to address the following questions: (1) Will the cutting score levels produced by groups of judges from differing backgrounds using the same method and instructions be different? (2) Will the agreement between item rating profiles vary across these different groups of judges? (3) Does either agreement across items and/or levels vary systematically by instruction or method?It was found that three out of four groups of judges arrived at significantly higher cutting score levels using the Angoff method than when using the Nedelsky procedure. The Angoff procedure was more effective in setting standards that distinguished the minimally qualified practitioner from the individual with average qualifications. Although the Angoff method demonstrated somewhat higher interjudge agreement with respect to the patterns of item responses the average correlation between item profiles was generally low for both procedures.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
