Abstract

This article proposes the use of a standards-based approach to reporting results from large-scale assessment surveys in South Africa. The use of this approach is intended to address the key shortcomings observed in the current reporting framework prescribed in the national curriculum documents. Using the Angoff method and data from the Annual National Assessments, the article highlights how standard setting procedures should be conducted to develop meaningful reports that provide users with relevant information that can be effectively used to identify and develop appropriate interventions to address learning gaps. The findings of the study produced policy definitions and performance level descriptors that are proposed for use in enhancing the reporting of results for grade six English and mathematics. Moreover, the findings also indicate that the reporting of the Annual National Assessments using the national curriculum reporting categories overestimates the percentage of learners classified at the lowest performance levels and underestimates those in the next category. This finding has serious implications for the implementation of targeted interventions aimed at improving learning for all. The paper concludes by noting areas of further research for enhancing the use of results of large-scale assessment surveys and for supporting schools and teachers in addressing specific learning needs of all learners, especially the poor and marginalised.

Highlights

  • Large-scale assessment surveys (LSAS) have been implemented in South Africa since the abolishment of the apartheid system and have evolved over time, changing in name, purpose, design, scope and frequency along the way (DoE, 1998, 2003, 2005, DBE, 2011b, 2013; Kanjee, 2007)

  • This section reports on the practical implications of using the standards-based approach at the national and provincial levels by comparing results obtained from the standard setting (SS) process to that reported by the DBE (DBE, 2011b)

  • The policy definition should apply to all subjects and grade levels and should answer the question: how good is good enough? Perie (2008) notes that policy definitions facilitate the articulation of performance levels across grades by ensuring the same level of rigour at each level across each grade and allows a reader to interpret any specified level in a similar manner regardless of the subject assessed

Read more

Summary

Introduction

Large-scale assessment surveys (LSAS) have been implemented in South Africa since the abolishment of the apartheid system and have evolved over time, changing in name, purpose, design, scope and frequency along the way (DoE, 1998, 2003, 2005, DBE, 2011b, 2013; Kanjee, 2007). The policy document further notes that the ANAs should assist in setting realistic improvement targets and help parents understand how their children are performing in nationally set tests (DBE, 2012). The results of the ANAs are reported in rankings of learners based on the percentage correct responses in the administered test, as specified in the National Curriculum Statements (DoE, 2002) and the Curriculum and Assessment Policy Statement – CAPS (DBE, 2011a). Issues of whether ANA results are recorded, reported and disseminated in ways that make their meaning understandable so that they can be utilised optimally by targeted users have aroused growing interest into the role that LSAS in general and ANAs in particular, can play in improving the quality of teaching and learning in schools (Hoadley & Muller, 2014; Kanjee & Moloi, 2014). Reporting assessment results in raw scores such as percentage correct responses has received sharp criticism regarding its utility value as well as its lack of measurement accuracy and consistency (Braun & Kanjee, 2007; Bond & Fox, 2007; Dunne et al, 2012)

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call