Educational Assessment Policies Research Articles

European foreign language policies, national language testing and ambivalence towards the introduction of the logics of standardisation

Educational policies and priorities shaped at the supranational level by European and global agencies and players impact the processes of national policymaking in complex ways. In this study, recontextualisations of European foreign language education and language assessment policies in the Greek policy and pedagogical contexts are examined. Specifically, the politics of foreign language education and assessment are explored with a focus on English language teaching in public schools and the expected introduction of the Greek National Certificate of Language Proficiency (known as KPG) which is a state-led testing system formed by adopting the six-level scale of the Common European Framework of Reference for languages. Drawing on Bernstein’s theory of symbolic control and pedagogic discourse, it is shown that extensive recontextualisations of European (and global) discourses on English language teaching and assessment in the Greek context project competency and outcome-based curricula and learning as the desirable pedagogic model. Furthermore, attempts to introduce certification procedures in public schools derive from market-driven discourses that sanction a standardised system of student performance while the implications of standardisation for schools, teachers and students alike are downplayed.

Validade de Construto e Confiabilidade da Escala de Atitudes perante as Avaliações Externas Aplicadas em Larga Escala

Abstract The Scale of Attitudes towards External Assessments applied on a Large-Scale was developed to capture what basic education teachers think, feel, and how they behave in response to this type of assessment. Considering the potential of the instrument to support management decisions in the field of educational assessment policies, this article aimed to evaluate construct validity, via factor analysis, as well as scale reliability, via composite reliability of the scale, based on its application to a sample of teachers affiliated with the Education Department of Espírito Santo/Brazil. This is a quantitative, nonexperimental, instrumental study that involved 405 teachers from the public school network, whose results indicate adequate psychometric indices and a satisfactory factor structure consistent with the proposed three-dimensional attitude construct. The statistical coefficients found at the level of the analyses performed legitimize its use for the development of public policies and effective practices in the educational field.

Rater variability and reliability of constructed response questions in New York state high-stakes tests of English language arts and mathematics: implications for educational assessment policy

Using generalizability (G-) theory as a theoretical framework and research methodology, this study examined the impact of the current one-rater holistic scoring practice on the rater variability and reliability of constructed response questions in New York State high-stakes tests of grades four and six English language arts (ELA) and grades four and five mathematics assessments. Following the New York State scoring rubrics, a total of 36 grades four and six ELA constructed response samples and 72 grades four and five mathematics constructed response samples were marked holistically by ten independent raters having current certifications as educators in the State of New York. The results indicated that the current single-rater holistic scoring practice would not be able to yield acceptable G-coefficients for the New York State grades four and six ELA and grades four and five mathematics assessments. Implications for assessment policy making at the local and state levels are discussed.

A review of the changes in higher education assessment and grading policy during covid-19

The Covid-19 pandemic has not only brought about sociocultural, psychological and economic challenges, but also educational problems that have entailed radical policy changes to allow universities and colleges to fulfil their role. Before the pandemic, the majority of university courses were designed for face-to-face settings; but under the social distancing policies since Covid-19, institutions have had to react quickly, revising their teaching and assessment policies to ensure that education continues for all students and accommodate the new remote reality of education. This paper provides a review of the changes in educational assessment and grading policies of universities around the world in response to the Covid-19 pandemic, where five key themes were identified: covid-19 binary grading system, revised regulations governing the final degree award, relaxed academic progression policies, revised extension, deferral and exceptional circumstances policies, and mark adjustments. This review will serve as a useful summary for institutions to reflect upon and inform planning strategies for subsequent unexpected future events.

New Public Management and the Centralization of Educational Assessment Policy in Brazil: The Impact of the COVID-19 Pandemic in the Educational Field

<p style="text-align:justify">This text aims to analyze the conditionalities of the New Public Management for the educational assessment policy in Brazil and the deepening of educational inequality with the outbreak of the Coronavirus disease (COVID-19) pandemic. Certainly, within the trajectory of educational policies, Brazil has a clear relationship with the conservative way in which the State and society were shaped. In the current scenario of the New Public Management, the new educational policy dictates an economic logic in the pedagogical factor, which uses business management methods for results, transforming it as a solution to measure the quality of teaching, for which it uses evaluation mechanisms. Aspects linked to the New Public Management such as efficiency, efficacy and effectiveness permeate the rationality of educational policy and, consequently, of the evaluative logic. Indeed, the centrality of the assessment conditioned the logic of curriculum standardization. These curriculum guidance indicators denote training based on skills and abilities that contribute to training that meets market demands.</p>

Pre-Service Teachers’ Perceptions of College Tutors’ Use of Student-Centred Approach of Teaching and Learning Mathematics

The study sought to explore pre-service teachers’ perceptions of tutors’ use of student-centred approach of teaching and learning Mathematics in Akatsi College of Education. The study also evaluated pre-service teachers’ learning experiences in relation to their active and passive learning. The study used descriptive survey design. A structured questionnaire was used to collect data from one hundred and ninety-seven pre-service teachers who were purposively sampled for the study. The data collected was analysed using means and standard deviations. The results of the study revealed that College tutors used both student-centred and teacher-centred approaches of teaching Mathematics. In addition, students’ learning experiences could be described as a mixed bag, incorporating both active and passive learning experiences, with most of the pre-services involved in active learning. Consequently, it was recommended that during the development and implementation of the subject course manuals, tutors should be encouraged to use student-centred approach of teaching and learning Mathematics in the Colleges of Education. Also, since stakeholders of Initial Teacher Education programme, made provision for 60% of continuous assessment marks in the implementation National Teacher Education Assessment Policy, tutors no matter the circumstances, should engage pre-service teachers in student-centred Mathematics lessons.

Social Media; Negative Effect on Academic Performance of Secondary School Students In Nigeria

The study sought to explore pre-service teachers’ perceptions of tutors’ use of student-centred approach of teaching and learning Mathematics in Akatsi College of Education. The study also evaluated pre-service teachers’ learning experiences in relation to their active and passive learning. The study used descriptive survey design. A structured questionnaire was used to collect data from one hundred and ninety-seven pre-service teachers who were purposively sampled for the study. The data collected was analysed using means and standard deviations. The results of the study revealed that College tutors used both student-centred and teacher-centred approaches of teaching Mathematics. In addition, students’ learning experiences could be described as a mixed bag, incorporating both active and passive learning experiences, with most of the pre-services involved in active learning. Consequently, it was recommended that during the development and implementation of the subject course manuals, tutors should be encouraged to use student-centred approach of teaching and learning Mathematics in the Colleges of Education. Also, since stakeholders of Initial Teacher Education programme, made provision for 60% of continuous assessment marks in the implementation National Teacher Education Assessment Policy, tutors no matter the circumstances, should engage pre-service teachers in student-centred Mathematics lessons.

The politics of pupil self-evaluation: a case of finnish assessment policy discourse

ABSTRACT Illustrating the rising trend across education systems, the article examines the socio-historical constitution of the politics of pupil self-evaluation in the case of Finnish compulsory education assessment policy discourse. By studying self-evaluation as a ‘politics’, which, drawing on studies in governmentality, engages in the governing and shaping of educational practices, the conduct of teachers and pupils but also in the forming of pupils’ selves, the article challenges the mainstream understanding of self-evaluation as an apolitical technology of learning in pursuit of better learning outcomes, 21th century competencies and lifelong learning. The study uses Finnish compulsory education curricular, legislative and policy documents from 1921 to 2020 as data. In the genealogical reading of data, the rise of the politics of pupil self-evaluation at the interface of discursive formations of assessment as a practice of discipline and truth about the pupil and the practice of self-disclosure and constitution was demonstrated. Consequently, pupil self-evaluation will be consolidated as a normal educational practice. Importantly, implying subjectifying power, a self-regulative and self-evaluative pupil subjectivity in compliance with the requirements of current globalized knowledge economy and evaluation society will be mobilized and called for.

Pre-Service Teachers’ Perceptions of College Tutors’ Use of Student-Centred Approach of Teaching and Learning Mathematics

The study sought to explore pre-service teachers’ perceptions of tutors’ use of student-centred approach of teaching and learning Mathematics in Akatsi College of Education. The study also evaluated pre-service teachers’ learning experiences in relation to their active and passive learning.The study used descriptive survey design. A structured questionnaire was used to collect data from one hundred and ninety-seven pre-service teachers who were purposively sampled for the study. The data collected was analysed using means and standard deviations. The results of the study revealed that College tutors used both student-centred and teacher-centred approaches of teaching Mathematics. In addition, students’ learning experiences could be described as a mixed bag, incorporating both active and passive learning experiences, with most of the pre-services involved in active learning. Consequently, it was recommended that during the development and implementation of the subject course manuals, tutors should be encouraged to use student-centred approach of teaching and learning Mathematics in the Colleges of Education. Also, since stakeholders of Initial Teacher Education programme, made provision for 60% of continuous assessment marks in the implementation National Teacher Education Assessment Policy, tutors no matter the circumstances, should engage pre-service teachers in student-centred Mathematics lessons.

I do it Better: How Social and Emotional Learning Environment Enhances Assessment for Learning Strategies in Science Classrooms

This paper describes part of a more extensive national study on Malaysian teachers’ classroom assessment practices. The main study used a priori coding framework containing four-level performance ratings (i.e., Distinguish, Proficient, Basic, and Unsatisfactory). The findings revealed that a large majority of teachers’ practices were at an unsatisfactory level. Among the 30 science teachers, only two teachers were categorised at the Basic level; the rest were at the unsatisfactory level. The present study used a qualitative approach to compare two teachers at basic and unsatisfactory levels and investigated if teachers’ social and emotional competencies (SEC) affect the implementation of three Assessment for Learning (AfL) strategies. Three video recordings for each teacher were the main source of data. The findings revealed that the teacher with SEC increased student engagement. The research findings have implications on educational assessment policy and, particularly, teacher education programmes to incorporate elements of SEC to improve teachers’ AfL skills.

Exploring educational assessment strategies and policies to reinforce teaching and learning of key competencies

Exploring educational assessment strategies and policies to reinforce teaching and learning of key competencies

Assessment Accommodations for English Language Learners: The Case of Former-LEPs

Within the U.S. public school system, English Language Learners (ELL) represent the fastest growing student population. Many of these students struggle to access grade-level content due to Limited English Proficiency (LEP). Although policy regarding LEP status varies state-to-state, most states impose a short time limit on how long a student can be designated LEP. Consequently, students may lose their LEP status before gaining full proficiency in English. Current policy does not allow for test accommodations for former-LEP students, raising concerns about whether language factors within the tests may prevent students who are not fully proficient in English from successfully accessing the content of the tests. The purpose of this article is to identify education placement and assessment policies that lead to reduced assessment language support for former-LEP students. Using the state of Texas as a case example, we identify potential impact points for former-LEP students who are required to participate in English-only assessments. We then review ELL assessment accommodations literature and propose extension of assessment policies to provide options for former-LEP student population.

Revisiting the governance narrative: The dynamics of developing national educational assessment policy in South Korea

This paper argues that the ‘new governance’ narrative should be revised and modified to reflect context-specific details of the policy sector and styles of government. I discuss the modified network governance narrative, including how the theory of bureaucracy informs the function of network governance. I then apply it to analyze a case study of Korean educational assessment policy, specifically the National Assessment of Educational Achievement, as empirical evidence to support the claim. The case study revealed that central government was a major force in the policy development, and its bureaucratic power combined with soft and hard capital was strong. Responding to central government, opposing groups tried to change the policy by forming networks for collective action, utilizing the media and discovering flexibility within bureaucratic rules, which led to partial changes of the policy in the next regime. The study concludes with several remarks that contribute to policy analysis in education: (a) the usefulness of the modified network governance framework in analyzing policy; (b) bureaucratic structures as useful resources for stakeholders in policy; (c) educational and political beliefs as critical factors in forming and tightening networks; and (d) broader implications for understanding testing policy in Asian contexts.

Conceptions of assessment in students and staff teaching biomedical sciences: a pilot study

ABSTRACT Higher education assessment policies aim to please all, creating confusion for staff and students. This study reports on staff and student conceptions of assessment and the students’ experience of the assessment regime over their Biomedical Science degree. There was a general alignment of staff and students views of assessment for 19 of 27 items on the ‘Conceptions of Assessment’ questionnaire (CoA). Areas of discrepancy were identified in: (i) the use of assessment as institutional quality, students identified this as more important than staff, and (ii) assessment is used for modifying teaching practices, students did not recognise this as an important role. Students experience of the assessment regime over their degree revealed : (i) the excessive quantity of assessment without a clear delineation between formative and summative assessment, (ii) the importance of exams in learning, (iii) dissatisfaction with feedback timing, quality and quantity and (iv) self-reported high use of feedback received. This retrospective study highlights the need for an assessment dialogue between staff and students to reduce student mistrust over assessment and to improve staff–student relationships. Identifying the gap in assessment conceptions may assist staff in understanding student’s behaviour towards their grades, feed- back and the competitive student environment.

Contesting educational assessment policies in Australia

ABSTRACTAssessment is a major component of education, significant in directing what is identified as valued student learning. This paper is framed within an understanding of imperative and exhortative policy. Two paradigmatically different, and potentially contesting, assessment policy directions in Australian education – educational accountability to monitor school and teacher performance, and teacher assessment practices to improve learning (assessment for learning [AfL] or formative assessment) – are examined for their impact on teacher professionalism. Both approaches have official endorsement in Australian policy. Mandated participation in national tests is indicative of educational accountability assessments under national direction. While also endorsed nationally, AfL implementation is reliant on state and territory direction. Our examination reveals tensions in the alignment of both policies. This is evident in the impact of accountability assessment on AfL implementation, in particular, teachers’ understandings of valued assessment evidence. We conclude that a paradigmatic shift to support student learning in Australian schools is a policy imperative that includes the need for professional development and learning support for teachers.

Education Research in the Canadian Context

This special issue of the International Journal of Education Policy & Leadership (IJEPL), Research in the Canadian Context, marks a significant milestone for the journal. Throughout our twelve-year history, we have sought to publish the best research in leadership, policy, and research use, allowing authors to decide the topics by dint of their research. While this model still serves as the foundation for IJEPL content, we decided to give researchers a chance to engage in deeper conversations by introducing special issues. In our first special issue, researchers discuss their work within the scope of education policy, leadership, and research use within the Canadian context. While many aspects of leadership, teaching, and learning can be seen as similar across contexts, there are also issues of particular concern within national, regional, provincial, or local spheres, particularly when looking at policy and system changes. The researchers featured in this issue provide an important look into education in Canada.PolicyIn the policy realm, Sue Winton and Lauren Jervis examine a 22-year campaign to change special education assessment policy in Ontario, examining how discourses dominant in the province enabled the government to leave the issue unresolved for decades. Issues of access and equity play out within a neoliberal context focused on individualism, meritocracy, and the reduced funding of public services. While Winton and Jervis highlight the tension between policy goals and ideological contexts, Jean-Vianney Auclair considers the place of policy dialogues within governmental frames, and the challenge of engaging in broadly applicable work within vertically structured governmental agencies. One often-touted way to move beyondResearch useWithin the scope of research use, Sarah L. Patten examines how socioeconomic status (SES) is defined and measured in Canada, the challenges in defining SES, and potential solutions specific to the Canadian context. In looking at knowledge mobilization, Joelle Rodway considers how formal coaches and informal social networks nserve to connect research, policy, and practice in Ontario’s Child and Youth Mental Health program.LeadershipTurning to leadership, contributing researchers explored the challenges involved in staff development, administrator preparation, and student outcomes. Keith Walker and Benjamin Kutsyuruba explore how educational administrators can support early career teachers to increase retention, and the somewhat haphazard policies and supports in place across Canada to bring administrators and new teachers together. Gregory Rodney MacKinnon, David Young, Sophie Paish, and Sue LeBel look at how one program in Nova Scotia conceptualizes professional growth, instructional leadership, and administrative effectiveness and the emerging needs of administrators to respond to issues of poverty, socioemotional health, and mental health, while also building community. This complex environment may mean expanding leadership preparation to include a broader consideration of well-being and community. Finally, Victoria Handford and Kenneth Leithwood look at the role school leaders play in improving student achievement in British Columbia, and the school district characteristics associated with improving student achievement.Taken together, the research in this special issue touches on many of the challenges in policy development, application, and leadership practice, and the myriad ways that research can be used to address these challenges. We hope you enjoy this first special issue of IJEPL!

Beyond Rhetoric: How Context Influences Education Policy Advocates’ Success

This article discusses findings from a study of a 22-year campaign to change special education assessment policy in Ontario by the advocacy organization People for Education (P4E) and explains how dominant discourses enabled the government to leave the issue unresolved. Based on a rhetorical analysis of 58 documents, the article identifies strategies used by P4E to persuade Ontario’s government and citizens to view students’ uneven access to educational assessments as a problem. Further, since this problem differently impacts children by class and geographical location, it perpetuates inequities. Despite using strategies deemed effective in other change efforts, arguments mobilized by P4E have not been persuasive in a neoliberal context that champions responsibilized individualism, meritocracy, human capital development, and reduced funding of public services.

Incluir, comparar e competir: serviços de avaliação externa em larga escala e inclusão escolar

Em um mesmo contexto escolar coexistem políticas educacionais com diferentes ênfases, como é o caso das políticas de inclusão escolar dos alunos público-alvo da educação especial e as políticas de avaliação externa em larga escala. Nesse trabalho, ao explorarmos dados sobre a utilização de pacotes de serviços privados que envolvem avaliação externa em larga escala para os sistemas de educação municipal no estado de Santa Catarina e sua relação com proposições de educação inclusiva, apresentamos os resultados parciais de duas investigações e damos atenção à utilização desses recursos como mecanismo de tradução das políticas de avaliação da educação e suas implicações para a construção de uma educação inclusiva. Os dados aqui apresentados foram coletados a partir de diferentes fontes de informação como: matérias da mídia local, documentos legais de contratação desses serviços e também contato direto com as prefeituras para identificar a existência desses serviços no município. O paradoxo criado entre propostas que elegem a competição e a comparação como elementos-chave em detrimento do necessário reconhecimento das diferenças entre sujeitos, é um dos focos de reflexão apresentados no texto e são postos em cena para discutir as implicações desses serviços na educação pública municipal.

The (Dis)Connection between Secondary English Education Assessment Policy and Practice: Insights from Bangladesh

Given the instrumental wave of globalization, English language has received a more pragmatic attitude and development interventionist promotion in developing countries including Bangladesh. This attitudinal shift and promotion have also led the policy makers of Bangladesh to revise and develop English education related policies including its curriculum, methods, materials and assessment system. Considering the scope of journal writing, the paper critically presents a policy trajectory study of secondary English education assessment in Bangladesh. This qualitative study was conducted as part of a doctoral project employing content analysis of pertinent policy documents and semi-structured interviews with a set of English curriculum policy implementation stakeholders including teacher trainers, school principals and English teachers. The findings highlighted a clear ‘disconnection’ between the intended English assessment policy directions and the practiced pattern. The analysis of data also indicated that, as a washback of such ‘disconnection’ between policy and practice substantially intercedes the overall quality of secondary English education. By accenting the assessment system as the wire-puller, the paper finally suggested that the strict monitoring of the government would facilitate the extent of proper implementation of secondary English assessment policy in Bangladesh.

New modes of policy legitimation in education: (Mis)using comparative data to effectuate assessment reform

Identifying three modes of policy legitimation in education, illustrated by shifts in Swedish educational assessment and grading policies over the past decades, the paper demonstrates significant trends with regard to national governments’ policymaking and borrowing. We observe a shift away from collaboracy – defined as policy legitimation located in partnerships and networks of stakeholders, researchers and other experts – towards more use of supranational agencies (called agency), such as the Organisation for Economic Co-operation and Development, the European Union and associated networks, as well as the use of individual consultants and private enterprises (called consultancy) to legitimate policy change. Given their political and high-stakes character for stakeholders, assessment and grading policies are suitable areas for investigating strategies and trends for policy legitimation in education. The European Union-affiliated Eurydice network synthesises policy descriptions for the European countries in an online database that is widely used by policymakers. Analysing Eurydice data for assessment and grading policies, the paper discusses functional equivalence of grading policies and validity problems related to the comparison of such policy information. Illuminating the roles of the Swedish Government and a consultant in reviewing and recommending grading policies, the paper discusses new ‘fast policy’ modes of policy legitimation in which comparative data is used to effectuate assessment reform.