Assessment Practices In Education Research Articles

Effects of transcription ability and transcription mode on translation:: Evidence from written compositions, language bursts and pauses when students in grades 4 to 9, with and without persisting dyslexia or dysgraphia, compose by pen or by keyboard.

This study explored the effects of transcription on translation products and processes of adolescent students in grades 4 to 9 with and without persisting specific language disabilities in written language (SLDs—WL). To operationalize transcription ability (handwriting and spelling) and transcription mode (by pen on digital tablet or by standard US keyboard), diagnostic groups contrasting in patterns of transcription ability were compared while composing autobiographical (personal) narratives by handwriting or by keyboarding: Typically developing students (n=15), students with dyslexia (impaired word reading and spelling, n=20), and students with dysgraphia (impaired handwriting, n=19). They were compared on seven outcomes: total words composed, total composing time, words per minute, percent of spelling errors, average length of pauses, average number of pauses per minute, and average length of language bursts. They were also compared on automaticity of transcription modes—writing the alphabet from memory by handwriting or keyboarding (they could look at keys).Mixed ANOVAs yielded main effects for diagnostic group on percent of spelling errors,, words per minute, and length of language burst. Main effects for transcription modes were found for automaticity of writing modes, total words composed, words per minute, and length of language bursts; there were no significant interactions. Regardless of mode, the dyslexia group had more spelling errors, showed a slower rate of composing, and produced shorter language bursts than the typical group. The total number of words, total time composing, words composed per minute, and pauses per minute were greater for keyboarding than handwriting, but length of language bursts was greater for handwriting. Implications of these results for conceptual models of composing and educational assessment practices are discussed.

Ontario’s educational assessment policy and practice: a double-edged sword?

This paper examines assessment policies for K-12 education in Ontario, Canada. We begin with a discussion of Ontario’s education system, and then turn our focus to Ontario’s K-12 assessment policies serving multiple purposes for accountability and classroom learning. We first examine the Educational Quality and Accountability Office (EQAO), which is responsible for Ontario’s province-wide literacy and numeracy assessments by focusing on the nature of its educational stakes, its implications for Ontario’s diverse student populations and its alignment with Ontario’s curriculum. We then turn to Ontario’s policies geared towards classroom-based, teacher-led assessments, such as the Growing Success initiative and the Steps to English Proficiency assessment framework. Together, these policies coexist and function like a double-edged sword for teachers because of conflicting expectations and roles. We conclude with some suggestions for further enhancing Ontario’s assessment policies through the integration of technology and building of teachers’ assessment competencies.

The morphing assessment terrain for English learners in US schools

PurposeThe purpose of this paper is to provide an overview of the public policy reshaping the assessment terrain for English learners (ELs) across the USA and to consider the implications and impact of these practices on sustaining and supporting a diverse student population in today’s schools.Design/methodology/approachThe authors review the literature and publicly available policy documents to trace key policy trends over the past 15 years that have shaped the current educational landscape and assessment practices for ELs in the USA.FindingsIn the USA, the 2015 Common Core State Standards (CCSSs) assessments generated worrisome results for ELs, as significant numbers had failing scores in English language arts and math. These results are juxtaposed to public policies that impact the educational experience of ELs, including No Child Left Behind and the CCSS, and which, despite their stated intentions to ameliorate the achievement gap, are found to be assimilationist in nature. Indeed, a review of the initiatives of developing common EL standards and English language proficiency tests and the recommendations for EL accommodations in state tests suggests several areas of concern. The recently passed Every Student Succeeds Act focuses on this vulnerable population, but there are concerns that the continued focus on accountability and testing will do little to facilitate academic progress for these students.Practical implicationsThe paper recommends a need to reevaluate the support and testing process for ELs to stem widespread failure and ascertain the sustenance of democratic and diversified schools.Originality/valueThe study provides an overview of key policy trends, outlines and critiques recent changes in the assessment of ELs and draws implications for practice.

Too much freedom and autonomy in the enactment of assessment? Assessment in physical education in Ireland

This paper sets out to outline current discussions in Ireland around teachers being responsible for assessing their own students’ work, and the subsequent impact such a perspective is having (or not) on the delivery and assessment of physical education in Ireland. Our intention is to contribute to assessment considerations, while acknowledging the nuances of the Irish education context, and the positioning of physical education within such nuances. This discussion is particularly timely given the very recent endorsement for the introduction of the new Leaving Certificate Physical Education as a full optional subject. We begin by discussing more specifically assessment in Irish primary and post-primary schools, drawing attention to the limited Irish assessment-related research being conducted in both contexts. We then explore assessment developments related to Irish primary physical education and post-primary physical education and compare the extent to which such developments are limited in comparison to international assessment interests and practices in physical education. We conclude with suggestions related to studying (pre-service) teachers’ and students’ exposure to assessment in order to understand how we could alter the balance of assessment purposes and uses in Irish schools.

Translanguaging in a township primary school: Policy and practice

We draw on a translanguaging perspective in this paper to examine teaching in schools where heteroglossic languaging practices in classrooms encounter less fluid language ideologies in educational policy and assessment practices. In an ethnographic-style case study in a Khayelitsha school, the teachers’ languaging in classroom teaching is shown to be fluid, mixing language resources, often in creative and helpful ways. One typical discourse pattern is that of ‘complementary translanguaging’, where resources are meshed without translation from one named language to another. On the other hand, ‘reproductional translanguaging’ also occurs, where meaning is first made using one set of language resources and then made again using another set. We find that teachers apply the language resources at their disposal with some skill to make learners engage with subject content. However, the institutional language ideologies that materialise in the school’s language policy and in testing regimes, turn such skilful language practices from an asset into a relative disadvantage. While aware that they are transgressing the principal’s language policy as well as knowing that their students are struggling with monoglossic examination requirements, teachers continue to translanguage for the pedagogic advantages this brings, despite the rigid, separatist language ideologies that inform school management.

INFORMATION AND COMMUNICATION TECHNOLOGY (ICT) AND ITS ROLE IN EDUCATIONAL ASSESSMENT

This paper identifies the role of ICT in assessment practices in education. The significant factors that schools and teachers should consider include the benefits it can provide to improve and enhance assessment. The primary focus of this paper is: What are the roles ICT can provide to support assessment in education? ICT has several roles and supports in educational assessment practices. This paper empha-sizes its roles in two parts: testing, and tasks. ICT can be used in testing to administer tests, to score the tests, to analyse the result and to facilitate teachers in assessing learning outcomes. Besides, ICT can be integrated in completing student’s task such as portfolio and project-based assessment. ICT provides opportunities for students to create electronic versions of their portfolio. ICT can also support students to complete their project. It is essential for teachers to realise that the rubric used to assess e-portfolios and projects must also assess students’ technology use.

Small data, online learning and assessment practices in higher education: a case study of failure?

In this paper, we present an in-depth case study of a single student who failed an online module which formed part of a master’s programme in Professional Education and Leadership. We use this case study to examine assessment practices in higher education in the online environment. In taking this approach, we go against the current predilection for Big Data which has given rise to ‘learning analytics’, a data-intensive approach to monitoring learning. In particular, we draw attention to the model of the learner produced by learning analytics and to issues of ‘dataveillance’ in online learning. We also use the case to examine assessment in higher education more broadly, exploring the tensions between the requirements for certification and the need for learning. We conclude that assessment practices in higher education may have more to do with ‘quality assurance’ and regulatory frameworks than with ‘enhancing the student experience’ and inculcating the qualities that mark out higher education as an ethical project.

Development of the Arithmetic Subtest of the School Achievement Test-Second Edition

The School Achievement Test (Teste de Desempenho Escolar, TDE) has been widely used in clinical and educational contexts for the past 22 years. Arithmetic disorders are frequent among children and teenagers, requiring new and updated tasks to assess as accurately as possible school achievement. The last decade has witnessed a growing recognition of the need for significant changes in educational assessment practices. Evidence provided by item response theory (IRT) enabled the link of more detailed information improving assessment quality. The aim of this study was to develop a revised and completely updated version of the Arithmetic Subtest for the School Achievement Test-Second Edition (Teste de Desempenho Escolar-Segunda Edicao, TDE-II). To this end, two studies were conducted. The first study focused on item and test construction, while the second study assessed the preliminary version of the instrument. The sample consisted of 302 students in grades 1 through 9 recruited from public and private schools. Factor analysis revealed two factors which explained 74 % of the variance in the data. Both dimensions were closely related to item complexity and difficulty. The subtest was therefore divided into two versions: one for students in grades 1 through 5 and the other for those in grades 6 through 9. Both versions were analyzed based on IRT models, which suggested that the items provided a comprehensive measure of the latent trait. The results provided satisfactory evidence of internal structure and reliability. Results indicated that the Arithmetic Subtest of the TDE-II has adequate psychometric properties for the assessment of arithmetic skills in primary education. Interpretation based on IRT analyses can be helpful for future studies about math education, discriminating even better between learning difficulty and typical groups, with the data to be the basis of math cognition stimulation programs.

Measurement Advances and Challenges in Competency Assessment in Higher Education

Domain‐specific and generic competencies have become target outcomes of students' learning in higher education, and competency assessment plays an increasingly important role in higher education on an international scale. Recent reviews of the literature show that there is still a substantial lack of research on assessment practices in higher education, especially on measurement models and valid instruments for competency assessment. This special issue provides an overview of current international research and innovative developments in this research area, covering a broad range of assessment perspectives, addressing prevalent shortcomings of educational assessment practices, and presenting novel conceptual and methodological approaches from various fields, including cognitive psychology, educational testing methodology, and psychometrics. This special issue is meant to provide new incentives for enhancing competency assessment, and thus, improving instructional practice and student learning outcomes.

Building a Productive Trading Zone in Educational Assessment Research and Practice

Building a Productive Trading Zone in Educational Assessment Research and Practice

An Analysis of State Autism Educational Assessment Practices and Requirements.

States differ in the procedures and criteria used to identify ASD. These differences are likely to impact the prevalence and age of identification for children with ASD. The purpose of the current study was to examine the specific state variations in ASD identification and eligibility criteria requirements. We examined variations by state in autism assessment practices and the proportion of children eligible for special education services under the autism category. Overall, our findings suggest that ASD identification practices vary across states, but most states use federal guidelines, at least in part, to set their requirements. Implications and recommendations for policy and practice are discussed.

English

The paper aimed to explore the self assessment practices in higher education in Bangladesh with special reference to Department of Business Administration of Shahjalal University of Science and Technology. For self assessment purpose the researchers have collected opinion from students, alumni, employer and faculty members on eight areas. In collecting data the study used a semi-structured questionnaire on four point scale . To test the internal consistency the researchers have used Cronbach's (alpha) test of coefficient. The study found that the department is in very weak position almost in all aspects from all assessors. The study suggested to the concerned authority of the department to allocate sufficient fund and logistic facilities for the development of higher education of the department. Key words: Self assessment, higher education, development of higher education.

Talking about the elephant in the room: Improving fundamental assessment practices

This paper reports on an institution-wide strategy to improve first year assessment practices. Assessment is central to the student experience and to informing their developing conceptions of themselves as students. Despite this central importance, much national and international literature raises questions about the fitness-for-purpose of assessment practices in higher education. The reported strategy was developed in response to analysis of student feedback, which suggested, like the literature, substantial opportunity for improvement. Student feedback on their assessment experience was validated by an audit of first session assessment and used to inform the strategy. A significant improvement in quantitative and qualitative measures of student satisfaction across routine data sources is provided to demonstrate impact. This supports a conclusion that the first year student experience can be impacted by the systemic application of a small number of fundamental good practice assessment strategies which are outlined.

A playbill: Rethinking assessment in teacher education

In this article, we use a theatre metaphor, reflected in a prologue, three acts, and an epilogue, to retell and reflect on our journey of inquiring about, designing, enacting, and studying our enactment of non-traditional assessment practices in higher education. We are striving to better align our assessment practices with our beliefs and values about teaching and learning. We discuss how reforming our assessment practices affected issues of equity for our pre-service teachers, such as their participation, identity, power, and agency in our classes. We hope to inspire readers to reflect on how their assessment practices affect students’ learning and sense of agency.

Evaluación del aprendizaje en educación física: relación entre las prácticas evaluativas de los docentes y enfoques de aprendizaje

El presente artículo muestra el resultado de una investigación que indagó sobre las prácticas evaluativas de los docentes de educación física, de los colegios públicos de la localidad de Suba en la ciudad de Bogotá, y la relación de estas prácticas con los enfoques superficial y profundo de aprendizaje. Está organizado en dos apartados, el primero presenta una caracterización de las prácticas evaluativas, y el segundo establece la relación de estas prácticas, con los enfoques superficial y profundo de aprendizaje. Este artículo deriva de una investigación con enfoque metodológico mixto, la muestra estuvo conformada por 68 docentes, como instrumento de recolección de información se aplicó una encuesta y su análisis se realizó utilizando el software estadístico R. Los resultados muestran el objeto, las finalidades, los procedimientos y los modos en que los docentes desarrollan su práctica evaluativa en educación física, y evidencian una tendencia hacia la promoción de aprendizaje profundo.

Assessment in higher education: drivers, barriers and directions for change in the UK

Assessment is fundamental to student learning and achievement. However, whilst research consistently emphasises the role of assessment in supporting the development of the learner, the reality of assessment processes and practices in higher education is frequently indicated to fall someway short. This article aims to contribute to a shared understanding of the discourse surrounding assessment in higher education in the UK, and presents a synopsis of the role of assessment in curriculum change. Key drivers for change, the inhibitory role of the dominant discourse of assessment and suggestions for future development towards an assessment for learning culture, are considered as a means of giving greater prioritisation to assessment than is currently afforded.

A cross-cultural study of students’ perceptions of assessment practices in higher education

Purpose – This study aims to utilized the item response theory (IRT) rating scale model to analyze students’ perceptions of assessment practices in two universities: one in Jordan and the other in the USA. The sample of the study consisted of 506 university students selected from both universities. Results show that the two universities still focus on paper-pencil testing to assess students’ learning outcomes. The study recommends that higher education institutes should encourage their teachers to use different assessment methods to assess students’ learning outcomes. Design/methodology/approach – The convenience sample consisted of 506 selected university students from the USA and Jordan, and participants were distributed according to their educational levels, thus: 83 freshmen, 139 sophomores, 157 juniors and 59 seniors. (Note: some students from both universities did not report their gender and/or their educational level). The USA university sample consisted of 219 students from three colleges at a major university in the southeast of the USA studying for arts and sciences, education and commerce and business qualifications, of whom 43 were males and 173 were females. The study used the Students Perception of Assessment Practices Inventory developed by Alquraan (2007), and for the purpose of this study, the RUMM2020 program was used for its rating scale model. Findings – Both universities, in Jordan and the USA, still focus more on the developmental (construction of assessment tasks), organizational and planning aspects of assessment processes than they do on assessments of learning and assessment methods (traditional and new assessment methods). The assessment practices that are used frequently in both universities based on the teachers sampled are: “(I27) I know what to study for the test in this class”, “(I6) Teacher provides a good environment during test administration” and “(I21) My teacher avoids interrupting students as they are taking tests”. This indicates that teachers in the selected universities have a tendency to focus on the administrative and communicative aspects of assessment (e.g. providing a good environment during test administration) more than on using different assessment methods (e.g. portfolios, new technology, computers, peer and self-assessment) or even using assessment practices that help students learn in different ways (e.g. assessing students’ prior knowledge and providing written feedback on the graded tests). Originality/value – This is a cross-cultural study focus assessment of students learning in higher education.

Examining the utility of Assessment Literacy Inventory and its portability to education systems in the Asia Pacific region

Teachers use assessment to ascertain and enhance student learning, thus the importance of assessment literacy. One of the instruments that has been used to examine teachers’ assessment literacy is the Assessment Literacy Inventory developed by Mertler and Campbell. The Assessment Literacy Inventory has been validated using pre-service teachers and employing traditional statistical techniques. This study reports on the evaluation of the Assessment Literacy Inventory utility using 582 in-service teachers through employing the Rasch model and confirmatory factor analysis. The results indicate that the Assessment Literacy Inventory works well at the item level. However, the Assessment Literacy Inventory seven-factor structure, based on the Standards for Teacher Competence in Educational Assessment of Students, poses challenges against newer psychometric techniques. Hence, recommendations are presented. This article concludes with relevant implications for instrument development, educational assessment research, policy and practice, and teachers’ professional development.

Educational Assessment Profile of Teachers in the Sultanate of Oman

This study builds on a previous pilot study conducted by Alkharusi, Aldhafri, Alnabhani, and Alkalbani (2012) to explore educational assessment attitudes, competence, knowledge, and practices of in-service teachers in the Sultanate of Oman. The present study extends the previous pilot study by surveying a larger sample of in-serivce teachers teaching grades 5 to 12 in all educational governorates in the Sultanate of Oman as opposed to 165 in-service teachers teaching grades 5 to 10 in one educational governorate. Specifically, the study aimed at developing a profile of educational assessment attitudes, competence, knowledge, and practices for teachers in the Sultanate of Oman. The profile was developed as a function of teachers’ gender, nationality, educational governorate, teaching grade, qualification, teaching subject, pre-service assessment training, in-service assessment training, teaching load, and teaching experience. The study employed a descriptive survey research design. Participants were 3557 in-service teachers teaching various subject areas in grades 5 to 12 randomly selected from all educational governorates in the Sultanate of Oman. Confirming Alkharusi et al. (2012) study, findings of the current study showed that the teachers tended to have a positive attitude towards educational assessment. Despite their perception as being competent in educational assessment, they demonstrated a low level of the educational assessment knowledge. Further, the teachers indicated using different classroom assessments mainly for grading and increasing students’ desire for learning. Teaching load and teaching experience explained some of the differences in the teachers’ educational assessment profile. Also, the educational assessment profile varied as a function of the selected demographic and background variables. The findings pointed to a conclusion that professional educational assessment programs for teachers should be continued and tailored to the needs and nature of the teachers’ classroom realities. Future research is needed to judge the validity of the teachers’ self-report surveys concerning educational assessment.

Assessment Practices in Higher Education in United States

This study is an attempt to analyse the assessment practices among students and lecturers in an institute of higher learning (IHL) in the United States. The sample population comprised 170 undergraduate and postgraduate students and 22 lecturers from an identified School of Education. Questionnaires using a 6 point Likert-scale were administered to all respondents whilst interviews were conducted with 5 undergraduates, 5 postgraduates and 5 instructors. Descriptive analysis indicated that assessment practices (dimensions or overall) recorded above moderate level in higher education. Interestingly, students in the IHL favoured formative assessment over final examination. Besides that, students also expressed a positive response to receiving more constructive feedback from lecturers to help them to learn better. Generally, students” preference for feedback coincided with the concepts of formative assessment. This should augur well especially in laying the foundation for more specific action to further improve assessment practices in higher education in the United States as well as other universities which aspire to become exemplary universities.