Formative Peer Assessment Research Articles

Effectiveness of AR-Based Formative Peer Assessment on Chinese Writing Performance of Students with Different Cognitive Styles

The ability to communicate effectively in writing and produce clear and cohesive text is a necessary skill in both educational settings and the workplace, yet many young students struggle to organize their thoughts and engage in deep thinking. To address these challenges, an augmented reality (AR) application titled “Explore Wild Animals” has been used to help students organize information; however, it may not accommodate different cognitive styles. Integrating formative peer assessment (FPA) strategy into AR-based instruction can enhance knowledge construction and address diverse cognitive needs. This study, conducted from May to June 2023, empirically investigates the effects of FPA in an AR environment on the writing performance of learners with field-independent (FI) and field-dependent (FD) cognitive styles. A total of 89 fifth-grade pupils from China were randomly assigned to two groups: one group adopting FPA in an AR environment (AR-FPA), and the other group adopting FPA in a conventional PowerPoint (PPT) version 2410 environment (FPA). The results of a two-way analysis of covariance (ANCOVA) indicate that the AR-FPA group outperformed the FPA group in writing performance. Specifically, FI learners benefitted more from the AR-FPA approach, while FD learners performed better with the FPA approach. However, multiple linear regression analysis reveals that the peer feedback quality and features showed little to no significant correlation with feedback providers’ writing performance, regardless of cognitive style. These results highlight the effectiveness of integrating AR and FPA in enhancing educational outcomes, providing practical insights for promoting the sustainability of technology-enhanced learning and teaching practices.

Investigating anonymity in formative and summative peer assessment: Effects on university students’ social-affective factors, perceptions and preference

This study examines the impact of anonymity on students’ social-affective processes, as well as their perceptions and preferences regarding peer assessment and grading for both formative and summative purposes. 177 higher education students participated in this quasi-experimental study. They participated in two peer assessment activities after receiving training on the provision of effective feedback. The first peer assessment activity was formative in nature, while the second was summative. The study had two conditions: anonymous peer assessment and non-anonymous peer assessment. Results indicate that although 73.6 % of all students (90.5 % in the anonymous condition and 56.5 % in the non-anonymous condition) preferred anonymous peer assessment, this preference did not significantly impact perceptions of fairness or peer pressure. This challenges assumptions around the effects of anonymity. Interestingly, non-anonymous settings were still favourably viewed, with the open-ended responses indicating the value of face-to-face dialogue. This suggests that non-anonymous, highly formative peer assessment requiring more interaction may lead to better social and interpersonal outcomes.

How Do We Know It Works? Feedback Loops to Raise the Messy Middle in Online Formative Peer Assessment

Qualitative and then quantitative analysis of student review comments assessing peer review instructions found that students needed even more direction and structure than initially given. Specifically, shorter feedback statements—a twenty-one-to forty-word range—can be useful if they provide both evaluative and suggestive comments to guide revision.

ORGANIZATION AND EVALUATION OF THE EDUCATIONAL PROCESS BASED ON EUTAGOGICAL APPROACHES

The article explores the implementation and assessment of educational practices rooted in eutagogy. Eutagogy, a learner-centered approach to education, emphasizes self-directed learning and individual autonomy. This article examines how eutagogical principles can be applied to organize and evaluate the educational process effectively. It discusses strategies for fostering learner engagement, personalized learning experiences, collaborative activities, and the integration of technology. The article also explores various assessment methods aligned with eutagogy, including formative assessments, authentic assessments, self-assessment, and peer assessment. By adopting eutagogical approaches, educators can create a conducive learning environment that promotes critical thinking, problem-solving, and lifelong learning skills in students.

Formative Peer-Assessment in Oral Presentation Skill: EFL Secondary School Students’ Perception and Its Challenges

Penilaian teman sebaya formatif memiliki peran penting dalam memantau performa belajar peserta didik di kelas. Dalam Kurikulum Merdeka Belajar, penilaian teman sebaya formatif adalah sebuah metode penilaian yang efektif untuk meningkatkan kemampuan kognitif, psikomotor, dan afektif peserta didik. Penelitian ini bertujuan untuk menelusuri persepsi dan tantangan yang dihadapi peserta didik SMP dalam menerapkan penilaian teman sebaya formatif selama kegiatan presentasi lisan. Penelitian ini menggunakan metode kualitatif dan dilakukan dengan melibatkan 5 peserta didik kelas VII di salah satu SMP di Sidoarjo. Data penelitian ini dikumpulkan dengan menggunakan kuesioner terbuka dan sesi wawancara. Sumber data penelitian diambil dari jawaban peserta didik yang ada di kuesioner dan wawancara. Analisis data digunakan sebagai evaluasi dari implementasi penilaian teman sebaya formatif dalam presentasi lisan di tingkat SMP. Penelitian ini menunjukkan bahwa penilaian teman sebaya formatif membantu peserta didik SMP dalam mempersiapkan tugas, fokus selama sesi kegiatan presentasi lisan, meningkatkan kemampuan berpikir kritis dan evaluatif, mengembangkan kepercayaan diri, dan mengenali kelebihan dan kelemahan teman mereka secara mendalam. Di sisi lain, beberapa peserta didik justru mendapatkan keluhan, menemukan kesulitan dalam menentukan nilai, ulasan, dan pertanyaan yang sesuai serta menemukan adanya tindakan kecurangan selama kegiatan penilaian teman sebaya formatif. Selain dari keuntungan dan kerugiannya, penilaian teman sebaya formatif dapat dipertimbangkan sebagai metode penilaian alternatif bagi para peserta didik SMP selama melaksanakan kegiatan presentasi lisan. Diharapkan, penelitian ini dapat dikembangkan oleh peneliti lain di lingkup pendidikan yang lebih luas.

Design and development of an online formative peer assessment environment with instructional scaffolds

Design and development of an online formative peer assessment environment with instructional scaffolds

Effectiveness of online regulation scaffolds on peer feedback provision and uptake: A mixed methods study

Providing quality peer feedback and processing and using the received feedback are cognitively challenging activities of formative peer assessment (FPA) for students. The use of technological tools involving theoretically-grounded instructional scaffolds can be one promising solution to support these activities. Accordingly, this mixed methods research utilized scaffolds in an online environment that can activate self-regulated and co-regulated learning during FPA and investigated their impact on peer feedback provision and uptake. It included 70 ninth-grade students assigned into two groups to perform FPA activities for two writing tasks either with online regulation scaffolds (ORS) or without them. Using a new online FPA environment developed by the authors, they composed a story and poem in the first and second writing tasks, respectively. Results regarding peer feedback provision revealed that feedback in the group using ORS was briefer in two writing tasks, but it had significantly higher quality in the first writing task. In terms of feedback uptake, ORS led to more likelihood of reading peer feedback in the first writing task, but the percentage of students revising their performance was similar independent of ORS. Students’ experiences highlighted the role of feedback requests and goal setting and planning. Besides ORS, qualitative results called attention to the influence of task, learner, and feedback characteristics. Overall, this study concludes that ORS can be beneficial for improving peer feedback provision and uptake, especially in the first FPA practices for complex performance tasks. Moreover, it contributes to the development of the FPA model and guides the instructional design of online FPA environments with empirical evidence.

Teaching Academic Literacies in international relations: towards a pedagogy of practice

ABSTRACT Academic Literacies elucidates how undergraduate students with diverse skillsets can effectively engage with socially constructed and discipline-specific knowledge(s) through writing. Over the last two decades, language specialists and education researchers have developed a robust, student-focused epistemology. However, it remains unclear how lecturers understand and teach Academic Literacies in their courses. This article shifts the focus by exploring how we – a teaching team in International Relations at a Swedish university – translated the knowledge claims and ideological commitments of Academic Literacies into an applied pedagogy. We employ collaborative, reflective practice to investigate how we progressively integrated Academic Literacies in an introductory, bachelor’s level course from 2010–2019. Specifically, we illustrate how we used formative feedback, peer assessment, and reflective journaling to teach International Relations through academic writing. We conclude with a discussion of the best practices and unresolved challenges of our evolving pedagogical design.

Evaluation of a formative peer assessment in research methods teaching using an online platform: A mixed methods pre-post study

BackgroundIn higher education settings, there are increasing calls to shift away from traditional summative assessment practices, such end of term written tests, to explore methods of assessing learning in alternative ways. Peer assessment has been advocated as a means of formative assessment to enhance student engagement, empowering students to take responsibility for their own learning. While there is accumulating evidence for the value of peer assessment in higher education, one cannot assume peer feedback will translate appropriately to all settings and educational contexts. ObjectivesThis study evaluated the implementation of formative online peer assessment in a nursing and midwifery research methods module. We explored students' expectations, experiences, and ultimately the acceptability of this approach. DesignA quantitative descriptive study. SettingIreland. MethodsAn online survey to collate expectations and experiences of engagement in peer assessment. Scales were drawn from previous research and non-parametric tests explored changes in perceptions over time. Qualitative content analysis explored patterns evident in open-text responses. ResultsThe response rate was 28% (n = 74) at baseline and 31% at follow-up (n = 81). Peer assessment was a new experience for 95% of respondents. Students initially expressed apprehension, perceiving the task as daunting, and doubting their ability to provide feedback to peers. However, through providing instruction and tools to support students in the activity, high levels of satisfaction with the process and the experience were reported. Significant differences in perceptions of peer assessment were evident over time, including an enhanced belief that respondents had the requisite skills to appraise the work of their peers. ConclusionsIn sum, nursing and midwifery students agreed that peer assessment was a valuable learning experience as part of research methods training and critical skills development.

Exploring the reliability and its influencing factors of peer assessment in massive open online courses

AbstractAs an innovative evaluation tool, peer assessment is essential in Massive Open Online Courses (MOOCs). In both formative and summative peer assessments in MOOCs, providing reliable feedback is crucial in enhancing learning outcomes. Peer assessment has been highlighted as a reliable tool in both traditional classrooms and small‐scale online learning contexts by a wealth of studies. Factors impacting the result of peer assessment have also been identified. However, such exploration in MOOCs is very limited. Through an examination of 5,722 assignment submissions and 56,794 review scores collected from 18 peer assessments in three courses on Chinese University MOOC platform, this study investigated the inter‐reliability of peer assessment in MOOCs utilizing Krippendorff's alpha and ICC[1]. It also revealed factors affecting peer assessment reliability in MOOCs. The results of this study show that students tended to mark extreme scores, and peer assessment in MOOCs seemed unreliable. In addition, the reliability of the peer assessment in these MOOCs was inversely correlated to the number of reviewers per assignment and reviews completed per reviewer. The assignment type also matters; peer assessment using e‐portfolios format was found more reliable than those using papers and proposals. Suggestions on how to improve the reliability of peer assessments in MOOCs are also provided. Practitioner notesWhat is already known about this topic Both the formative and summative peer assessment mode, providing reliable feedback is needed, which is of great value for improving the quality of online learning. The reliability and influence factors of peer assessment has been highlighted by a wealth of studies in traditional classrooms and small‐scale online learning contexts. There are still limited explorations in MOOCs. What the paper adds The students tended to give extreme scores in peer assessment in MOOC, and the peer assessment in MOOC may was not particularly reliable. The Assignment type being rated affected the reliability, and peer assessment using e‐portfolios format was found more reliable than those using papers and proposals. The reliability of peer assessment in MOOC was negative related to the number of reviewers per assignment and the reviews completed per reviewer. Implications for practice and/or policy Avoid using peer assessment as a summative assessment method, and should be assigned relatively low weights to final grades. Using papers and proposals as learning assignments can appropriately reduce the proportion of peer assessment in the final grade. Training on how to identify medium quality work should be provided. Instructional strategies should be designed to encourage learners to actively participate in peer assessments and thoroughly assess.

Formative peer assessment in higher healthcare education programmes: a scoping review

ObjectivesFormative peer assessment focuses on learning and development of the student learning process. This implies that students are taking responsibility for assessing the work of their peers by giving and...

An Advanced Communication Skills Workshop Using Standardized Patients for Senior Medical Students.

IntroductionMedical students often lack training in advanced communication skills encompassing emotionally fraught situations and those in which an intense emotional response is expected. Such skills are required for clinical situations encountered during residency. We created and evaluated an advanced communication skills workshop (ACSW) using standardized patients for senior medical students. The workshop emphasized communication skills for four scenarios—strong emotion, goals of care, medical error, and palliative care assessment—and utilized formative peer assessment and feedback.MethodsWe created the four ACSW cases with case-specific communication behavior checklists and a common modified Master Interview Rating Scale in a Capstone Course for senior medical students. In groups of three, students rotated through three of four stations. Each student conducted one of the interviews while the other two completed the checklists and provided verbal feedback. We performed one-way analyses of variance on Likert responses and content analysis on open responses on a post-ACSW survey.ResultsNinety-one students completed the ACSW and survey. Students assigned high value to all four ACSW student roles: interviewer, observer, feedback recipient, and feedback provider. Students rated the experience above average to excellent on nearly all survey items. Open-response themes included “liked the opportunity to give or receive peer feedback” (46%) and “found the checklists helpful” (45%).DiscussionFeasible and well received by senior medical students, our ACSW offers an opportunity to practice and observe advanced communication skills and peer feedback. A peer-assisted, formative learning model, the ACSW efficiently addresses a key aspect of residency preparation.

The development of secondary students’ feedback literacy: Peer assessment as an intervention

A growing body of research has recognized the importance of students’ having active roles in feedback processes. Feedback literacy refers to students’ understandings of and participation in feedback processes, and research on students’ feedback literacy has so far focused on higher education; secondary schools have not received attention. This case study investigates secondary students’ feedback literacy and its development in the context of formative peer assessment. From various data sources, three categories of students’ feedback literacy were identified, and criteria for the levels of literacy in each category were created. The criteria were used in the coding of seventh- and eighth-grade students’ skills. The results show that students were able to develop their feedback literacy skills. Thus, secondary school students should be introduced to feedback literacy via, for example, formative peer assessment.

Formative peer assessment to enhance primary school pupils’ oral skills: Comparison of written feedback without discussion or oral feedback during a discussion

In this study, we seek to understand which form of peer assessment is most effective in helping pupils progress in their speaking skills: when the peers discuss the feedback they are giving in subgroups or when they provide it in writing and individually. We also want to analyze what the students say, for what purpose, and what elements of oral communication skills they talk about when they provide feedback. The sample consisted of 42 pupils aged 10–11 years in two conditions (same school): written feedback condition and discussed oral feedback condition. Results indicated that the pupils in the discussed oral feedback condition progressed more than their peers in the written feedback condition. In addition, in the written feedback condition the majority of comments were mainly descriptive observations, with a few prescriptive comments. On the other hand, in the discussed oral feedback condition the comments were mostly suggestions.

Factors That Determine the Perceived Effectiveness of Peer Feedback in Collaborative Learning: a Mixed Methods Design.

Peer assessment has been promoted as a valuable approach to formative assessment to support learning and peer professionalism. This mixed methods study employed a conceptual framework to explore the factors that enhance the perceived effectiveness of formative peer assessment in the context of team-based learning as a form of collaborative learning. The volume and quality of written peer comments of two medical school classes at three time points were analyzed. Focus groups were then conducted to clarify issues that appeared in the quantitative data and to explore other emerging dimensions. There was a notable deficiency in both the volume and quality of the comments provided, with no improvement over time. Several factors were identified, including some that are logistical and operational and can be corrected easily, such as the timing of the assignments. Others that stood out as major substantive issues and/or limitations related to the students' conceptions of the purpose of the peer assessment and to their interpersonal variables. There were social disincentives for students to provide constructive feedback to peers with whom a continuing working relationship is necessary. There was also an inconsistency between the quality of the peer feedback being typically shallow and lacking in substance, and students considering it beneficial. The findings identify factors that need to be addressed in order to ensure the quality and effectiveness of formative peer assessment among medical students.

FORMATIVE ASSESSMENT AS AN ESSENTIAL COMPONENT OF SUCCESSFUL LANGUAGE TEACHING

The article deals with teachers‘ use of language assessment to guide students‘ language proficiency development and academic achievement, the positive benefits of formative assessment for guiding teaching and learning and its characteristics. It is specially noted that language assessment is a purposeful activity that gathers information about students‘ language development. Assessment can be intended to improve teaching and learning or to evaluate the outcomes of teaching and learning. Special attention is given to formative assessment that is described as assessment for learning, in contrast to assessment of learning, i.e. summative assessment. The article focuses on the analysis of formative assessment and its procedures in English classes such as questioning, quizzes, discussions, interviews, role plays, observations, teacher-made tests, checklists, self-reports, journals, projects. Various types of formative assessment, namely self-assessment, peer assessment and alternative assessment are highlighted in the paper. The characteristics of teacher-based assessment that distinguish it from other forms of assessment are described. Teachers assess their students’ learning to determine the effectiveness of their teaching. It should be emphasized that the quality of formative assessment depends on its beneficial uses and value for teaching and learning and teachers‘ judgments and classroom uses of assessments have profound effects on the lives and opportunities of students.

Development of teachers’ perspective on formative peer assessment

ABSTRACT Teachers’ understanding of formative assessment is quite essential for its implementation in everyday classroom practices [Heritage, M. (2007). Formative assessment: What do teachers need to know and do? Phi Delta Kappan, 89(2), 140–145]. This study investigates the development of teachers’ perspective on formative peer assessment when it is newly introduced into their teaching. A group of 18 science teachers participated in design-based research project in which they developed and enacted inquiry-based teaching units with embedded formative peer assessment instances. Teachers’ perspective on formative peer assessment was captured by means of group discussions and reporting tool at different stages of the project (before teaching the experimental units, after having taught the units and 20 months after that). Data were analysed by thematic analysis. The findings show that immersing teachers into this relatively new method, formative peer assessment, especially when they are co-investigating their own practice (in research project), may have significant impact on their conceptualisation and implementation of formative assessment in general.

Investigating the Potentials of Classroom Assessment: A Critical Discussion

Despite gaining currency in the contemporary assessment literature, the depth of the various dimensions of classroom assessment is yet to be explored. This systematic review aims to survey what the current literature reports on the evidence of success of classroom assessment in transforming students towards learning, and it also puts forth a number of implications. The review methodology we adopted includes inclusion/exclusion criteria, identification of the relevant literature, screening articles for the final selection and finally judgment used for the quality of the articles. The search for literature started by the keywords, such as, assessment, summative assessment, formative assessment, formative classroom assessment, and assessment literacy. The search engine and databases we used for the research articles entail Google Scholar, Web of Science, Scopus, JSTOR and ERIC. Considering the reality of the development of knowledge in continuum, we extended the period for literature search from 1989 to 2019 (thirty years). The major themes that surfaced incorporate formative assessment, self- and peer assessment, feedback, reliability and validity, alternative assessment, and assessment literacy. We then critically analyzed the themes and suggested implications.

Peer assessment effects on the self-assessment process of first-year undergraduates

Peers carry potential in enhancing students’ self-assessment development, but few studies have explored how peer scaffolding is enacted in the process. This qualitative study explores peer assessment effects on the self-assessment process of 11 first-year undergraduates and the factors limiting peer influence. Drawing on the data from students’ journals, follow-up interviews, observations of in-class formative peer assessment activities and teacher interviews, we ascertained that peers could aid the self-assessment process by enriching student understanding of quality, refining subjective judgement and deepening self-reflection. Yet, peer influence could be reduced by distrust, tensions in feedback communication, competition and lack of readiness for peer learning. Implications for effective use of peers in supporting self-assessment development are discussed.

Implementation analysis of formative self and peer assessment towards critical thinking skill in junior high school

The change of assessment paradigm from assessment of learning to assessment for learning is an effort to implement formative assessment. Implementation of assessment for learning involves the students to understand and be responsible for their ability, while the teacher acts as their partner that directs the learning process which is integrated with assessment. The formative self and peer assessment provides feedback to direct students to do self-regulation and think criticaly. This study explains that the implementation of formative self and peer assessment has not been optimal so that the results of self-assessment tests of junior high students on critical thinking skills in the average category. Implementation of school learning is based on scientific approach but formative assessment has not been integrated. The critical thinking skills of the students are only supported from the learning process only without scaffolding. Interviews were also conducted with four science teachers indicating that this school has developed a website in the implementation of cognitive and formative assessment, but there is no optimization of the system in it merely to transfer paper media to the website. The availability of media can be an opportunity to present formative self and peer assessment in this school.