Peer Assessment Research Articles

Is it useful, acceptable, or controllable? Hong Kong primary school teachers’ online assessment practices in changing time

Few studies have explored primary school teachers’ classroom-based online assessment practices and underlying reasons. To fill this research gap, this study interviewed 48 Hong Kong primary school teachers to understand their online assessment practices and influencing factors when they were obliged to use it in their daily instruction under the influence of the COVID-19 pandemic. The findings revealed that the participants tended to use online tests/exercises for formative purposes instead of summative purposes. In addition, they tried online alternative assessment tasks, such as video or audio recordings, peer assessment and projects, and gave online feedback to students but less frequently than online tests/exercises. The school examination culture and the participants’ perceived limited control over online test fairness may have restricted their summative use of online tests/exercises. Meanwhile, the participants’ perceived positive usage norms, along with their favourable attitudes towards and confidence in using online tests/exercises probably enhanced their formative use of them. In addition, the participants’ perceived neutral usage norms and limited external control of online alternative assessment tasks and feedback seemed to impede their use of them in classrooms.

A study of the impact of an interprofessional education module in Vietnam on students' readiness and competencies.

The literature puts forward a range of challenges of interprofessional education (IPE) related to its planning, initiation, implementation, and especially to IPE assessment. The present study aims to map changes in students' readiness and interprofessional collaboration competence (IPCC) in implementing an innovative IPE module. Potential differences in impact related to the health education programs and IPCC scores resulting from self-, peer-, and tutor assessments will also be analysed. A pre-post design was adopted. The student's readiness for interprofessional learning was assessed using the Readiness for Interprofessional Learning Scale, and the student's IPCC score was calculated based on self-, peer-, and tutor assessments with the interprofessional collaborator assessment rubric. Students' mean post-test readiness scores and mean post-test IPCC scores were significantly higher than the total and subscales/domain pre-test scores (p<0.01). No significant within-subject differences were observed in students' readiness total or subscale scores when comparing health educational programs. However, significant differences were observed in students' mean total IPCC scores between programs (p<0.01). Significant differences in students' average IPCC scores were found when comparing self-, peer- and tutor assessment scores in six domains (p<0.01). Also, significant correlations between peer and tutor assessment scores were observed (p<0.01). The IPE module, designed and implemented to focus on patient-centred practice within a primary care context, positively impacted students' readiness and IPCC development. These results offer insights to expand the implementation of the IPE module to all health educational programs.

"The Equipoise Ruler:" A National Survey on Surgeon Judgment about the Value of Surgery.

The objective of this study was to understand professional norms regarding the value of surgery. Agreed-upon professional norms may improve surgical decision making by contextualizing the nature of surgical treatment for patients. However, the extent to which these norms exist among surgeons practicing in the US is not known. We administered a survey with 30 exemplar cases asking surgeons to use their best judgement to place each case on a scale ranging from "Definitely would do this surgery" to "Definitely would not do this surgery." We then asked surgeons to repeat their assessments after providing responses from the first survey. We interviewed respondents to characterize their rationale. We received 580 responses, a response rate of 28.5%. For 19 of 30 cases there was consensus (≥60% agreement) about the value of surgery (range 63% - 99%). There was little within-case variation when the mode was for surgery and more variation when the mode was against surgery or equipoise. Exposure to peer response increased the number of cases with consensus. Women were more likely to endorse a non-operative approach when treatment had high mortality. Specialists were less likely to operate for salvage procedures. Surgeons noted their clinical practice was to withhold judgment and let patients decide despite their assessment. Professional judgment about the value of surgery exists along a continuum. While there is less variation in judgment for cases that are highly beneficial, consensus can be improved by exposure to the assessments of peers.

UNLEASHING HIDDEN POTENTIALS: THE EFFECT OF SELF-RECORDING IN LANGUAGE ASSESSMENT

The purpose of this study was to know the effects of using self-recording in peer and self-assessment in language learning. This mixed-method research design with post-test control groups utilized speaking tests, rubrics, self-assessment checklists, interview guides, and teaching scenarios to collect data. Instrument preparation, validation, and reliability tests were all part of rigorous data-gathering procedures. Using stratified random sampling, participants were divided into control and experimental groups. Each group received different treatment, using self-recording for peer and self-assessment in the experimental group and traditional oral presentations in the control group. Speaking performances by students were recorded for self-and peer assessment, whereas the control group was assessed using a teacher's criteria. The results of the posttest showed that the experimental group fared much better than the control group, demonstrating the superior effectiveness of self-recording in enhancing speaking skill. In addition, the results of the interview confirmed that self-recording is meaningful for self-control, feedback, time-shifted assessment, equity, and fairness. More importantly, the transformative power of self-recording in assessments highlights the critical function of self-recording in strengthening self-regulation abilities. Thus, in educational and assessment contexts, this technique has the potential to unleash hidden self-regulation capacities, resulting in deep personal development and positive transformations.

Project Based Learning Assisted by Peer Assessment to Promote the Students’ Critical Thinking Ability in The Tertiary Level of Education

Project Based Learning Assisted by Peer Assessment to Promote the Students’ Critical Thinking Ability in The Tertiary Level of Education

How Do We Know It Works? Feedback Loops to Raise the Messy Middle in Online Formative Peer Assessment

Qualitative and then quantitative analysis of student review comments assessing peer review instructions found that students needed even more direction and structure than initially given. Specifically, shorter feedback statements—a twenty-one-to forty-word range—can be useful if they provide both evaluative and suggestive comments to guide revision.

Technology-Mediated Peer Assessment in a Course: A Snapshot through the Students’ Lens

Technology-Mediated Peer Assessment in a Course: A Snapshot through the Students’ Lens

Formative Assessment Practices and its Influence on Students’ Learning and Achievement in Biology: Lessons from a Selected Community Secondary School in Moshi, Tanzania

This qualitative study explored current teachers’ formative assessment practices in Biology classrooms and how these practices influence performance in the subject. The study employed a case study design in a single selected community ordinary-level secondary school in Moshi municipality. It purposively involved two Biology teachers and twenty students selected from classes that do not have national examinations. Data were collected through semi-structured interviews with teachers, classroom observations, and focus group discussions with the students, as well as a review of students’ exercise books. The data were transcribed verbatim, then coded and themes generated through interpretive phenomenological analysis. The findings showed that teacher’s oral questioning dominated the assessment practices. Other strategies such as peer assessment, student-student interactions, descriptive feedback, and sharing of learning intentions with students seemed to be unfamiliar to the Biology teachers involved. The study recommends among other things, in-service training for teachers on how to employ alternative formative assessment practices during instruction to promote students’ learning and achievement in Biology.

Sustainable education on improving the quality of peer assessment: design and implementation of an online deep learning-based peer assessment system

PurposeAs global issues such as climate change, economic growth, social equality and the wealth gap are widely discussed, education for sustainable development (ESD) allows every human being to acquire the knowledge, skills, attitudes and values necessary to shape a sustainable future. It also requires participatory teaching and learning methods that motivate and empower learners to change their behavior and take action for sustainable development. Teachers have begun rating pupils based on peer assessment for open evaluation. Peer assessment enables students to transition from passive to active feedback recipients. The assessors improve critical thinking and encourage introspection, resulting in more significant recommendations. However, the quality of peer assessment is variable, resulting in reviewers not recognizing the remarks of other reviewers, therefore the benefits of peer assessment cannot be fulfilled. In the past, researchers frequently employed post-event questionnaires to examine the effects of peer assessment on learning effectiveness, which did not accurately reflect the quality of peer assessment in real time.Design/methodology/approachThis study employs a multi-label model and develops a self-feedback system in order to use the AIOLPA system in the classroom to enhance students' learning efficacy and the validity of peer assessment.FindingsThe research findings indicate that the better peer assessment through the rapid feedback system, for the evaluator, encourages more self-reflection and attempts to provide more ideas, so bringing the peer rating closer to the instructor rating and assisting the evaluator. Improve self-evaluation and critical thinking for the evaluator, peers make suggestions and comments to help improve the work and support the growth of students' learning effectiveness, which can lead to more suggestions and an increase in the work’s quality.Originality/value ESD consequently promotes competencies like critical thinking, imagining future scenarios and making decisions in a collaborative way. This study builds an online peer assessment system with a self-feedback mechanism capable of classifying peer comments, comparing them with scores in a consistent manner and providing prompt feedback to critics.

The implementation of peer assessment as a scaffold during computer-supported collaborative inquiry learning in secondary STEM education

BackgroundComputer-supported collaborative inquiry learning (CSCiL) has been proposed as a successful learning method to foster scientific literacy. This research aims to bridge the knowledge gap surrounding the role of peers as scaffolding sources in CSCiL environments. The primary objective is to explicitly implement peer assessment as a scaffolding tool to enhance students' inquiry output in terms of research question, data, and conclusion. Additionally, students’ perceptions of peer assessment within CSCiL are explored.ResultsThe study involved 9th and 10th-grade students from 12 schools (N = 382), exploring the effects of peer assessment with and without peer dialogue. The results highlight that while adjustments were more frequently made to the research question and data, adjustments to the conclusion showed significantly greater improvement. Furthermore, students’ perceptions of peer assessment during CSCiL were examined, revealing that students generally perceive peer assessment as fair and useful, and they accept it while being willing to make improvements based on the feedback. While students did not report experiencing negative feelings, they also did not report positive emotions from the process. Additionally, the study found that including a peer dialogue in the peer assessment process did not significantly impact the abovementioned findings.ConclusionsThis study enriches our understanding of peer assessment as a scaffolding tool in CSCiL, highlighting its potential to improve inquiry outputs and providing valuable insights for instructional design and implementation.

Student and Instructor Ratings in Geographic Information Systems: A Comparative Analysis

Geographic information system (GIS) education empowers engineering students to make informed decisions, integrate comprehensive data, and communicate effectively through maps and visualizations. In GIS education, it is common to employ problem-based learning, which can benefit from the advantages of peer assessment methods. Among the benefits of peer assessment are the enhancement of students’ capacity for analysis and synthesis, improvement in organizational and professional communication skills, and the development of critical judgement. However, a consequence of its application is that there may be variation in students’ final grades, with no consensus in the literature on this matter. This paper explores the extent to which the application of peer ratings among students can modify student grades in the field of GIS education. This was achieved by conducting an experiment in which undergraduate engineering students assessed two problem-based learning activities carried out by their peers in two different basic GIS courses. The ratings obtained after the peer assessment were compared with the grades given by the instructors. The results allowed us to debate whether the teaching benefits of this strategy compensate for the differences between the students’ grades and those given by instructors. Although no clear pattern was found in the mean ratings awarded by the two groups of evaluators, the results show that student engagement in peer assessment was high. This experience has demonstrated that the assessments of the two groups complement each other and allow students to gain a better understanding of their ratings and how to improve their skills.

I do and I understand: A virtual reality-supported collaborative design-assessing activity for EFL students

Instead of learning in a passive learning mode or aimlessly exploring VR scenarios, a collaborative design-based VR learning environment has great potential for developing classrooms. Through personal knowledge construction in a collaborative design-based learning (CDBL) environment, this study combines CDBL and VR technology to motivate students to build VR projects and practice speaking English in rich contexts through learning by design; students gradually generate knowledge from design experience and sufficient practice. Peer assessment was further introduced to enhance timely evaluation and reflection. Therefore, this study proposed a VR-supported collaborative design-assessing activity. 113 Chinese seventh-graders participated in a quasi-experiment to evaluate the effectiveness of this method. Compared to the collaborative design-assessing (CDA) activity, the results demonstrated that students in the VR-supported collaborative design-assessing (VR-CDA) activity greatly enhanced their English-speaking performance, collaboration tendency, and critical thinking awareness while lowering their English learning anxiety. In contrast to the VR-supported collaborative design (VR-CD) activity, however, the VR-CDA group activity did not significantly improve students’ English-speaking performance. The interview results proved that the students in the VR-CDA group were highly motivated to learn English because of the innovative classroom instruction. They also enjoyed designing the projects collaboratively, posting assessments, and self-reflection.

EVALUATION OF THE EFFECTIVENESS OF GROUP COOPERATION IN THE CONTEXT OF PROBLEM BASE LEARNING (PBL): A MIXED METHOD APPROACH

This study uses a mixed-methods approach to evaluate the effectiveness of group collaboration in a Problem-Based Learning (PBL) context. The study integrates qualitative and quantitative analyses to understand the dynamics of group collaboration and its impact on learning outcomes. The sample consisted of 98 students involved in a semester-long PBL course. The researcher collected Quantitative data through self-assessment and peer assessment scales, while qualitative data came from in-depth interviews and analysis of group reflections. The results showed a significant correlation between group cooperation effectiveness and learning outcome achievement, with positive interaction and effective conflict management as critical factors in improving group performance. Qualitative analysis revealed that effective communication, shared leadership, and equitable task distribution enhanced group synergy. The findings provide new insights into the importance of developing collaborative skills in PBL and suggest the need for educational interventions designed to enhance group cooperation abilities. This study contributes to the PBL literature by providing empirical evidence on the effectiveness of group cooperation and its implications for teaching and learning.

ORGANIZATION AND EVALUATION OF THE EDUCATIONAL PROCESS BASED ON EUTAGOGICAL APPROACHES

The article explores the implementation and assessment of educational practices rooted in eutagogy. Eutagogy, a learner-centered approach to education, emphasizes self-directed learning and individual autonomy. This article examines how eutagogical principles can be applied to organize and evaluate the educational process effectively. It discusses strategies for fostering learner engagement, personalized learning experiences, collaborative activities, and the integration of technology. The article also explores various assessment methods aligned with eutagogy, including formative assessments, authentic assessments, self-assessment, and peer assessment. By adopting eutagogical approaches, educators can create a conducive learning environment that promotes critical thinking, problem-solving, and lifelong learning skills in students.

Peer assessment in medical communication skills training in programmatic assessment: A qualitative study examining faculty and student perceptions

Introduction Current literature recommends assessment of communication skills in medical education combining different settings and multiple observers. There is still a gap in understanding about whether and how peers assessment facilitates learning in communication skills training. Methods We designed a qualitative study using focus group interviews and thematic analysis, in a medical course in the Netherlands. We aimed to explore medical students’ and teachers’ experiences, perceptions, and perspectives about challenges and facilitating factors in PACST (Peer assessment in medical communication skills training). Results Most of the participants reported that peer feedback was a valuable experience when learning communication skills. The major challenges for the quality and credibility of PACST reported by the participants are the question whether peer feedback is critical enough for learning and the difficulty of actually engaging students in the assessment process. Conclusion Teachers reviewing students’ peer assessments may improve the quality and their credibility and the reviewed assessments can best be used for learning purposes. We suggest to pay sufficient attention to teachers’ roles in PACST, ensuring a safe and trustworthy environment and additionally helping students to internalize the value of being vulnerable during the evaluation process.

The Merdeka Curriculum Reform on Aspects of Historical Thinking Skills in History Subjects in Senior High Schools

The aims of this research are (1) to plan history learning using the Merdeka curriculum for historical thinking skills, (2) to improve the Merdeka curriculum in relation to aspects of history learning for historical thinking skills, and (3) As an evaluation of history teaching and learning activities based on thinking skills. Merdeka Curriculum Aspects of Historical Thinking Skills in SMA Pasundan 2 Cimahi, Especially in Schools that Implement the Merdeka Curriculum. This research applies qualitative methods with a case study approach. The data sources are informants: teachers, students, documents, curriculum, and historical thinking skills. Research findings show that (1) Merdeka Curriculum history learning planning is carried out by teachers who prepare their own ATP and learning modules; However, one of the schools where he could use KOSP was closed, and the teachers at both schools did not know the whereabouts and contents of his KOSP. (2) Implementation of history learning depends on student performance. There are several learning processes that do not follow learning principles, such as Education modules that are not prepared. PLP students take classes based on a unique curriculum. There are no student teaching evaluations for teachers. There are also monotonous learning methods, less situational learning, and unused social studies books. (3) In evaluating teaching and learning activities, there are several cases where the implementation does not follow the principles of teaching and learning evaluation based on the Merdeka Curriculum. Teaching and learning activities in history classes are not in line with assessment principles. There are no student self-assessments or peer assessments, no in-module assessment rubrics, and no post-test quizzes. However, teachers have tried to adhere to some principles and implement their own curriculum as closely as possible. Implementing the Merdeka Curriculum from the perspective of historical thinking skills in history education can be adapted to the implementation of the Merdeka Curriculum established by the Ministry of Education, Culture, Research and Technology of the Republic of Indonesia.

Tools for self- or peer-assessment of interprofessional competencies of healthcare students: a scoping review.

Healthcare professionals are expected to demonstrate competence in the effective management of chronic disease and long-term health and rehabilitation needs. Care provided by groups of collaborating professionals is currently well recognized as a more effective way to support people living with these conditions than routine, single-profession clinical encounters. Clinical learning contexts provide hands-on opportunities to develop the interprofessional competencies essential for health professional students in training; however, suitable assessment tools are needed to support student attainment of interprofessional competencies with self-assessment espoused as an important component of learning. A structured approach was taken to locate and review existing tools used for the self-assessment and peer assessment of students' competencies relevant to interprofessional practice. A range of self- and/or peer assessment approaches are available, including formally structured tools and less structured processes inclusive of focus groups and reflection. The identified tools will usefully inform discussion regarding interprofessional competency self- and peer assessment options by healthcare students participating in a broad range of clinical learning contexts. Self- and/or peer assessment is a useful approach for those seeking to effectively enhance interprofessional learning and measure the attainment of related competencies.

How to promote students to share more knowledge with peers?

Education experts are trying to encourage students to contribute knowledge among them through online peer assessment so as to enhance the understanding of knowledge. As an online knowledge community, peer assessment will also fail due to the reluctance of students to return the favor and share knowledge. Many studies on this topic have highlighted the importance of contribution of knowledge for students which forms a virtuous feedback loop for the impression of knowledge. However, it is unclear how what influences its development. Motivated by this, this study explored why students contribute knowledge to others through online peer assessment. Empirical panel count data were collected from Peer review platform. The results from a negative binomial regression model with user fixed effects indicate that student’s peer recognition and organization interaction have a positive impact on his knowledge-contribution behaviors. The findings can help guide the development and operation of peer assessment.

Peer Assessment Using Student Co-Designed Rubrics

Peer Assessment Using Student Co-Designed Rubrics

Collaborative Approach to the Spatial Journey- An Experiment in First Year Architectural Design Studio.

Abstract: An architectural design studio is a place for learning, experimentation, and exploration. Design of a built environment has constantly remained a collective activity where the architect, client, structural engineer, surveyor, service contractor, mason, and many others work together for a common goal. In the traditional design studio model, a student is expected to follow a set of design procedures like ideation, conceptualization iteration, and finalization to arrive at the outcome. He is supposed to design a built form based on context, climate, socio-economic parameters, and function using appropriate materials and technology. Often the process becomes a drool if the student is allowed to follow the sequence all alone. He or she may get stuck and lack motivation. But if the studio pedagogy involves discussion and an endeavor to explore rational thinking by adopting learning by doing together which may involve peer group discussion and continuous inputs from faculties, the process becomes much more interesting. A pupil studying architecture needs to cooperate and engage in design studios with his or her classmates and faculty. In addition, the students need to confederate, to achieve the objective of learning in a way that prepares them for the extremely synergistic phenomena of the architectural profession. (Crosbie, 1995; Daniels, 2002).This research aims to understand the effectiveness of design studios that can work in collaboration to refine every partaker’s contribution to the design methodology. The research was supervised as a semester-long exercise that integrated forty-six students from the first-year Architectural Design program, at KLE Technological University, India. The author explored quantitative analysis in the form of rubrics along with qualitative parameters like peer assessment, faculty feedback, and student response in the design process. . Keywords— Collaborative Design Studio; Design Methodology; Traditional Design Studio.