Abstract
<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Background:</i> Peer evaluation in software engineering (SE) project courses enhances the learning experience of students. It also helps instructors monitor and assess both teams and individual students. Peer evaluations might influence the way individual students and teams work; therefore, the quality of the peer evaluations should be tracked through the project course. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Contribution:</i> In this article, we analyzed the quality and scoring behavior of students in peer evaluation in an undergraduate SE project course over three years. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Research Questions:</i> RQ1: What is the quality of peer evaluation of undergraduate students in a SE project course? RQ2: How do undergraduate students in an SE project course score each other? <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Methodology:</i> The quality of peer evaluation (length, level of detail, etc.) and scoring of peers based on various aspects of peer evaluations of third-year students in a year-long SE project course were studied. Taking into account the grade students received at the end of the course (A, B, C, and F-calibers), peer evaluations were categorized, analyzed over time, and compared between students calibers. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Findings:</i> After analyzing 6854 peer evaluations from 193 students, it was found that the quality of peer evaluations across students was mostly consistent throughout the course. Also, it was observed that quantitative aspects of the peer evaluation were scored similarly across student calibers. However, the qualitative aspects of the peer evaluation were impacted by the caliber of students. These findings suggest that weaker students (i.e., C-caliber students) generally receive better quality peer evaluations than stronger students (i.e., A-caliber students). Finally, a preliminary analysis showed a positive connotation of emotions and sentiments found in the textual feedback delivered by students.
Highlights
W ORKING efficiently and effectively in teams is part of the engineering profession [1]
Validity: At the end of each sprint, the peer evaluations of a team were assessed by the scrum masters (SM) who was responsible for that team during the sprint
This study contributes to understanding the quality of peer evaluations of students in a software engineering project course
Summary
W ORKING efficiently and effectively in teams is part of the engineering profession [1]. One approach to enhance the learning experience in software engineering group projects is peer evaluation. Does this adds “realism” to a course since peer evaluation that is practiced in the industry (e.g., to determine the performance of team members) and trains students to critically judge others’ work [6]. Students receive feedback from others they work closely with This creates accountability and clarifies expectations within the team [10]. Project courses allow students to learn about technologies, processes, and techniques, and enable them to reflect, self-assess, and self-evaluate [15], [17]. It has been reported to be used as the means for assessing student deliverables, such as game design projects [20] and laboratory reports [21]; individual contributions [7] to the project; and team effectiveness [13]
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
