Formative peer evaluation instrument for a team-based learning course: Content and construct validity

Abstract

Purpose Team-based learning (TBL) is an evidence-based approach to promote teamwork. Peer evaluation (PE) is an essential component to shape future team engagement and promote reflection. As PEs vary in use, implementation, and assessment, this study establishes the content and construct validity of a formative PE tool for a TBL course. Methods A ten-item instrument was developed based on a comprehensive review of PE literature and was critically edited by a team of experienced educators. Each student in a graduate histology course rated peers at two timepoints on a scale from Never to Always (0–3). The instrument’s factor structure was analyzed by dividing the response set (D1 and D2); with D1 utilized for exploratory factor analysis (EFA) and D2 for confirmatory factor analysis (CFA). Cronbach’s alpha assessed internal consistency. Results Data from 158 students across four cohorts were included in the analyses (D1, D2 = 972). A three-factor solution had good overall internal consistency (alpha = 0.82), and within the subscales ranged from 0.67 to 0.81. The factor structures were resonant with existing literature on (1) preparation, (2) providing feedback, and (3) feedback receptivity and attitude. Conclusion This study establishes evidence of content and construct validity of a formative PE instrument for a TBL course.