Design and Validation of a University Education Peer Observation Tool

Abstract

Objective: The aim of this study was to design and validate a university education PoT instrument. Theoretical Framework: It has become a priority to implement Peer Observation of Teaching (PoT) in the domain of higher education. There are different PoT approaches, a social credentialism model and a feedback-oriented approach. Method: The Higher Education-PoT (HE-PoT) tool was designed ad hoc following observational methodology principles. The original items were drawn from a systematic review of PoT tools by Otero-Saborido et al. (2024). The procedure consisted of two phases: in the first qualitative phase, items from the tool were selected and circulated within a group of experts; in the second quantitative phase, the items were quantified using the Aiken coefficient Results and Discussion: It was initially based on a systematic review of PoT tools and subsequently subjected to 4 rounds of revisions by Physical Education and Sports Science teaching experts. The final tool consisted of a total of 33 descriptive categories divided into 11 items. The validity of all item contents was calculated using Aiken's coefficient (value equal to 0.75 or above, except for 2 items which scored 0.66) and all categories obtained values above 0.75. A total of 25 of the 33 categories presented values over 0.90. Research Implications: Future works should test the tool reliability so that it can be used to improve teaching following collaborative approaches. Originality/Value: Validated PoT tools are generally lacking in university education. The designed tool includes a number of items that contribute to a sustainable observation for teachers.