When to conduct student evaluation of teaching surveys: before or after the final examination?

Abstract

Student evaluation of teaching (SET) involves numerous conceptual and methodological problems. This paper focuses on a specific methodological dilemma: whether to conduct SET surveys before or after the final examination. This decision is a critical administrative and practical issue that can affect the level and quality of SET results. To address this problem, a systematic literature search was initially performed. However, it found only 17 studies and inconclusive results. In the empirical component, a replication survey (n = 5,077) was conducted. It posed seven course-related questions to the same students before and after their final examination. A slightly higher but statistically significant (p < 0.001) average score was obtained in the after-examination survey (a 0.06 difference on a 1–5 scale). This increase was partly attributed to a positive examination experience. The overall test–retest correlation (r = 0.61) indicated relatively low reliability, suggesting that the before-examination survey better reflected students’ attitudes. The data quality was also higher in the before-examination survey, although the before-examination survey could not properly assess the examination-related aspects of the course. From a methodological perspective, the most comprehensive insight seems to be derived from conducting SET surveys before the examination and following up with a brief after-examination survey.