On the credibility of the judge: A cross-classified multilevel analysis on students’ evaluation of teaching

Abstract

This paper presents the results of an exploratory cross-classified multilevel analysis on students’ evaluation of teaching (SET) in a medium-sized Flemish university. The revalidation of the evaluation questionnaire and the existence of a Global factor, the ‘teacher professionalism’ factor, which accounts for 52% of the variance in 7 (out of 12) SET-scales are discussed. Cross-classified multilevel analysis including student, course, and teacher characteristics shows that at the student level class attendance, students’ age, course grade, and exam period are statistically significant predictors of SET (measured as the score on the teacher professionalism factor). At the course/teacher level, SET scores had a statistically significant association with rank of instructor. However, these indicators explain little variance in SET-scores (PRV is maximum 6.3%). The implications of this study for future SET-research are discussed.