Beyond self-report surveys: A comparison of methods for directly observing motivationally supportive teaching practices

Abstract

Observational measures of teaching are scarce in the motivation literature, but are needed for furthering theoretical knowledge and recommendations for how teachers can support motivation. To inform the development of effective observational tools, particularly for STEM settings, and based on a synthesis of current practices for observing motivational teaching, video lecture recordings from three undergraduate chemistry classes were observed for evidence of instructors’ supports for students’ motivation, including autonomy support, relevance support, and enthusiasm. Four different coding procedures selected from prior research were compared using interrater reliability estimates and descriptive comparisons of observer scores with student perceptions obtained from surveys. Results indicated that even with minimal coder training, observational measures of relevance support (i.e., connections to real life, support for meaningfulness, relevance statements) and enthusiasm achieved acceptable reliability in capturing motivational teaching that also appeared to align with student perceptions. For other observational measures, results indicated a need for further development including clearer operational definitions, limiting the number of processes observers are expected to simultaneously observe, and perhaps more extensive training for coders. To increase replicability and validity, we call for and contribute to greater transparency in reporting the development and implementation of observational methods for capturing contextual supports for students’ optimal psychological functioning in school.