Diversifying methods in educational research: what we learned at Winter School

Abstract

ABSTRACTAustralasian Association for Engineering Education (AAEE) has been sponsoring a Winter School in Engineering Education Research Methods since 2011. This paper describes how in 2017 attendees at the School applied what they had learned about a little-used data-gathering technique: observation. Starting with a Program Logic analysis, which identifies what an intervention ought to be doing, and hence what kind of evidence needs to be collected to describe its effect, some participants who had attended prior Winter Schools, were given the chance to collect the evidence. They found observation to be much harder to do well than one would think. This paper describes their experience and argues for the use of observational techniques in order to triangulate our data-gathering methods and improve the quality of our educational research. However, we also learned that a great benefit of observation comes from sustained reflection on the process and the data collected. Without such reflection, we argue observation is likely to produce rather thin results.abbriviations: AAEE - Australasian Association of Engineering Education; JEE - Australasian Journal of Engineering Education; WS2017 - 2017 Winter School