Development of a Work Sampling Methodology for Behavioral Observations: Application to Teamwork

Abstract

AbstractEngineering programs must assess students' abilities to master “criteria 3 a‐k.” Skills such as teamwork, problem solving, design, and ethical understanding entail learning various processes; hence, assessing these outcomes is better accomplished by focusing on the process rather than the result. Methods for observing students' performance, such as 100 percent behavioral observation, are ideal but expensive.We extend work sampling, an economic industry‐based alternative, to observe cognitive and behavioral processes. Specifically, we describe a work sampling methodology to assess students engaged in teamwork. We then determine attributes of teamwork, establish target time proportions using 100 percent observation, and statistically compare the targets to proportions obtained from work sampling intervals to determine the effective interval. The robustness of work sampling is tested in four learning environments. Results indicate that sampling provides a statistically valid alternative for assessing teamwork. However, when observing design and ethical understanding processes, additional research is needed to make work sampling viable.