Situational engagement experiences: Measurement options and theory testing

Abstract

We applied Cronbach and Meehl’s construct-validation process through nomological nets to evaluate true score theory and magnitude scaling approaches to measurement of situational engagement. Situational engagement was defined as an immediate subjective experience in which an unfolding narrative is occurring (e.g., spectator experiences at sporting events, artistic performances, and heritage interpretation). Nine hundred eighty-two adults watched one of six videos featuring a story being told. Each video represented a unique combination of two presumed causes of engagement: coherence (high vs. low) and self-relevance (self-affirmation, provocation, no self-relevance). Participants completed measures of engagement constructed through two true score theory procedures (classical test theory and the congeneric measurement model) and through magnitude scaling (sensory evaluation). Hypotheses from the nomological net were supported. Magnitude scaling produced stronger evidence of validity. The true score theory measures exhibited weak relations with provocation.