Reliability and validity of using structured visual-inspection criteria to interpret latency-based functional analysis outcomes.

Abstract

Prior research has evaluated the reliability and validity of structured visual inspection (SVI) criteria for interpreting functional analysis (FA) outcomes (Hagopian et al., 1997; Roane et al., 2013). We adapted these criteria to meet the unique needs of interpreting latency-based FA outcomes and examined the reliability and validity of applying SVI criteria to 43 previously published latency-based FA datasets. Overall, raters agreed on SVI-determined FA outcomes (98% of functions and 95% of cases) and these outcomes corresponded well to the interpretations provided by the authors of these 43 datasets (94% of functions and 88% of cases), indicating a high degree of reliability and concurrent validity. Our findings suggest that the use of SVI criteria may (a) serve as an objective aid in the identification of behavioral function(s), (b) produce high levels of agreement among expert raters, and (c) serve as a useful resource when teaching students how to interpret latency-based FA outcomes.