Pragmatic Language and Social Communication Tests for Students Aged 8–18 Years: A Review of Test Accuracy

Abstract

Purpose The accuracy of commercially available pragmatic language and social communication tests was reviewed. Method Online sources were searched to identify tests providing stand-alone pragmatic or social communication scores. Test manuals were examined to extract information about clinical and typically developing group comparisons, including sample size, inclusionary/exclusionary criteria, and mean group differences. Classification accuracy metrics, including sensitivity, specificity, optimal cut scores, and likelihood ratios, were reviewed. Results Six domain-specific pragmatic language and social communication tests and four omnibus language tests were identified. Test content varied and included video and audio recordings and question-and-answer formats to address hypothetical social vignettes, retell and comprehend narratives, interpret nonliteral language and multiple-meaning words, identify and display emotions, and infer another's perspective. Sample size and inclusionary/exclusionary criteria for comparisons of students with typical development (TD), developmental language disorder (DLD), autism spectrum disorder (ASD), and social (pragmatic) communication disorder (SPCD) varied widely. Mean group differences between TD and ASD or SPCD groups were generally larger (i.e., > 0.5 SD to > 2.0 SD s) than TD and DLD comparisons. Test authors interpreted these results as support for the accuracy of tests to identify deficits associated with ASD and SPCD and not DLD. Classification accuracy was reported for five domain-specific tests. Optimal cut scores ranged from 85 to 92, with adequate sensitivity and specificity (i.e., ≥ 80%); however, positive likelihood ratios and associated confidence intervals revealed limited confidence in reported levels. Conclusions Inadequate sample description for comparison and classification studies limit a clinician's ability to compare a student's profile with those in the samples. Although none of the tests meet all standards for test accuracy reviewed in this report, a checklist to guide test selection is provided to assist in identifying the best available test for a student's profile, if a test is needed.