Assessing Language in Unstructured Conversation in People With Aphasia: Methods, Psychometric Integrity, Normative Data, and Comparison to a Structured Narrative Task.

Abstract

Purpose This study evaluated interrater reliability (IRR) and test-retest stability (TRTS) of seven linguistic measures (percent correct information units, relevance, subject-verb-[object], complete utterance, grammaticality, referential cohesion, global coherence), and communicative success in unstructured conversation and in a story narrative monologue (SNM) in persons with aphasia (PWAs) and matched participants without aphasia (M-PWoAs). Furthermore, the relationship of language in unstructured conversation and SNM was investigated for these measures. Methods Twenty PWAs and 20 M-PWoAs participated in two unstructured conversations on different days with different speech-language pathologists trained as social conversation partners. An 8- to 12-min segment of each conversation was analyzed. Additionally, a wordless picture book was used to elicit an SNM sample at each visit. Correlational analyses were conducted to address the primary research questions. Normative range and minimal detectable change data were also calculated for the measures in both conditions. Results IRR and TRTS were moderate to good for parametric measures and moderate to excellent for nonparametric measures for both groups, except for TRTS for referential cohesion for the PWAs in conversation. Furthermore, in PWAs, a strong correlation was demonstrated for three of eight measures across conditions. Moderate or weaker correlations were demonstrated for three of eight measures, and correlations for two of eight measures were not significant. An ancillary finding was no significant differences occurred for sample-to-sample variability between the two conditions for any measure. Conclusions This study replicates previous research demonstrating the feasibility to reliably measure language in unstructured conversation in PWAs. Furthermore, this study provides preliminary evidence that language production varies for some measures between unstructured conversation and SNM, contributing to a literature base that demonstrates language variation between different types of monologue. Thus, these findings suggest that inclusion of the specific types of discourse of interest to the PWA may be important for comprehensive assessment of aphasia. Supplemental Material https://doi.org/10.23641/asha.16569360.