Developmental Sentence Scoring Research Articles

Using language sample analyses across English dialects: A case-based approach for preschoolers

ABSTRACT This study compared language samples from typically developing 4-year-olds who spoke African American English (AAE), Jamaican English (JE), or Mainstream American English (MAE) to assess the value of using language sample analysis (LSA) measures for characterising language use across dialects of English. Specific LSA metrics included mean length of utterance (MLU) in morphemes and in words, the Index of Productive Syntax (IPSyn), Developmental Sentence Scoring (DSS) and measures of lexical diversity. Children demonstrated diverse linguistic patterns across dialects, but a Kruskal–Wallis H test did not reveal significant differences in scores obtained through LSA measures. Notably, the IPSyn captured morphosyntactic structures in each category across dialects where prior research has highlighted limitations. This preliminary study uses a case-based approach to illustrate the applicability of LSAs in describing linguistic variations across children who speak different dialects of English. Moreover, the findings from this study underscore the potential use of LSAs in describing linguistic patterns to support the characterisation of communication profiles for culturally and linguistically diverse children.

Language sample analysis of conversation samples from school-age children who stutter: The role of syntactic factors in stuttering

IntroductionThe purpose of the study was to compare school-age children who stutter (CWS) and age-matched children who do not stutter (CWNS) in syntactic abilities and syntactic performance. MethodsComputerized Language Sample Analysis (LSA) was conducted on the conversation samples obtained from 46 school-age CWS and CWNS between 7 and 16 years (CWS, n = 23). Syntactic abilities were assessed using the Index of Productive Syntax (the IPsyn) and Developmental Sentence Scores (DSS) and mixed effects logistic regression analyses with participants as random effects were conducted to determine if the scores were predictive of group membership. Additionally, the groups were compared in the IPsyn subcategories to assess the use of syntactic structures. Syntactic performance was assessed by: (a) Categorizing the sentences from each conversation sample into high vs. low syntactic complexity categories based on DSS scores and comparing the sentence categories in % stuttered sentences (% SS); and (b) Comparing the groups in the proportion of phrase-level disfluencies (phrase repetitions vs. revisions) that are associated with syntactic planning. ResultsIn terms of syntactic abilities, the IPsyn scores interacted with the number of utterances (sample size) used to compute the scores in predicting group membership. In comparison to the CWNS, the CWS obtained higher scores in the IPsyn and the sentence structure subcategory of the IPsyn that were independent of sample size. In terms of syntactic performance: (a) Significantly more sentences were stuttered in the high compared to the low syntactic sentence category; (b) Compared to the CWNS who demonstrated significantly more phrase revisions, the CWS showed comparable and fewer phrase revisions and repetitions. Additionally, post-hoc analysis showed that the CWS used significantly elaborated noun phrases and a similar trend was evident for verb phrase elaborations. A significant association between verb phrase elaborations and%SS was also obtained. ConclusionsFindings from the IPsyn and the use of elaborate noun phrases, and to some extent verb phrases, suggested that the CWS used more complex syntax even in shorter conversational samples. More stuttered sentences in the high DSS sentence category, the use of fewer phrase revisions, and the association between stuttering and elaborated verb phrases in the CWS are interpreted to suggest the effects of syntactic planning and reformulation demands on fluency during ongoing articulation.

The relationship between mean length of utterance (MLU), Persian developmental sentence score (PDSS), and photographic expressive Persian grammar test (PEGT) in typically developing children and those with developmental language disorder (DLD)

Purpose This study investigated the relationship between three practical measures for evaluating Persian grammar expression skills, MLU, PDSS, and PEGT, in preschool children with developmental language disorder (DLD) and their typically developing (TD) peers. Method Secondary data were obtained by re-analyzing language samples collected in previous studies. Previously audiotaped language samples of 25 monolingual 5–7 years-old Persian children with DLD and 25 TD children were transcribed and reanalyzed to calculate MLU in words (MLU-w) and PDSS for comparison with the results of PEGT. Results Children with DLD had lower scores in PEGT, PDSS, and MLU-w than TD children (p < 0.001). In addition, there was a strong correlation between PDSS and MLU-w in both DLD (r = 0.91) and TD groups (r = 0.79). There was a significant correlation between PEGT and MLU (r = 0.76) and PDSS (r = 0.78) in the DLD group, while these correlations were not significant in TD group. Conclusions Considering the positive and significant correlation between MLU, PDSS, and PEGT in children with DLD, the use of PEGT, as a valid, reliable, and accurate test of grammar, which can be implemented quickly and easily, is suggested for clinical purposes of identification and screening of Persian children with DLD.

Assessment and Therapy Goal Planning Using Free Computerized Language Analysis Software.

We discuss a free software system (Computerized Language Analysis [CLAN]) that can enable fast, thorough, and informative language sample analysis (LSA). We describe methods for eliciting, transcribing, analyzing, and interpreting language samples. Using a hypothetical child speaker, we illustrate use KidEval to generate a diagnostic report. Given LSA results suggestive of expressive language delay, we analyze further using CLAN's Developmental Sentence Score and Index of Productive Syntax routines, and outline the child's use of Brown's morphemes. This tutorial provides an introduction to the use of free CLAN software. We discuss how LSA results can be used to structure therapy goals that address specific aspects of grammatical structure that the child may not yet demonstrate in their spoken language. Finally, we provide answers to common questions, including user support.

The Adaptation of Developmental Sentence Scoring and Index of Productive Syntax to Turkish.

Language sampling analysis (LSA) plays an important role in evaluating language skills; hence, the study aimed to develop new assessment measures for the LSA in Turkish as alternatives to mean length of utterance (MLU) and the Language Assessment, Remediation and Screening Procedure. With this aim, Developmental Sentence Scoring (DSS) and the Index of Productive Syntax (IPSyn) were adapted to Turkish. Eighty monolingual Turkish children were included in the study, and the age range was from 2;0 to 5;11 (years;months). The children were grouped with 6-month intervals, and each group had an equal number of participants in terms of gender. Their general and language development were tested with standardized tests, and language sampling was recorded during play with farm toys for 15-20 min. Reviewing literature and observing participants' production schemas were created for DSS for Turkish (DSS-TR) and the IPSyn for Turkish (IPSyn-TR) separately, and final versions were determined in consultation with experts. DSS-TR and IPSyn-TR were significantly correlated with standardized tests, and MLU values were statistically significant (p < .05). Total scores increased with age; however, grammatical categories did not go up. No difference was observed between genders (p > .05). In DSS-TR, the "sentence point" did not affect the participants' total scores because of language characteristics (p > .05). Finally, DSS-TR and IPSyn-TR were seen to be correlated with each other (p < .05). DSS-TR and IPSyn-TR are valid, being correlated with other assessment tools, and reliable, showing a high correlation with other raters, to reflect morphosyntactic skills. Therefore, they both are alternative assessment measures that will be used in LSA and give an opportunity to clinicians to plan their intervention goals. Also, they enable clinicians to observe progress not only specific to grammatical category but also in the total scores of the children either during or at the end of the therapy.

Effect of grammar intervention on vocabulary skills in children with a cochlear implant: A single-subject study.

Background: Previous studies have shown that children with cochlear implants have difficulty in grammar acquisition. Vocabulary acquisition and grammar abilities are important during language development. The purpose of this study was to investigate the effect of grammar therapy on the lexical ability of cochlear implanted children. Methods: Five children with cochlear implants and grammatical problems were treated using a grammar task designed for the current study. Before and after the treatment, repeated evaluations were performed using the Mean Length of Utterance (MLU) and Persian Developmental Sentence Scoring (PDSS) indices for grammar and NDW and NTW indices for vocabulary abilities; these show the number of different words and the number of total words respectively. Results: Grammar intervention was successful in cochlear implanted children of the present study. In addition, treatment of grammatical problems increased the lexical ability of all children; NDW and NTW scores increased, which was confirmed by the effect size indices. In the follow-up phase, the cochlear implanted children were able to maintain the increase in NTW and NDW values. Conclusion: Improving grammar skills in cochlear implanted children also increased their lexical ability. Therefore, grammar therapy helps to increase the vocabulary of children too.

Tracking Child Language Development With Neural Network Language Models

Recent work on the application of neural networks to language modeling has shown that models based on certain neural architectures can capture syntactic information from utterances and sentences even when not given an explicitly syntactic objective. We examine whether a fully data-driven model of language development that uses a recurrent neural network encoder for utterances can track how child language utterances change over the course of language development in a way that is comparable to what is achieved using established language assessment metrics that use language-specific information carefully designed by experts. Given only transcripts of child language utterances from the CHILDES Database and no pre-specified information about language, our model captures not just the structural characteristics of child language utterances, but how these structures reflect language development over time. We establish an evaluation methodology with which we can examine how well our model tracks language development compared to three known approaches: Mean Length of Utterance, the Developmental Sentence Score, and the Index of Productive Syntax. We discuss the applicability of our model to data-driven assessment of child language development, including how a fully data-driven approach supports the possibility of increased research in multilingual and cross-lingual issues.

Language Sample Analysis in Children With Cleft Lip and Palate

Objectives: Cleft Palate (CP) with or without Cleft Lip (CL/P) are the most common craniofacial birth defects. Cleft Lip and Palate (CLP) can affect children’s communication skills. The present study aimed to evaluate language production skills concerning morphology and syntax (morphosyntactic) in children with CLP. Methods: In the current cross-sectional study, 58 Persian-speaking children (28 children with CLP &amp; 30 children without craniofacial anomalies=non-clefts) participated. Gathering the language samples of the children was conducted using the picture description method. The 50 consecutive intelligible utterances of children were analyzed by the Persian Developmental Sentence Scoring (PDSS), as a clinical morphosyntactic measurement tool. Results: The PDSS total scores of children with CLP were lower than those of the non-clefts children. A significant difference was found between the studied children with CLP and children without craniofacial anomalies in the mean value of PDSS total scores (P=0.0001). Discussion: Children with CLP demonstrate a poor ability for using morphosyntactic elements. Therefore, it should be considered how children with CLP use the grammatical components.

Using Free Computer-Assisted Language Sample Analysis to Evaluate and Set Treatment Goals for Children Who Speak African American English.

Purpose Spoken language sample analysis (LSA) is widely considered to be a critical component of assessment for child language disorders. It is our best window into a preschool child's everyday expressive communicative skills. However, historically, the process can be cumbersome, and reference values against which LSA findings can be "benchmarked" are based on surprisingly little data. Moreover, current LSA protocols potentially disadvantage speakers of nonmainstream English varieties, such as African American English (AAE), blurring the line between language difference and disorder. Method We provide a tutorial on the use of free software (Computerized Language Analysis [CLAN]) enabled by the ongoing National Institute on Deafness and Other Communication Disorders-funded "Child Language Assessment Project." CLAN harnesses the advanced computational power of the Child Language Data Exchange System archive (www.childes.talkbank.org), with an aim to develop and test fine-grained and potentially language variety-sensitive benchmarks for a range of LSA measures. Using retrospective analysis of data from AAE-speaking children, we demonstrate how CLAN LSA can facilitate dialect-fair assessment and therapy goal setting. Results Using data originally collected to norm the Diagnostic Evaluation of Language Variation, we suggest that Developmental Sentence Scoring does not appear to bias against children who speak AAE but does identify children who have language impairment (LI). Other LSA measure scores were depressed in the group of AAE-speaking children with LI but did not consistently differentiate individual children as LI. Furthermore, CLAN software permits rapid, in-depth analysis using Developmental Sentence Scoring and the Index of Productive Syntax that can identify potential intervention targets for children with developmental language disorder.

Using Computerized Language Analysis to Evaluate Grammatical Skills.

Purpose Conducting in-depth grammatical analyses based on language samples can be time consuming. Developmental Sentence Scoring (DSS) and the Index of Productive Syntax (IPSyn) analyses provide detailed information regarding the grammatical profiles of children and can be conducted using free computer-based software. Here, we provide a tutorial to support clinicians' use of computer-based analyses to aid diagnosis and develop and monitor treatment goals. Method We analyzed language samples of a 5-year-old with developmental language disorder and an adolescent with Down syndrome using computer-based software, Computerized Language Analysis. We focused on DSS and IPSyn analyses. The tutorial includes step-by-step procedures for conducting the analyses. We also illustrate how the analyses may be used to assist in diagnosis, develop treatment goals focused on grammatical targets, and monitor progress on these treatment goals. Conclusion Clinicians should consider using Computerized Language Analysis's IPSyn and DSS analyses to support grammatical language assessments used to aid diagnosis, develop treatment goals, and monitor progress on these treatment goals. Supplemental Material https://doi.org/10.23641/asha.12021141.

Language therapy outcomes in deaf children with cochlear implant using a new developed program: A pilot study

BackgroundCochlear implanted (CI) children have problems in most aspects of language and in particular with regards to grammar. Considering the lack of studies in the field of grammar treatment in CI children and bearing in the mind that CI children have the potential to develop language, the aim of the present study was to investigate the effect of treating grammar in CI children using a treatment grammar program. Methodologyfirst, the literature related to grammar were reviewed so as to extract different grammatical components for developing grammar treatment program and to make sentences for each element as well as to compile a manual for its implementation. Second, the validity of the sentences was examined using the Delphi method. Third, grammar treatment was performed on five CI children. Persian Developmental Sentence Scoring(PDSS) and Mean Length of Utterance(MLU) were used to evaluate them before and after treatment. ResultsFive grammatical classes were extracted, and the grammatical elements were classified in each category according to age. For all of the grammatical items, 2076 sentences were constructed. After applying the Delphi method, a total of 1936 sentences with Kendall's coefficient of concordance (W) of 71%, remained. Using this program, grammar treatment was effective in all five children. The PDSS and MLU increased in all five children during the treatment phase, which was confirmed by Percentage of Non-overlapping Data (PND), Improvement Rate Difference (IRD). During the follow-up period, the children showed that they were able to maintain the trained components. ConclusionCochlear implants have the potential to learn language skills, and the present study confirms their ability to learn grammar, using a comprehensive grammar treatment program.

Sentence Structure Analysis in Patients with Ischemic Stroke

Introduction. The definition of brain health and the best method of promoting optimal brain health is an American Heart Association/American Stroke Association initiative. Intact cognitive function is important following an ischemic stroke for successful rehabilitation. Therefore having a simple metric of cognitive function would be optimal for all health professionals.Aim. The aim of this study was to investigate if using Developmental Sentence Scoring (DSS) on sentences written by patients on a Mini-Mental State Examination (MMSE) could provide a simple metric of cognitive function.Material and Methods. This secondary analysis reports on sentences written by patients after an ischemic stroke using quantitative and conventional content analysis methods.Results. A mean score of 24.38 (SD±13, range 9–30) was found in the 76 patients who had written something in the course of the Folstein MMSE. The number of words ranged from 1 to 16 with the greatest number (21) averaging 5 words. The DSS ranged from 0–11 with a mean of 4. The mean Folstein MMSE (N=30), was 27.53 (SD±2.74, range 18–30) in patients who consented to a home visit 3 years after their stroke. Twenty seven of the 30 patients had written something and the number of words ranged from 1 to 12 with the greatest number (10) averaging 5 words. The DSS ranged from 0–12 with a mean of 4. Conventional content analysis revealed an overarching pattern articulated in two ways: (1) Awareness of recent space and time and remote memories of people and place (2) Expression of the self as person.Conclusions. This secondary analysis provides normative data and a rich description of cognitive function in a group of individuals describing the DSS at baseline and again at 3 years after stroke but the sample was too small to be able to provide a simple metric of cognitive function. (JNNN 2018;7(4):140–144)

A comparison of morpho-syntactic abilities in deaf children with cochlear implant and 5-year-old normal-hearing children

IntroductionChildren with cochlear implants (CIs) have problems in morpho-syntactic abilities more than other language skills. The current study was aimed to evaluate the language samples of children with CIs by using a numerical measurement tool, Persian developmental sentence scoring (PDSS). MethodIn this cross-sectional, descriptive, analytical study, 33 children (22 children with CIs and 11 with normal hearing) were recruited. Language samples of the children were recorded during the description of pictures. The PDSS was used as a reliable numerical measurement tool for analyzing the first 100 consecutive intelligible utterances. ResultsWe found a significant difference in the mean PDSS total scores (p = 0.0001) between the normal-hearing children and deaf children using CIs for 5 years. Similarly, the results revealed a significant difference in the mean PDSS total scores (p = 0.0001) between the normal-hearing children and 5-year-old deaf children with CIs. There was no significant difference in the mean PDSS total scores between the two groups of children with CIs. ConclusionChildren with CIs can form simple sentences but probably exhibit poor abilities for using complex sentences and essential morphology items.

Assessing the impact of conversational overlap in content on child language growth.

When engaged in conversation, both parents and children tend to re-use words that their partner has just said. This study explored whether proportions of maternal and/or child utterances that overlapped in content with what their partner had just said contributed to growth in mean length of utterance (MLU), developmental sentence score, and vocabulary diversity over time. We analyzed the New England longitudinal corpus from the CHILDES database, comprising transcripts of mother-child conversations at 14, 20, and 32 months, using the CHIP command to compute proportions of utterances with overlapping content. Rates of maternal overlap, but not child overlap, at earlier time-points predicted child language outcomes at later time-points, after controlling for earlier child MLU. We suggest that maternal overlap plays a formative role in child language development by providing content that is immediately relevant to what the child has in mind.

Verb Production in Aphasia: Testing the Division of Labor between Syntax and Semantics.

Some individuals with aphasia preferably use semantically general light verbs, whereas others prefer semantically specific heavy verbs. This study aimed to test Gordon and Dell's "division of labor" hypothesis that light versus heavy verb usage depends on syntactic and semantic processes, respectively. In a retrospective analysis of data from the AphasiaBank corpus, narrative language of neurologically healthy individuals and individuals with aphasia was analyzed for the proportion of light verbs used, and its relationship with narrative measures of syntactic and semantic sophistication and verb naming scores was examined. In individuals with aphasia, light verb usage was positively correlated with a syntactic measure (developmental sentence score) and negatively associated with two semantic measures (idea density and verb naming). For healthy individuals, the number of verbs per utterance, which is a measure of syntactic complexity, predicted light verb use. These findings suggest that light verb usage in aphasia observes an inverse relationship with syntactic and semantic abilities, supporting the division of labor hypothesis.

How should we approach the study of fluency? A corpus analysis

How should we approach the study of fluency? A corpus analysis

Comparison of measures of morphosyntactic complexity in French-speaking school-aged children

This study examined the validity and reliability of different measures of morphosyntactic complexity, including the Morphosyntactic Complexity Scale (MSCS), a novel adaptation of the Developmental Sentence Scoring, in French-speaking school-aged children. Seventy-three Quebec children from kindergarten to Grade 3 completed a definition task and a narration task. Mean length of utterance (MLU), clause density and MSCS global score, average frequency scores and average complexity scores were calculated from the transcripts of the two contexts. MLU, clause density and MSCS global score were correlated with vocabulary knowledge and narrative skills, and they increased as a function of school level, suggesting that they are valid measures of morphosyntactic complexity. Moreover, the three scores were correlated across contexts, suggesting that they are also reliable measures. However, no MSCS average frequency or average complexity score was found to be both valid and reliable. These findings will guide researchers and practitioners who desire to assess the language skills of French-speaking school-aged children.

Developmental Sentence Scoring for Japanese (DSSJ).

This paper reports on the development and use of the Developmental Sentence Scoring for Japanese (DSSJ), a new morpho-syntactical measure for Japanese constructed after the model of the English Developmental Sentence Scoring model (Lee, 1974). Using this measure, we calculated DSSJ scores for 84 children divided into six age groups between 2;8 and 5;2 on the basis of 100-sentence samples collected from free-play child-adult conversations. The analysis showed a high correlation of the DSSJ overall score with the Mean Length of Utterance. The analysis of the DSSJ subarea scores revealed large variations between these subarea scores for children with similar overall DSSJ scores. When investigating the high-scoring children (over 1 SD over group average), most children scored high in three to five subareas, but the combination of scores for these subareas varied from child to child. It is concluded that DSSJ is a valuable tool especially for the language acquisition research. The overall DSSJ score reliably reflects the overall morpho-syntactic development of Japanese children, and the subarea scores provide specific information on individual acquisition patterns.

Expressive Language Profiles of Verbally Expressive Adolescents and Young Adults With Down Syndrome or Fragile X Syndrome

In this study, the authors examined the expressive language abilities of a subset of highly verbally expressive adolescents and young adults with Down syndrome (DS) and those with fragile X syndrome (FXS) for evidence of syndrome-related differences. FXS gender differences were also examined in an exploratory fashion. The authors evaluated 24 adolescents and young adults with DS, 17 adolescents and young adults with FXS, and 21 children with typical development (TD), with the groups matched on nonverbal mental age. Language ability was examined using the Oral and Written Language Scales (OWLS; Carrow-Woolfolk, 1995) and Developmental Sentence Scoring (DSS; Lee, 1974) scores derived from an oral narrative language sample. Study analyses revealed the following group differences: The FXS group outperformed the DS and TD groups on the OWLS measure; the TD group outperformed both other groups on some of the DSS measures; the FXS group outperformed the DS group on the DSS Sentence Point measure; and females with FXS outperformed males with FXS on several measures. Results contribute to the ongoing construction of the language phenotypes of individuals with DS and individuals with FXS and support the conclusion that there are quantitative rather than qualitative differences in their expressive language profiles.

A longitudinal investigation of morpho-syntax in children with Speech Sound Disorders

Purpose The intent of this study was to examine the longitudinal morpho-syntactic progression of children with Speech Sound Disorders (SSD) grouped according to Mean Length of Utterance (MLU) scores. Methods Thirty-seven children separated into four clusters were assessed in their pre-kindergarten and Grade 1 years. Cluster 1 were children with typical development; the other clusters were children with SSD. Cluster 2 had good pre-kindergarten MLU; Clusters 3 and 4 had low MLU scores in pre-kindergarten, and (respectively) good and poor MLU outcomes. Results Children with SSD in pre-kindergarten had lower Developmental Sentence Scores (DSS) and made fewer attempts at finite embedded clauses than children with typical development. All children with SSD, especially Cluster 4, had difficulty with finite verb morphology. Conclusions Children with SSD and typical MLU may be weak in some areas of syntax. Children with SSD who have low MLU scores and poor finite verb morphology skills in pre-kindergarten may be at risk for poor expressive language outcomes. However, these results need to be replicated with larger groups. Learning outcomes: The reader should (1) have a general understanding of findings from studies on morpho-syntax and SSD conducted over the last half century (2) be aware of some potential areas of morpho-syntactic weakness in young children with SSD who nonetheless have typical MLU, and (3) be aware of some potential longitudinal predictors of continued language difficulty in young children with SSD and poor MLU.