Language Assessment Instrument Research Articles

Exploring the effectiveness of the Pragmatic Intervention Programme (PICP) with children with autism spectrum disorder and developmental language disorder: A non-randomised controlled trial.

Children diagnosed with autism spectrum disorder (ASD) and developmental language disorder (DLD) often have difficulties using language in social contexts. An intervention programme for preschool-age children with pragmatic difficulties, called Pragmatic Intervention Programme (PICP), showed positive effects for these children. However, it was important to confirm these effects with a larger group and analyse them separately for each condition. In this study, the effectiveness of the PICP was analysed in preschool-age children with ASD or DLD with difficulties in using language in social contexts. The study was carried out with 36 children. Twenty-two were allocated to an experimental group to receive the PICP-based intervention first, and 14 children were assigned to a control group (waiting list). Each child attended 24 PICP-based intervention sessions provided by a speech and language therapist. Progress was measured using a Goal Attainment Scale (GAS) and other language assessment instruments. The results showed that all children in the experimental group made significant progress in their language competencies, compared to the control group after the intervention. This study confirms that the PICP is effective in improving language competencies in preschool-age children with ASD and DLD with difficulties in using language for social purposes, regardless of their condition. These results emphasise the importance of tailored interventions for these children and point to areas for further research.

Assessing the Efficacy of Language Assessment Tools in Educational Settings

Language assessment plays a pivotal role in evaluating learners’ language proficiency and informing educational practices. This paper provides a comprehensive review of international standards guiding the assessment of language proficiency in educational settings. Drawing upon established frameworks such as the Common European Framework of Reference for Languages (CEFR) and the American Council on the Teaching of Foreign Languages (ACTFL) proficiency guidelines, this review examines the key principles, methodologies, and criteria for assessing the efficacy of language assessment tools. It explores the importance of validity, reliability, authenticity, and practicality in the design and implementation of language assessment instruments. Furthermore, it discusses the significance of considering socio-cultural and contextual factors in ensuring the fairness and equity of language assessment practices. The review also highlights emerging trends and challenges in language assessment, including the integration of technology and the need for continuous professional development for assessors. By synthesizing international standards and best practices, this paper offers valuable insights for educators, assessment specialists, and policymakers striving to enhance the quality and effectiveness of language assessment in educational contexts.

Exploring The Effects of English as a Foreign Language on First Language Development of Young Children: The Case of Greece

This study meticulously investigates the interplay between Early Second Language Acquisition (ESLA) and the potential emergence of first language disorders in the unique context of Greece. Embedded in the Complex Dynamic Systems Theory (CDST) paradigm, it aims to untangle existing ambiguities and explore implications for Greek society and education. Employing a Concurrent Mixed Methods Approach, the study attempts to unveil the intricate impacts of ESLA on First Language Development (FLD).Grounded in CDST's framework emphasizing linguistic system complexity, and interconnectedness, the research design employs a Descriptive Exploratory orientation through a Case Study Methodology. This facilitates comprehensive research into two cohorts of children aged four, representing monolingual Greek kindergartens (Cohort A) and English as a Foreign Language (EFL)-focused kindergartens (Cohort B).The research inquiries delve into multifaceted language development aspects amidst intricate linguistic dynamics. This involves nuanced analysis of potential performance disparities in the primary language pre- and post-interventions in early foreign language pedagogy, meticulous comparative assessment of both cohorts, and insightful exploration of EFL's implications on young children's nascent language development.Methodologically, data collection employs a language development assessment tool (Logometro®). The collection of both quantitative and qualitative data in this study is contingent upon the application of the Logometro® language assessment instrument. Thematic Analysis shapes the qualitative corpus, complemented by statistical analyses for quantitative data.Anticipated outcomes aim to enhance understanding among Greek educational authorities and the scientific community about intricate, adaptive ESLA impacts on FLD. Findings could influence enduring, impactful EFL policies shaped by Greek authorities. Overall, the research deepens comprehension of latent consequences tied to ESLA's effects on FLD, set within Greece’s intricate context. Nested within CDST's theoretical framework, the amalgamation of research methodology and insights provides a robust foundation for future inquiries and invaluable guidance for policymakers navigating English language education decisions among young learners.

O Impacto da Consciência Morfológica na Leitura e na Ortografia

ABSTRACT: Morphological awareness is characterized by the ability to intentionally reflect and manipulate morphemes. The present study aimed to characterize the development of morphological awareness in school-age children and to analyze its impact on reading and spelling. The sample was comprised of 60 children with typical language development in Portuguese primary schools with a mean age of 8.6 (standard deviation = 0.1), 30of which attended the 2nd grade and 30 the 4th grade. The data was analyzed considering the use of language assessment instruments, reading and spelling and morphological awareness tests adapted from other studies. The results showed a significant difference in morphological awareness between the 2nd grade and the 4th grade. Although with different statistical proportions, there was a positive correlation between morphological awareness and reading, and between this metalinguistic capacity and spelling in both groups. An association is suggested between morphological awareness and reading and spelling and a difference in this correlation between the two degrees.

Language Assessment Instrument Analysis: Scoping and Investigating the Writing Assessment of College English Test Band 4

The writing evaluation portion of the College English Test band 4 (CET-4) in China is the subject of this study. The goal is to evaluate the language evaluation tool utilized in this test and pinpoint its advantages, disadvantages, and prospective growth areas. The study uses a scoping and investigative strategy to fully comprehend the CET-4 writing assessment's administration, scoring, and design. The study makes a contribution to the field of language assessment by offering insightful information on how writing abilities are assessed in high-stake test and by outlining prospective directions for future study and research in this area.

CHARACTERIZING ENGLISH ASSESSMENT INSTRUMENTS: AN OVERVIEW OF THEIR DESIGN

Assessment tends to be associated with students and learners; however, the term assessment encompasses both teachers and students. To understand the purpose of language assessment instruments, it is key to look for the designers and their preferences. This research aims to characterize 209 assessment instruments created by English teachers. This is a non-experimental and descriptive study that analyzes the types of instruments, the educational level, the language systems and skills, and the type and number of items. Two of the most important findings are related to the preferences Chilean English teachers have towards traditional assessment and the tendency to assess vocabulary and grammar; besides, the participants’ preference for tests and fill-in-the gap items.

Deaf Children's ASL Vocabulary and ASL Syntax Knowledge Supports English Knowledge.

The current study contributes empirical data to our understanding of how knowledge of American Sign Language (ASL) syntax aids reading print English for deaf children who are bilingual and bimodal in ASL and English print. The first analysis, a conceptual replication of Hoffmeister ( 2000), showed that performance on the American Sign Language Assessment Instrument correlated with the Sanford Achievement Test-Reading Comprehension (SAT-RC) and the Rhode Island Test of Language Structures (RITLS, Engen & Engen, 1983). The second analysis was a quantile regression using ASL assessments to predict English print abilities. Different ASL skills were important for English reading comprehension (SAT-RC) versus understanding English syntax (RITLS); the relationship between ASL skills and English print performance also varied for students at different English print ability levels. Strikingly, knowledge of ASL syntax was robustly correlated with knowledge of English syntax at all ability levels. Our findings provide novel and strong evidence for the impact of ASL on the development of English literacy.

Ejercicios de articulación fonética del aparato estomatognático en una paciente con fisura velo-palatina

El caso clínico que se presenta correspondió a una mujer de 53 años, tuvo como objetivo mejorar la función del habla de la paciente atendida. Se realizó un examen odontológico extraoral e intraoral para valorar la condición del aparato estomatognático diagnosticándole fisura palato-uvular. Una vez hecho el diagnóstico odontológico-médico y lingüístico se determinó los procedimientos de intervención, la mujer fue rehabilitada odontológicamente, quirúrgicamente se le realizó una palatoplastia y consecutivamente participó de 24 sesiones ordinarias y 10 de sesiones de refuerzo de ejercicios de articulación de varios fonemas enfatizando en /k/ /g/ /j/ /x/ /c/ ch/ /ñ/ /ll/ /y/. Se concluyó que después de las sesiones de intervención, la paciente evidenció una mejora en la producción de estos fonemas del habla, pasando de un rango muy bajo de 45/110 y 4/15 a un rango alto de 95/110 y 13/15 respectivamente, según los instrumentos de evaluación del lenguaje aplicados.

Individual Differences in Mothers' Spontaneous Infant-Directed Speech Predict Language Attainment in Children With Cochlear Implants.

Purpose Differences across language environments of prelingually deaf children who receive cochlear implants (CIs) may affect language acquisition; yet, whether mothers show individual differences in how they modify infant-directed (ID) compared with adult-directed (AD) speech has seldom been studied. This study assessed individual differences in how mothers realized speech modifications in ID register and whether these predicted differences in language outcomes for children with CIs. Method Participants were 36 dyads of mothers and their children aged 0;8-2;5 (years;months) at the time of CI implantation. Mothers' spontaneous speech was recorded in a lab setting in ID or AD conditions before ~15 months postimplantation. Mothers' speech samples were characterized for acoustic-phonetic and lexical properties established as canonical indices of ID speech to typically hearing infants, such as vowel space area differences, fundamental frequency variability, and speech rate. Children with CIs completed longitudinal administrations of one or more standardized language assessment instruments at variable intervals from 6 months to 9.5 years postimplantation. Standardized scores on assessments administered longitudinally were used to calculate linear regressions, which gave rise to predicted language scores for children at 2 years postimplantation and language growth over 2-year intervals. Results Mothers showed individual differences in how they modified speech in ID versus AD registers. Crucially, these individual differences significantly predicted differences in estimated language outcomes at 2 years postimplantation in children with CIs. Maternal speech variation in lexical quantity and vowel space area differences across ID and AD registers most frequently predicted estimates of language attainment in children with CIs, whereas prosodic differences played a minor role. Conclusion Results support that caregiver language behaviors play a substantial role in explaining variability in language attainment in children receiving CIs. Supplemental Material https://doi.org/10.23641/asha.12560147.

Pengembangan Instrumen Asesmen Higher Order Thinking Skills (HOTS) pada Mata Pelajaran Bahasa Indonesia SMA dan SMK

This research aims to produce a valid and reliable Indonesian language assessment instrument in form of HOTS test items and it describes the quality of HOTS test items to measure HOTS skill for the tenth grade of SMA and SMK students. This study was a research and development study adapted from Borg & Gall’s development model, including the following steps: research and information collection, planning, early product development, limited try out, revising the early product, field try out, and revising the final product. The research’s result shows that the HOTS assessment instrument in the form of HOTS test consists of 40 multiple choice items and 5 essay test items. Based on the judgment of the materials, construction, and language was valid and appropriate to be used. The reliability coefficients were 0.88 for the multiple-choice items, and 0.79 for essays. The multiple-choice items have the average difficulty 0.57 (average), the average of item discrimination 0.44 (good), and the distractors function well. The essay items have the average of item difficulty 0.60 (average) and the average of item discrimination 0.45 (good)

Morphosyntactic Evaluation Protocol (MEP): validation of content.

the use of language assessment instruments in the area of speech-language-therapy is essential for the diagnosis and, consequently, for therapeutic planning. In Brazil, there is a shortage of instruments constructed and validated in the morphosyntax area. Morphosyntactic Evaluation Protocol (MEP) was constructed based on the main syntactic characteristics of the period of acquisition of children's language, on the Portuguese grammatical structure and the application in a pilot study. To verify the validity of MEP content. for the validation process, the instrument was applied and analyzed through a questionnaire by three judges, a linguist and two speech-language specialists with experience in assisting children with Language Development Disorder. The Index of Judges' Reliability was used to compare the results of the protocol application and the Cronbach's Alpha tests, Spearman-Brown and Content Validity Index (CVI) in the questionnaire responses. the statistical tests applied in the validation of content legitimized the reliability of the instrument with indexes considered substantial for both alpha coefficients, higher than 0.80, Spearman and the CVI test had a maximum concept of 1.0. there were compliance and compatibility in the answers of the experts, which indicates the reliability of the instrument. The results of the statistical tests legitimize the reliability of the instrument with indexes considered substantial for alpha and Spearman coefficient. In the future, the protocol may help characterize the syntactic profile of children with language developmental disorder.

DESIGNING ICT COMPETENCES-INTEGRATED ASSESSMENT INSTRUMENTS OF ENGLISH LANGUAGE ASSESSMENT AND LANGUAGE ASSESSMENT INSTRUMENT DEVELOPMENT OF ENGLISH LANGUAGE EDUCATION STUDY PROGRAM

This study aims at designing ICT competences – integrated assessment instruments of English Language Assessment and Language Assessment Instrument Development courses for English Language Education Study Program by analyzing the existing assessment instruments from five universities in Indonesia. The analysis involved the ICT competences proposed by UNESCO and Digital Media and Assessment Descriptors of English Profiling Grid (EPG). The study applied Design and Development Research (DDR) as the research design and qualitative as the research method. The used stages of DDR in this study are Identify Problem; Describe the Objectives, Design and Develop the Prototypes and Validate the Prototypes. The result of the study found that ICT competences are mostly integrated in the use of word-processing of the existing assessment instruments as a tool which use hardware such as computer, laptop and printer as well as software such as Windows/Mac and Microsoft Word by using features on them such as page layout, margins, table, font type and size, numbering, space and grammar checker. Then the researcher tried to provide the procedure of ICT competences integration and the design of ICT competences integrated – Language Assessment Instrument Development course.

Auditory memory span in Mandarin-speaking preschoolers with congenital hearing loss: Impact of task structure

Objective: The current research was conducted to test the prediction that children who have hearing loss and are developing spoken language can perform at the same level as hearing children in an auditory memory span task if actual production of speech is excluded from task requirement.Method: A listen-and-point digit span task and two sub-tests of Wechsler Intelligence Scale for Children-IV (Verbal Digit Span and Matrix Reasoning) were administered to thirty hearing children and thirty-three children with hearing loss. A language assessment instrument for Mandarin-speaking preschool children was also administered to the participants with hearing loss.Results: The listen-and-point task not only correlated with the Verbal Digit Span sub-test, but also correlated with the comprehension sub-test of the language assessment instrument. The size of auditory memory span was similar in both groups of participants in the listen-and-point task. Moreover, the memory span estimated in the listen-and-point task was smaller than that estimated in the Verbal Digit Span task. The correlation coefficients between chronological age and the listen-and-point task were also similar in both groups of children.Conclusions: When speech processes are not required in an auditory working memory task, demand for the phonological loop is reduced and the children with hearing loss are able to perform as well as the hearing children. Moreover, the auditory memory span develops at the same rate for the children with hearing loss as for the hearing children.

Patterns of educational achievement among groups of immigrant children in Denmark emerge already in preschool second-language and preliteracy skills

AbstractImmigrant children in Denmark differ greatly in educational outcomes. This study examined whether systematic differences in majority language (L2) and preliteracy skills are apparent already at ages 2–6 in immigrant children in Denmark across regional immigration background. Danish language and preliteracy skills in 1,211 immigrant children in four regional groups (based on maternal origin) and 11,259 native Danish nonimmigrant children, all enrolled in Danish childcare centers, were assessed using an age- and gender-normed language assessment instrument. Hierarchical linear models showed that all four immigrant groups scored significantly lower than the native Danish group; the negative coefficients diminished but remained significant when socioeconomic background and having a native Danish father were controlled for. In addition, even with these controls, significant differences existed between some of the immigrant groups, suggesting that factors relating to regional immigrant background were important sources of differences in L2 development. A greater immigrant disadvantage for language than preliteracy skills was found; two immigrant groups did not differ significantly from the nonimmigrant Danish group for preliteracy skills. The results suggest that measures to reduce inequalities in long-term educational achievement between immigrant groups should be taken already before school with a particular focus on L2 language skills.

Developing Culture-Based English Language Assessment Instrument for Second Semester of Grade Seven of Junior High School in Buleleng Sub-District to Support the Implementation of Curriculum 2013

This research aimed at developing culture-based English language assessment instrument for the second semester of grade seven of junior high school in Buleleng Subdistrict to support the implementation of Curriculum 2013. This research was categorized as research and development. Research and development model which was used in this research proposed by Peffers et.al (2007). The suitable English assessment for the second semester of grade seven of junior high school was English assessment with integrated Balinese culture in order to support the development of character building. The steps of developing this English assessment instrument included assessment goal analysis, assessment standard analysis, syllabus analysis, learning source analysis, designing blue print, developing assessment, expert judgment, and revision. This research produced English assessment instrument which assessed
 students’ affective, cognitive, and psychomotor domains. The reliability and quality of the developed assessment instrument were found out by giving expert judgment form to the experts of assessment and English language teaching. The scores which were given by the two experts were 650 from the first expert and 802 from the second expert. Based on those scores, the quality of the developed English assessment instrument was categorized as excellent. The reliability of the data was categorized as excellent in which the score of Alpha Cronbach’s coefficient was 0.9. It means that the developed culturebased English assessment instrument was suitable to be used in teaching and learning process that implements Curriculum 2013 in Buleleng Sub-district.

Preschoolers' Performance on the Brazilian Adaptation of the Preschool Language Assessment Instrument - Second Edition

Purpose: The objective was to test whether the Brazilian version of the Preschool Language Assessment Instrument - Second Edition (PLAI-2) has the potential to assess and identify differences in typical language development of Portuguese-speaking preschoolers. Methods: The study included 354 children of both genders with typical language development who were between the ages of 3 years and 5 years 11 months. The version of the PLAI-2 previously translated into Brazilian Portuguese was used to assess the communication skills of these preschool-age children. Results: Statistically significant differences were found between the age groups, and the raw score tended to increase as a function of age. With nonstandardized assessments, the performances of the younger groups revealed behavioral profiles (e.g., nonresponsive, impulsive behavior) that directly influenced the evaluation. Conclusions: The findings of this study show that the PLAI-2 is effective in identifying differences in language development among Brazilian children of preschool age. Future research should include studies validating and standardizing these findings.

THE USE OF DIGIT AND SENTENCE REPETITION IN THE IDENTIFICATION OF LANGUAGE IMPAIRMENT: THE CASE OF CHILD SPEAKERS OF AFRIKAANS AND SOUTH AFRICAN ENGLISH

There is a great need for an instrument that can accurately identify children with language problems early, regardless of the language(s) they speak. Certain tasks have been identified as potential markers of language impairment, including sentence repetition and digit repetition (Ziethe, Eysholdt and Doellinger 2013: 1). The purpose of this study was to compare the sensitivity of these two potential markers in order to compile an accurate measuring instrument for language impairment in Afrikaans and South African English (SAE). The participants were 20 typically developing (TD) Afrikaans- and 20 TD SAE-speaking 5-year-olds, as well as five Afrikaans- and five SAE-speaking 5-year-olds with language impairment (LI). Sentence and digit repetition tasks were devised, recorded on CD, and performed by each participant individually. Both groups with LI performed poorly, and significantly more poorly than their corresponding TD group, on both repetition tasks. For both languages, (i) sentence repetition distinguished best between the participants with and without LI, and (ii) some items proved to be more sensitive than others for the difference between the performance of the TD and the LI groups. These items may be appropriate for inclusion in a screening tool for LI in 5-year-olds. The availability of language screening tools in several of South Africa’s languages can be of value to child language researchers and speech-language therapists. This study demonstrated that devising such tools could be a feasible endeavour. In contrast to diagnostic language assessment instruments, screening tools that employ repetition tasks can be devised relatively quickly and economically, and can contribute to the early identification of children with language problems in the interim, while diagnostic instruments are developed.

Cross-cultural adaptation of Preschool Language Assessment Instrument: Second Edition.

In Brazil, formal tools for the evaluation of spoken language are scarce. Therefore, this study aimed to translate and adapt to Brazilian Portuguese the Preschool Language Assessment Instrument: Second Edition (PLAI-2). The process of translation and adaptation of this instrument was conducted in two stages - Stage 1: (1a) translation of the original version to Brazilian Portuguese, (1b) comparison of the translated versions and synthesis into a single Portuguese version, (1c) back-translation, (1d) revision of the translated version; and Step 2: (2a) application of the Portuguese version in a pilot project with 30 subjects, and (2b) statistical comparison of three age groups. In the Brazilian version, all items of the original version were kept. However, it was necessary to modify the application order of one item, and the change of one picture was suggested in another. The results obtained after application indicated that the Brazilian version of the PLAI-2 allows us to distinguish the performance of participants belonging to different age groups, and that the raw score tends to increase with age. Semantic and syntactic adjustments were required and made to ensure that PLAI-2 would be used with the same methodological rigor of the original instrument. The adaptation process observed the theoretical, semantic, and cultural equivalences.

Preschool language assessment instrument, second edition, in Brazilian Portuguese-speaking children.

To present a brief report on the initial results of the application of Preschool Language Assessment Instrument, second edition, in Brazilian Portuguese-speaking children. The study included 300 children with typical language development, from both genders, aged from 3 to 5 years and 11 months, as proposed by the original test version. After translation, back-translation, and adaptation of the second edition of the Preschool Language Assessment Instrument, the instrument was administered to investigate the receptive and expressive language skills. There was a significant difference between the average gross scores of the three groups for both "receptive" and "expressive" language skills, and a growing tendency of scores according to age. After analysis, we found that versions translated and adapted for Brazilian Portuguese speakers allow one to evaluate and discriminate the performance of children in receptive and expressive language skills, according to age group, as well as the original version.

Child language assessment and intervention in multilingual and multicultural South Africa: Findings of a national survey

Research world-wide suggests that service delivery by speech-language therapists (SLTs) to bilingual children is problematic and largely unsatisfactory. In multicultural South Africa, the majority of SLTs speak either only English or only Afrikaans and English. The current state of service delivery to bilingual children, including those with first languages other than English or Afrikaans, is not known. This study was undertaken to ascertain how SLTs in South Africa adapt their assessment and intervention practices to cope with the multilingual and multicultural nature of the local child population. A questionnaire was completed by 243 practising SLTs who had children on their caseloads. 71% of respondents reported treating children with English as first language, 51% Afrikaans, and 53% an indigenous African language. Less than 2% reported not treating bilingual children. Almost all respondents could assess clients in English, three-quarters in Afrikaans, and 15% in an African language. A quarter could treat clients in one language only; 11% could do so in more than two languages. Only 7% reported that 90-100% of their bilingual clients receive intervention in their first language. 70% of respondents needed intervention material in English, 57% in Afrikaans, and 33% in an African language. 78% considered the underlying linguistic base when selecting a language assessment instrument; only 6% considered its linguistic and cultural appropriateness for use locally. The use of translations of English-medium instruments when assessing Afrikaans-speaking children was widely reported, as was dissatisfaction with standardised English- and Afrikaans-medium instruments. The findings supply essential information on the state of service delivery to bilingual children: After almost two decades of official multilingualism in South Africa, SLTs’ practices remain a poor reflection of the multilingual and multicultural realities of the population. Steps toward improving the situation would include training more multilingual SLTs, specifically speakers of African languages, and expanding research leading to linguistically and culturally appropriate assessment and intervention material.