Oral Proficiency Interview Research Articles

Study Abroad Students’ Social Contacts in Different Linguistic Contexts and Their Relationship With English Use and Development

AbstractOur contribution draws on quantitative data from a longitudinal mixed‐methods study to uncover different patterns of social contacts of study abroad (SA) students and the relationship of these social contacts with (a) language use, (b) target language development, and (c) contextual variables. Data were obtained by means of online questionnaires pre, during, and post sojourn. English oral proficiency gains were measured using the Oral Proficiency Interview by Computer (OPIc) test before and after the stay. Latent profile analysis yielded four profiles of social contacts, which differed in terms of the degree of integration into the community of locals or international students. Students with distinct profiles differ significantly with respect to language use but not in terms of language gains. Regression analyses indicate that comparable progress in oral proficiency was made by students across profiles of social contacts and also by those in an English as a lingua franca (ELF) context suggesting that different SA context and networking patterns are conducive to second language (L2) gains.

Enhancing self-regulation and learner engagement in L2 speaking: exploring the potential of intelligent personal assistants within a learning-oriented feedback framework

IntroductionDeveloping L2 speaking proficiency can be challenging for learners, particularly when it comes to fostering self-regulation and maintaining engagement. Intelligent Personal Assistants (IPAs) offer a potential solution by providing accessible, interactive language learning opportunities.MethodsThis mixed-methods study investigated the effectiveness of using Google Assistant within a learning-oriented feedback (LOA) framework to enhance L2 speaking proficiency, self-regulation, and learner engagement among 54 university-level EFL learners in China. Convenience sampling assigned participants to either an experimental group (n = 27) using Google Assistant with tailored activities or a control group (n = 27) using traditional methods. The Oral Proficiency Interview (OPI) assessed speaking performance. Self-reported questionnaires measured L2 motivation and the Scale of Strategic Self-Regulation for Speaking English as a Foreign Language (S2RS-EFL) evaluated speaking self-regulation. Additionally, semi-structured interviews with a subsample of the experimental group provided qualitative insights.ResultsThe Google Assistant group demonstrated a statistically significant improvement in speaking performance compared to the control group. While no significant difference in motivation was found, thematic analysis of interviews revealed perceived benefits of Google Assistant, including increased accessibility, interactivity, and immediate pronunciation feedback. These features likely contributed to a more engaging learning experience, potentially fostering self-regulation development in line with the core principles of LOA.ConclusionThis study suggests Google Assistant as a promising supplementary tool for enhancing L2 speaking proficiency, learner autonomy, and potentially self-regulation within an LOA framework. Further research is needed to explore its impact on motivation and optimize engagement strategies.

Integrating Socio Cultural Theory and Bloom’s Taxonomy to Overcome Xenoglossophobia and Anxiety in English Language Speaking in Sri Lankan Undergraduates

The importance of knowing a second or a foreign language today has become a pivotal factor with regard to education, travel, trade, business, information, communication and most importantly to acquire a recognizable occupation. Even so, obtaining a job related to a graduate’s educational background in the Sri Lankan context at present, is a challenging task. Having realized this, the local government of Sri Lanka have been taking measures in teaching English at local government schools from Grade 3 onwards since 1950’s. Nonetheless, even by the time the Sri Lankan local government school children enter university after engaging in English language learning for over a decade and subsequent to Ordinary and Advanced level examinations, their English-speaking skills stand at a marginal level with traits of xenoglossophbia and anxiety. Thus, the aim of the study is to find out the main factors that influence xenoglossophobia and suggest strategies to overcome them. A sample of 32 Engineering undergraduates from the first year of General Sir John Kotelawala Defence University (KDU) was selected based on purposive sampling technique. The selection process was performed based on an Oral Proficiency Interview (OPI). After having exposed the students to a teaching process for 15 academic weeks, they were re-administered through a post-OPI. The lesson plans were set according to Blooms Taxonomy knowledge-based objectives. Socio-Cultural Theory (SCT) was incorporated when designing the lessons. Data was analyzed via a mixed approach. The findings revealed that the students had increased motivation and confidence to speak English as they were exposed to a gradual process of self-autonomy. Paving way for authentic speaking opportunities via Task Based Activities (TBA) and making students aware of the importance of English language communication for employment purposes from school levels is highly important. Further, teacher, learning environment and material play a considerable role in motivating language learners while self-negativity is a main reason for the majority to possess xenoglossophobia which adversely affects their future employability.

Oral proficiency gains of study abroad students before and during the COVID-19 pandemic

Oral proficiency gains of study abroad students before and during the COVID-19 pandemic

Language switching and speaking a nondominant language challenge executive control: Preliminary data for novel behavioral markers of Alzheimer's risk in Spanish-English bilinguals.

The present study explored psycholinguistic analysis of spoken responses produced in a structured interview and cued linguistic and nonlinguistic task switching as possible novel markers of Alzheimer's disease (AD) risk in Spanish-English bilinguals. Nineteen Spanish-English bilinguals completed an Oral Proficiency Interview (OPI) in both languages, cued-switching tasks, and a battery of traditional neuropsychological tests (in a separate testing session). All were cognitively healthy at the time of testing, but eight decliners were later diagnosed with AD (on average 4.5 years after testing; SD = 2.3), while 11 controls remained cognitively healthy. Past studies showed picture naming was more sensitive to AD in the dominant than in the nondominant language, but we found the opposite for a composite measure of spoken utterances produced in the OPI that included revisions, repetitions, and filled pauses (RRFPs), which were especially sensitive to AD risk in the nondominant language. Errors produced on language switch trials best discriminated decliners from controls (in receiver operating characteristic curves), and though the nonlinguistic switching task was also sensitive to AD risk, it elicited more errors overall and was also negatively affected by increased age and low education level. Speaking a nondominant language and errors in cued language switching provided sensitive and specific markers of pending cognitive decline and AD risk in bilinguals. These measures may reflect early decline in executive control abilities that are needed to plan and monitor the production of connected speech and to manage competition for selection between languages. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The speaking proficiency outcomes of face‐to‐face and online intensive summer LCTL programs

AbstractThis article is the first large‐scale study to document the speaking proficiency outcomes of intensive programs in less commonly taught languages in US higher education. Speaking proficiency was measured by pre‐ and postprogram ACTFL Oral Proficiency Interviews (N = 484) in 14 languages: Arabic, Bengali, Brazilian Portuguese, Hindi, Indonesian, Kazakh, Persian, Tamil, Thai, Tibetan, Turkish, Urdu, Uyghur, and Uzbek. The intensive programs are usually taught face‐to‐face but were offered fully online during the COVID‐19 pandemic. No significant difference in speaking proficiency outcomes, as measured by the ACTFL OPI, was found between the face‐to‐face and online formats. Students at all levels of instruction made significant gains in speaking proficiency, with greater gains made by students in Level 1 than at Levels 2‐3, and with wide variation within instructional levels. The average speaking proficiency outcomes were Advanced Low (Level 3), Intermediate High (Level 2), and between Intermediate Low and Intermediate Mid (Level 1).

The role of agency in language socialization

Abstract Drawing on longitudinal data from the perspective of Complex Dynamic Systems Theory, I portray how L2 language socialization is promoted by an L2 user’s agency borne out of his Ideal L2 self. This paper first showcases a decade-long longitudinal OPI (Oral Proficiency Interview) data set elicited from an L2 Japanese user who speaks Korean as his L1, focusing on the process of affective adverb acquisition observed through transformations in his speech style. Then, employing the Trajectory Equifinality Approach (TEA), I examine holistically how changes in the use of affective adverbs reflects the L2 user’s language socialization by visualizing his language environment and language awareness chronically, including his own reflections through retrospective interviews.

Ingliz tilini o'rganuvchilarning muloqot qobiliyatlarini baholash usullari

This comprehensive article explores various assessment methods used to evaluate the communication skills of English language learners. It discusses oral proficiency interviews, group discussions, written assignments, listening comprehension tests, role-plays, simulations, and portfolios as effective assessment tools. The article emphasizes the importance of assessing different aspects of communication, such as speaking, listening, reading, and writing. It provides insights into the evaluation criteria, including fluency, coherence, vocabulary usage, and cultural sensitivity. The references at the end offer additional resources for those interested in further exploration of the topic. Overall, this article serves as a valuable guide for educators and assessors involved in evaluating English language learners’ communication skills.

Language-Concordant Care: a Qualitative Study Examining Implementation of Physician Non-English Language Proficiency Assessment

BackgroundLanguage concordance can increase access to care for patients with language barriers and improve patient health outcomes. However, systematically assessing and tracking physician non-English language skills remains uncommon in most health systems. This is a missed opportunity for health systems to maximize language-concordant care.ObjectiveTo determine barriers and facilitators to participation in non-English language proficiency assessment among primary care physicians.DesignQualitative, semi-structured interviews.ParticipantsEleven fully and partially bilingual primary care physicians from a large academic health system with a language certification program (using a clinician oral proficiency interview).ApproachInterviews aimed to identify barriers and facilitators to participation in non-English language assessment. Two researchers independently and iteratively coded transcripts using a thematic analysis approach with constant comparison to identify themes.Key ResultsMost participants were women (N= 9; 82%). Participants reported proficiency in Cantonese, Mandarin, Russian, and Spanish. All fully bilingual participants (n=5) had passed the language assessment; of the partially bilingual participants (n=6), four did not test, one passed with marginal proficiency, and one did not pass. Three themes emerged as barriers to assessment participation: (1) beliefs about the negative consequences (emotional and material) of not passing the test, (2) time constraints and competing demands, and (3) challenging test format and structure. Four themes emerged as facilitators to increase assessment adoption: (1) messaging consistent with professional ethos, (2) organizational culture that incentivizes certification, (3) personal empowerment about language proficiency, and (4) individuals championing certification.ConclusionsTo increase language assessment participation and thus ensure quality language-concordant care, health systems must address the identified barriers physicians experience and leverage potential facilitators. Findings can inform health system interventions to standardize the requirements and process, increase transparency, provide resources for preparation and remediation, utilize messaging focused on patient care quality and safety, and incentivize participation.

The Impact of Topic Selection on Lexico-Grammatical Errors and Scores in English Oral Proficiency Interviews of Korean College Students

The primary objective of this study is to identify the types of errors made by Korean college students in an oral proficiency interview in relation to specific task topics, and to examine how these errors affect their lexico-grammatical proficiency scores. Ninety-six two-minute-long audio clips of 32 Korean college students on three different topics were transcribed. Lexico-grammatical errors were then coded for statistical analysis and lexico-grammatical scores were estimated using many-facet Rasch measurement analysis with two raters. Friedman tests and Wilcoxon signed-rank tests showed that noun phrase, verb phrase, and prepositional phrase errors were more frequently found with the descriptive tasks than compare-and-contrast or hypothetical prompts. A hierarchical multiple regression analysis showed that noun phrase and verb phrase errors accounted for 22% of the variance in lexico-grammatical scores. Adding utterance length variables to the initial regression model explained an additional 43% of the variance in the lexico-grammatical scores. These findings suggest that noun phrase errors and verb phrase errors should be a priority in English classes, and that it is beneficial to teach English speaking skills in a way that takes into account the task characteristics and contextual factors.

Assessing spoken lexical and lexicogrammatical proficiency using features of word, bigram, and dependency bigram use

AbstractThe measurement of second language (L2) productive lexical proficiency has driven a great deal of research over the past two decades. Research has indicated that more proficient speakers and writers tend to use a wider range of words and that more proficient writers tend to use words that are more sophisticated (less frequent in reference corpora). Research over the past 15 years has also demonstrated that the way words are used in context (i.e., collocation use) is also an important indicator of both written and spoken proficiency. In this study, we extend recent research that has modeled writing proficiency using collocation indices based on grammatical dependencies (e.g., verb–direct object) to spoken contexts. In particular, we model speaking proficiency scores from a large corpus of oral proficiency interview responses using a range of well‐known indices of productive proficiency and newly developed grammatical dependency indices. The results indicated that all index types demonstrated small to moderate correlations with speaking proficiency individually but explained a large proportion of the variance when used in a multivariate model that included dependency collocation indices.

Mediation and Learner Reciprocity

The Oral Proficiency Interview (OPI) is an effective tool for assessing language learners’ speaking ability. While it is commonly employed in institutional contexts, the OPI has been criticized for not granting due attention to the assistance that the tester offers to the learner. Dynamic Assessment (DA), rooted in Vygotsky’s theory of the development of human higher psychological functions, believes the use of different forms of mediation, when tailored to learners’ needs, enables learners to perform beyond their current level, thus providing insights into their emerging abilities. This study explores the use of DA within the OPI framework. Through a microgenetic analysis of the mediation-learner interactions observed in a series of mock OPI sessions conducted in Mandarin Chinese, we identified the mediation and reciprocity typological moves that are significant to learner development. The analysis showed DA’s potential for not only pinpointing areas of difficulty but also identifying the learner’s Zone of Proximal Development (ZPD) and supporting their microgenetic progress. The findings indicate that DA would add an important, yet long neglected, dimension to the OPI framework.

The foreign-accentedness, comprehensibility, and intelligibility of L2 Arabic speech

This study investigated foreign-accentedness, comprehensibility, and intelligibility in second language (L2) Arabic speech. More specifically, it was designed to 1) measure how foreign-accented, comprehensible, and intelligible L2 Arabic speech was, 2) explain the relationships among those three global aspects, and 3) determine the extent to which foreign-accentedness and comprehensibility – individually or combined – explain or predict intelligibility. Thirty adult L2 Arabic speakers were audio-recorded while having an unofficial oral proficiency interview (OPI). A subset of three speech samples were extracted from the entire OPI for each speaker. Next, 10 adult native speakers of Arabic listened to and transcribed all speech samples in Arabic as a measure of intelligibility; in addition, they rated the samples for foreign-accentedness and comprehensibility on a 9-point scale. Results showed that L2 Arabic speech was rated more positively for comprehensibility than for foreign-accentedness, on average; in addition, most of it was less than highly intelligible. Also, results showed statistically significant relationships among the three global aspects under investigation, although they varied in strength: foreign-accentedness and comprehensibility showed the strongest relationship, followed with comprehensibility and intelligibility; foreign-accentedness and intelligibility was found to have the weakest relationship. Furthermore, foreign-accentedness and comprehensibility demonstrated a statistically significant explanatory or predictive power in intelligibility. However, both the unique contribution and added power of foreign-accentedness were not statistically significant, deeming a model with only comprehensibility being the best fit for the obtained assessment data of L2 Arabic speech. Consistent with existing evidence, the results support the partial independence of foreign-accentedness, comprehensibility, and intelligibility as global aspects of L2 speech while also indicating L2-specific patterns. After discussing the results and implications, directions for future research are provided.

Modeling Lexical and Phraseological Sophistication in Oral Proficiency Interviews: A Conceptual Replication

Building on previous studies investigating the multidimensional nature of lexical use in task-based L2 performance, this study clarified the roles that the distinct lexical features play in predicting vocabulary proficiency in a corpus of L2 Oral Proficiency Interviews (OPI). A total of 85 OPI samples were rated by three separate raters based on a Common European Frame of Reference (CEFR) based rubric in terms of their linguistic range. The interview transcription was analyzed for 56 lexical and phraseological indices using modern natural language processing tools. The result of an exploratory factor analysis (EFA) revealed that the 56 indices tapped into 10 distinct factors of lexical use in OPI: three factors related to content words, three related to n-grams, three lexical collocation factors, and one function-word factor. A subsequent Bayesian mixed-effect ordinal regression indicated that six out of the 10 factors meaningfully predicted the CEFR levels on Range with reasonable accuracy (quadratic kappa coefficient = .81 with the human rating). The result highlights the distinct roles that multiple content-word, collocation, and function-word factors play in characterizing the linguistic range in a CEFR-based assessment of OPI. The implication for the assessment of lexical richness, as well as future directions of this research domain, are discussed.

Oral Proficiency Interview (OPI) for the Assessment of Speaking

The skill of speaking, arguably, plays the most essential role in the process of communication among people; thus, the teaching and assessment of speaking deserves special attention. The oral proficiency interview (OPI) has been utilized as a technique for the assessment of speaking for about 70 years and its traditional format has been revised and updated in line with the requirements of contexts and innovations in technology. Accordingly, this paper briefly introduces the OPI and discusses the advantages and disadvantages of the OPI. In addition, the reliability and validity of the OPI for the assessment of speaking skills has also been expounded on with specific reference to its strengths and weaknesses. More precisely, the paper argues that the OPI has the potential to assist foreign language teachers in teaching and testing the speaking skills of their learners as long as its weaknesses are compensated for, reliable rating scales are designed and raters are trained to score the performances reliably.

Temporal fluency and floor/ceiling scoring of intermediate and advanced speech on the ACTFL Spanish Oral Proficiency Interview–computer

The rating of proficiency tests that use the Inter-agency Roundtable (ILR) and American Council on the Teaching of Foreign Languages (ACTFL) guidelines claims that each major level is based on hierarchal linguistic functions that require mastery of multidimensional traits in such a way that each level subsumes the levels beneath it. These characteristics are part of what is commonly referred to as floor and ceiling scoring. In this binary approach to scoring that differentiates between sustained performance and linguistic breakdown, raters evaluate many features including vocabulary use, grammatical accuracy, pronunciation, and pragmatics, yet there has been very little empirical validation on the practice of floor/ceiling scoring. This study examined the relationship between temporal oral fluency, prompt type, and proficiency level based on a data set comprised of 147 Oral Proficiency Interview - computer (OPIc) exam responses whose ratings ranged from Intermediate Low to Advanced High [AH]. As speakers progressed in proficiency, they were more fluent. In terms of floor and ceiling scoring, the prompts that elicited speech a level above the sustained level generally resulted in speech that was slower and had more breakdown than the floor-level prompts, though the differences were slight and not significantly different. Thus, temporal fluency features alone are insufficient in floor/ceiling scoring but are likely a contributing feature.

Predicting the Success of International Pharmacists in a Distance-Based US Doctor of Pharmacy (PharmD) Program: Results from a 5-Year Cohort.

Background: To establish the predictors of success in an international-trained PharmD (ITPD) program between admission criteria and academic performance. Methods: The primary outcome of this study was the correlation of admission criteria with didactic and experiential grade point averages (GPA) for the first 5 years. Candidates meeting the minimum criteria completed a competency exam or the US-Foreign Pharmacy Graduate Equivalency Exam (US-FPGEE). Tests of English language proficiency (TOEFL(R) and ACTFL’s Oral Proficiency Interview) plus interview with faculty, students, and alumni were also required. Scores were correlated with both didactic and experiential GPAs. Results: The 23 students admitted to the ITPD program had a cumulative GPA of 3.72. There was a significant correlation between total admissions score and the median pharmacy and healthcare course category GPA (ρ 0.53), but not other categories. The composite TOEFL did not predict any performance but TOEFL writing and speaking did correlate with advanced pharmacy practice experience (APPE) performance. The OPI scores were associated with higher GPAs overall, in advanced integrated clinical sciences, and APPEs. The admission interview scores consistently and significantly correlated with preceptor-rated APPE GPA, practitioner skills, and professionalism (ρ > 0.5; p < 0.05). Performance in early courses significantly predicted the performance in advanced courses and experiential performance (ρ 0.48–0.61). Conclusion: The correlations between early and late course performance demonstrated the cohesiveness of this program. Further study is needed between the predictors of success using non-cognitive admission criteria.

Changes in second-language learners’ oral skills and socio-affective profile following short-term study abroad to Japan

Abstract Thirty-seven second language (L2) learners of Japanese (21 L1 English, 16 L1 Chinese) participated in an eight-week study abroad (SA) program to Japan. Pre- and post-SA oral proficiency interviews were used for ACTFL-level assessments and ratings of component skills (pronunciation, fluency, grammatical accuracy, vocabulary/content, interaction skills). Surveys measured socio-affective variables and L2 engagement (using a modified Language Contact Profile). Thirty-six participants increased in ACTFL level. Both L1 groups showed a significant increase in component skills and perceived competence. For L1 Chinese participants, pre-SA perceived competence significantly correlated with time spent in brief exchanges using Japanese. For L1 English participants, gains in interaction scores remained significant after controlling for the significant increase in positive communication affect. Thematic analysis of participants’ journals revealed the homestay environment was the nexus of activities supporting communication skill development through exchanges of viewpoints and culture learning, frequently over dinner. Homestays also contributed to developing greater L2 speaking confidence.

Assisted self‐assessment to optimize the OPIc test experience

The ChallengeA principal adaptive feature of the ACTFL Oral Proficiency Interview—computer (OPIc) is a self‐assessment instrument through which test takers select a level‐appropriate test form. How accurately do test takers select level‐appropriate forms on the OPIc? Would assistance with the test form selection process optimize the testing experience?

“I can't come to the words”: Effects of including military flavour when testing the oral proficiency of Norwegian joint terminal attack controllers

Joint Terminal Attack Controllers (JTACs) direct close-air-support during NATO operations, however, non-native speaker JTACs struggle to meet the NATO English proficiency requirement. This paper examines the effects of including more “military flavour” (Green & Wall, 2005) in the oral proficiency interview (OPI) for JTACs, developed in accordance with NATO Standardisation Agreement (STANAG) 6001. The new test format, called the “OPI+” included linguistic tasks associating military content domains with the linguistic functions traditionally elicited in the OPI, allowing for comparisons to be made between the two. The test was tried on the Norwegian JTAC selection course (N = 25). Test-taker performance was holistically rated in accordance with STANAG 6001, and candidate output on four OPI+ tasks later transcribed and analysed using discourse analytic measures. Findings suggest that while adding more professional flavour to the test of speaking will improve face validity, test-takers' qualitative and quantitative performance will not be significantly affected, as long as the language functions elicited remain the same. Moreover, when it comes to testing the professional language JTACs need in the target language use situation, the standard STANAG 6001 OPI test format apparently leaves something to be desired.