English Proficiency Test Research Articles

The pain, the pedagogy, and the politics of IELTS: a critical autobiographical inquiry

ABSTRACT Language tests, including international high-stakes English proficiency tests widely used around the world, are to be viewed as ideological constructs connected with power relations and center–periphery demarcations at different social levels. In this paper, we examine the International English Language Testing System (IELTS) as an instance of such tests to uncover some of its underlying sociocultural functions. Adopting a critical autobiographical approach that revisits three personal trajectories in relation to each other and in connection with wider contextual dynamics, we reflect on our own lived experiences of engagements with IELTS in various social and institutional settings and in different roles. Each one of us first shared narrative accounts of turning points in our learning, taking, teaching, and using IELTS within the past two decades. Then, we explored these narratives through multiple rounds of reflections and discussions of their common underlying ideas related to the sociocultural functioning of IELTS. Although the narratives presented unique trajectories, three common themes of Pain, Pedagogy, and Politics emerged from our collective analytic reflections. We discuss these themes and how they can problematize different aspects of IELTS from a critical point of view.

Writing Anxiety: Why do IELTS Test Takers Fail to Obtain their Desired Band Scores?

Numerous individuals with varied backgrounds (doctors, engineers, IT professionals) either want to study in an English-speaking country or want to immigrate there. Hence they have to attempt an English proficiency test –IELTS –that requires good proficiency in writing, alongside listening, reading, and speaking. However writing has been an uphill task leading the test-takers to multiple retakes. Therefore this study is conducted to investigate the level and kind of anxiety associated with writing. The contributors to this study are 38 IELTS aspirants who have been training for IELTS through self-study and a well-known institute in Karachi, Pakistan. Responses were accumulated through Google Forms, they were translated into pie charts and ultimately presented to readers. The outcomes demonstrate that practices of learners and teachers in this context are aligned with the set standards but with minor faults. Findings of this study are essential for the IELTS aspirants as well as IELTS instructors.

Estimating Test-Retest Reliability in the Presence of Self-Selection Bias and Learning/Practice Effects

Test-retest reliability is often estimated using naturally occurring data from test repeaters. In settings such as admissions testing, test takers choose if and when to retake an assessment. This self-selection can bias estimates of test-retest reliability because individuals who choose to retest are typically unrepresentative of the broader testing population and because differences among test takers in learning or practice effects may increase with time between test administrations. We develop a set of methods for estimating test-retest reliability from observational data that can mitigate these sources of bias, which include sample weighting, polynomial regression, and Bayesian model averaging. We demonstrate the value of using these methods for reducing bias and improving precision of estimated reliability using empirical and simulated data, both of which are based on more than 40,000 repeaters of a high-stakes English language proficiency test. Finally, these methods generalize to settings in which only a single, error-prone measurement is taken repeatedly over time and where self-selection and/or changes to the underlying construct may be at play.

Print Rich Classroom: An Exposure to Learn English Language Reading Proficiency

The aim of this study was to investigate the effect of print rich classroom on English language reading proficiency of fourth grade. The study utilized a randomized pretest-posttest control group design, drawn from true experimental research methods, was employed. A sample of forty fourth-grade students was randomly selected from a private school in Aroop, Gujranwala. Forty students were chosen and divided into two groups: twenty were randomly assigned to the control group and twenty to the experimental group. The control group was taught using traditional teaching methods, while the experimental group received instruction through a print-rich method. Lesson plans incorporating the print-rich method were specifically designed by the researcher for the experimental group. The control group continued with the traditional teaching method for one month. An English Language Reading Proficiency (ELRP) test was developed by the researcher to assess reading skills. The test's validity was confirmed using quantitative methods and expert opinion. Data were collected from both groups, with pre-tests and post-tests administered. The results showed that students taught using the print-rich method confirmed greater improvement in reading proficiency compared to those taught using traditional methods. The study's review clearly indicated, in light of other researchers' earlier research investigations, that this study is beneficial for English language learners that print rich classroom offers a variety of chances for students to advance their English language reading abilities both within and outside of the classroom.

Exploring the Grammatical Complexity of International Teaching Assistants: A Comparative Corpus Study

AbstractThe purpose of this study is to analyze the grammatical complexity features of international teaching assistants' (ITAs) mock‐teaching presentations and to compare the distributions of these features to those found in the Oral English Proficiency Test (a local ITA assessment), university classroom teaching, conversation, and academic writing. The data consisted of 186 prospective ITAs' mock‐teaching presentations collected from two ITA training courses at a large U.S. university: one higher‐level course and one lower‐level course. All presentations were transcribed, proofread, and built into a corpus consisting of 247,043 words. Based on the previous corpus studies, a total of 22 grammatical complexity features were selected for the analysis. Overall, the discourse of ITA mock‐teaching involved a substantial number of both the grammatical complexity features commonly found in spoken conversation (e.g., finite adverbial clauses and modals) and those commonly used in academic writing (e.g., noun premodifiers and prepositional phrases). The frequency distributions of the features differed in complex ways between ITA mock‐teaching and the other registers, as well as between the higher‐level and lower‐level ITAs. Pedagogical implications for ITA training and assessment, and future research directions are discussed at the end.

Examining the role of achievement goals in L2 learning: A cross-sectional and longitudinal study

Achievement goals (AGs) have been argued to influence general learning processes and outcomes, while their roles in L2 learning remain underexplored. This study, consisting of two sub-studies, aims to examine how different types of AGs (mastery-approach goals, performance-approach goals, mastery-avoidance goals, and performance-avoidance goals) contribute to overall and skill- (knowledge-)11Note. In this study, ‘skill-specific achievement’ refers to academic performance measured across three core language skills—listening, reading, and writing—and two knowledge domains, vocabulary and grammar. For readability, the term ‘skill-specific achievement’ is used consistently to encompass both the language skills and the knowledge domains. specific L2 achievement (curriculum-based course exam scores) and proficiency (Cambridge English proficiency test scores) using cross-sectional and longitudinal approaches. Participants of both sub-studies were 1,355 adolescent EFL learners from a junior high school in rural China. In Sub-study 1, the students participated in a questionnaire survey, an end-term English exam, and a Cambridge English proficiency test. Path analysis results showed that different AGs predicted overall and skill-specific L2 achievement and proficiency with variations. In Sub-study 2, the same participants completed three waves of questionnaire surveys and end-term exams spanned over three 6-month semesters. Cross-lagged panel modelling results indicated that AGs positively influenced subsequent achievement, but the effects were unstable; achievement positively and stably influenced subsequent AGs. Our findings provide implications for L2 teachers to help their students set goals to close their achievement gap and reach their full L2 potential.

Face validity and washback effects of the shortened PTE Academic: insights from teachers in Mainland China

Pearson Test of English Academic (PTE Academic), a high-stakes English language proficiency test, underwent substantial revisions in 2021. The test duration was reduced from 3 h to 2 h by reducing specific task numbers and sections. This study investigates the impact of these changes on teachers’ perceptions and teaching practices, areas previously underexplored in language assessment literature. It focuses on the implications of the test’s modifications, examining the face validity and washback effects through the lens of teachers in mainland China. Semi-structured interviews with four experienced PTE Academic test trainers, who were familiar with both the original and revised test formats, reveals that the revised PTE Academic is perceived to maintain strong face validity, particularly noted in its academic authenticity, balanced skill structure, and perceived result accuracy. Additionally, most teachers perceived an increase in test difficulty. A mixed washback effect was observed: while improvements in students’ language competence—a positive outcome—were noted, teachers also reported a continued reliance on teaching test-oriented strategies for higher-scoring tasks, indicating negative washback. This study highlights the significant implications of reducing PTE Academic’s duration and offers targeted recommendations for its future improvement. These suggestions aim to enhance students’ academic language skills, thereby better aligning PTE Academic with the practical language abilities required in university settings.

Influence of Working Memory Capacity on English Language Learning of High School Students School

In recent years, the relationship between working memory and second language acquisition has been a hot topic in the field of second language acquisition. The impact of second language learners’ working memory capacity on their second language acquisition is inconclusive. Researchers have called for further investigation into the role of working memory in second language development when reviewing literature on working memory in second language acquisition. called for further investigation into the role of working memory in second language development when reviewing literature on working memory in second language contexts and language contexts. Therefore, this study aims to explore whether and how working memory capacity affects overall English proficiency. The research question is: what is the correlation between high school students' working memory capacity and their English grades? This study used empirical research methods and randomly selected 37 high school students from a school in Dujiangyan, Chengdu as participants. empirical research methods and randomly selected 37 high school students from a school in Dujiangyan, Chengdu as participants. Data sources included Data sources included working memory capacity tests and English proficiency tests, both of which were conducted in the students’ classrooms. Descriptive statistics and Pearson correlation analysis were performed using SPSS 26.0 statistical analysis software. The study shows that there is a significant correlation between working memory capacity and English proficiency test scores. The correlation between The correlation between working memory and English proficiency test scores suggests that individual differences in working memory capacity can affect important cognitive activities such as listening, reading comprehension, reasoning, writing, and problem-solving. The correlation between working memory and English proficiency test scores suggests that individual differences in working memory capacity can affect important cognitive activities such as listening, reading comprehension, reasoning, writing, and problem-solving.

Mastery of Listening and Reading Vocabulary Levels in Relation to CEFR: Insights into Student Admissions and English as a Medium of Instruction

Prior to enrolling in an English as a medium of instruction (EMI) institution, students must show an English proficiency level through meeting a benchmark on a standard English proficiency test, which is typically aligned with the Common European Framework of Reference for Languages (CEFR). Along with overall English proficiency, aural/written vocabulary level mastery could also predict students’ success at EMI institutions, as students need adequate English vocabulary knowledge to comprehend lectures and course readings. However, aural/written vocabulary level mastery has yet to be clearly benchmarked to CEFR levels. Therefore, this study aimed to investigate the correlations between students’ aural/written vocabulary level mastery and their CEFR levels. Forty undergraduate students in a Macau EMI university were recruited to take one English proficiency test and two vocabulary level tests (i.e., Listening Vocabulary Levels Test (LVLT) and the Updated Vocabulary Levels Test (UVLT)). Correlation analyses were conducted to explore the relationship between students’ CEFR levels and their mastery of listening and reading vocabulary levels. A positive correlation was found between students’ CEFR levels and their mastery of receptive aural vocabulary levels (ρ = 0.409, p = 0.009). Furthermore, a statistically significant positive correlation was found between students’ CEFR levels and their mastery of receptive written vocabulary levels (ρ = 0.559, p < 0.001). Although positive correlations were observed, no clear pattern was identified regarding the relationship between students’ CEFR levels and their mastery of aural/written vocabulary levels. Regression analyses were further conducted to determine the extent to which the combination of receptive aural and written vocabulary knowledge predicts the CEFR levels. The results indicated that the regression model that included only UVLT scores better predicted the CEFR levels. Given the positive correlations observed between students’ CEFR levels and their mastery of vocabulary levels, this study’s findings suggest the inclusion of aural/written vocabulary levels as additional indicators for ensuring student academic success in EMI institutions. Implications for EMI universities on student admissions, classroom teaching, and provision of additional English courses were provided.

Exploring the Efficiency of Associative Vocabulary Teaching Strategies to Foreign Language Learners

This study attempted to explore the effect of applying three associative vocabulary instruction strategies (context-based, morphemic analysis and concept map) compared with the traditional strategies on the intermediate EFL learners' vocabulary development employing a quasi-experimental, quantitative, pre-test/post-test design. With the aid of an English proficiency test and a researcher-developed vocabulary test the homogeneity of the participants were checked before the study's treatment. Subsequently, 80 intermediate EFL learners were chosen via convenience sampling procedure from private language schools and recruited for the study and divided into four groups of 20 as the experimental and control participants. The experimental participants were taught the target lexical items with the aid of contexts, concept maps and morphemic analyses while the control participants experienced the traditional instruction (i.e., L1 equivalent provision, word lists, flashcards and memorization). The same vocabulary test was administered this time as the post-test to check whether there was a significant difference in the learners’ attainment for the taught lexical items. The performance of the participants on the vocabulary post-test was analyzed both descriptively and inferentially (a MANOVA, an ANOVA and an independent-samples t-test). It was revealed that all the associative vocabulary teaching strategies were significantly more efficient than the traditional vocabulary teaching strategies. Moreover, it was found that concept mapping was the most efficient instructional strategy for teaching the lexical items compared with the traditional strategies and other associative strategies for the intermediate EFL learners.

Bahasa Inggris sebagai Katalis Perubahan: Memberdayakan Mahasiswa Manajemen Indonesia untuk Mendorong Pertumbuhan Ekonomi Berkelanjutan

This classroom action research aimed to explore an innovative approach to teaching English that specifically targets the development of communication skills required for implementing sustainable business strategies. The study was conducted at the Sekolah Tinggi Ilmu Ekonomi Pariwisata Indonesia (STIEPARI) Semarang, involving 30 management students. The research employed a mixed-methods approach, collecting data through surveys, interviews, classroom observations, and English proficiency tests. The findings revealed that the innovative teaching method, which integrated sustainability concepts and focused on developing relevant business communication skills, effectively enhanced students' English competence and understanding of applying sustainability concepts in business. The increased English proficiency positively impacted students' comprehension and ability to implement sustainability principles in business contexts. The study concludes that integrating sustainability concepts into English language learning for business purposes is an effective strategy for developing management students' competencies as change agents in promoting sustainable business practices. Recommendations for future research include expanding the sample, conducting longitudinal studies, exploring teachers' perspectives, and collaborating between business management academics and English language experts.

English in the internationalization of higher education and international student mobility

Abstract In this article, we discuss the significance of English in the internationalization of higher education and international student mobility, using Kachru’s (1985) Three Circles Model of World English. As education is one of the major forms of migration (Liu-Farrer, 2022; Borlongan, 2023) in the so-called ‘age of migration’ (cf. de Haas, Castles, & Miller, 2020), more and more students are motivated to study abroad to complete their tertiary education. First, we discuss motivating factors both for the internationalization of higher education and international student mobility. Second, we point out how English has been playing a very central role in the internationalization of higher education institutions and international student mobility (Philipson, 2010; Jenkins, 2017) among these factors. Then, we present the dynamics of international student mobility by looking at their global flow, English-medium programs, and English language proficiency requirements. While Inner Circle countries are still the most attractive destinations for most international students, Expanding Circle countries, where English is not an institutionalized medium of instruction in higher education, also value English by expanding English-medium degree programs and requiring English proficiency test scores to admission. Finally, we end the article by reiterating the dominance and utility of English in the internationalization of higher education and international student mobility and its stable position as the language of educational migration.

From Pen to Pixel

The use of digital technologies in higher education is continually increasing, leading to changes in language use and presumably altering the language skills needed for academic studies. However, scores from high-stakes English language proficiency (ELP) tests used in postsecondary admissions only ensure the prerequisite level of traditional English skills (reading, writing, listening, and speaking). Such tests generally do not directly assess technology-mediated language skills (e.g., using online dictionaries and communicating via text message) that likely facilitate successful degree completion for international students. We present results from a needs analysis survey to re-evaluate the English-medium postsecondary linguistic landscape (i.e., update the target language use domain description), to inform ELP admissions tests. We specifically investigate international student (n = 379) and disciplinary instructor (n = 427) perceptions of the importance and frequency of technology-mediated language skills. Results show that student and instructor responses differ on certain technology-mediated skills, such as typing on a smartphone, underscoring the need to consider diverse perspectives in domain analysis research. Findings may inform how digital ELP admissions tests are developed, and how English for academic purposes curricula are designed, in order to better align test/classroom tasks with the academic language skills postsecondary students need.

Concgrams and Writing Quality in Test Compositions

Phraseology has been flourishing in the field of English writing studies in recent years. However, the focus has primarily been on items with less variability, such as ngrams or lexical bundles. To address this gap, this study investigates concgrams (Cheng et al., 2006), which encompass both constituency and positional variations, in advanced General English Proficiency Test (GEPT) writings. One hundred compositions from the GEPT were divided into two proficiency groups based on their scores and analyzed using the corpus tool ConcGram 1.0. The phraseological characteristics of concgrams are explored from four perspectives: frequency, type-token ratios (TTRs), word associations, and configuration. The goal is to determine the relevance of the use of concgrams to writing evaluation. The results indicate that TTRs and configuration play minor roles, while frequency and word associations appear to be more relevant to excellent writing. This study highlights the importance of including more variable phraseological units and provides a new approach to investigating the presence of phraseological units in greater depth.

A Rasch-based validation of the University of Tehran English Proficiency Test (UTEPT)

Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick’s validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to examine the validity of the University of Tehran English language proficiency test (UTEPT) using 6 aspects of Messick’s validation framework (i.e., content, structural, external, generalizability, substantive, and consequential). To examine each validity dimension, the Rasch model was considered. To this end, the data of 394 test takers who had taken the test in 2023 were cleaned and analyzed for the assumptions of the Rasch model and then for the 6 aforementioned validity aspects. The results indicated that the structural (i.e., unidimensionality), generalizability (i.e., measurement invariance), and substantive aspects held. However, the evidence for the content, external, and consequential aspects of validity was less definitive. The implications of the findings for the validity of the test, for the realm of language testing, and for item developers and item writers will be discussed.

The Academic Achievement of Undergraduate Students with Different English Language Proficiency Profiles

ABSTRACT Many English-medium universities employ a compensatory model to establish cutscores on English language proficiency tests for student admissions. In this model, students can have different scores on different sections of the test provided their overall score meets the admission cutscore. This practice raises questions regarding potential variation in academic achievement among students with diverse score profiles. To address these questions, this study compared the demographic characteristics and academic achievement of 3,694 undergraduate students who met the required cutscore on the IELTS-Academic for admission to a Canadian English-medium university but have different scores on different sections of the test. The findings indicated that, generally, students with medium reading scores combined with low or medium writing scores exhibited lower academic achievement compared to those with high scores on all the IELTS sections or high reading scores combined with medium or high writing scores. The profile groups demonstrated significant differences in certain demographic characteristics, potentially explaining why they have different proficiency levels in different language skills. The implications of the findings are discussed, including whether to maintain the compensatory model or switch to a mixed one, and the implications for providing English language support to students with diverse proficiency profiles.

Exploring the effects of intelligent personal assistants on bilingual education teachers’ L2 speaking proficiency

ABSTRACT Communication in a second and foreign language (L2) is regarded as the most challenging and anxiety-inducing language skill for L2 learners and teachers. The emergence of artificial intelligence and automatic speech recognition (ASR) has opened new avenues for enhancing L2 interaction, with intelligent personal assistants (IPAs) showing significant potential. While prior research has predominantly focused on learners, using IPAs for bilingual education (BE) teachers has received relatively little attention. The study investigated the effects of IPAs (i.e. Google Assistant) on BE teachers’ L2 speaking proficiency and their perceptions of IPA-assisted L2 speaking. Thirty Taiwanese BE teachers who were L2 English speakers participated in a semester-long IPA-mediated interaction program. These teachers interacted with Google Assistant in their daily lives. Both quantitative (English speaking proficiency tests) and qualitative data (semi-structured interviews) were collected and analyzed. The results revealed that Google Assistant significantly promoted BE teachers’ English-speaking proficiency. Most teachers confirmed that Google Assistant could establish an authentic environment that facilitates communication, increases English-speaking opportunities, enhances practice frequency, and provides scaffolding and immediate feedback, which contribute to their English speaking proficiency. Integrating Google Assistant into lesson preparation proved valuable, enabling teachers to access curriculum-related information efficiently and increasing their motivation to engage with IPAs.

The Influence of Learning Strategy on the English Oral Proficiency of English Majors under the Background of Media Convergence

With the gradual development of information and media technologies, more and more tools are available in the process of language learning. In this context, the impact of the use of learning strategies on the spoken English proficiency of English majors has received widespread attention. In this study, the use of metacognitive, cognitive, and social-emotional strategies on the learning strategies of oral English was studied through questionnaires and oral English proficiency tests. The results show that the frequency of use of different learning strategies is significantly positively correlated with the oral English level of English majors in the context of media integration, that is, the use of learning strategies has a positive effect on the improvement of English-speaking level of English majors.

English medium instruction learners’ self-efficacy, engagement, and satisfaction; developing a measurement instrument

ABSTRACT This paper describes the development of a survey instrument to measure learners’ self-efficacy, engagement, and satisfaction within the context of English Medium Instruction (EMI) classes, with reference to both language issues and the discipline being taught. The paper presents details of analysis of the instrument using the Rasch model. The survey was administered to 287 tertiary students enrolled in EMI classes in Japan. Results of a Rasch Principal Components Analysis of Residuals showed the three intended constructs to be largely unidimensional. Item-level analysis, as well as reliability and separation measures and an investigation of Wright maps, provided further evidence that the items are working adequately to measure each of the three constructs and to allow differentiation between levels of each construct among the respondents. In addition, the effectiveness of the 6-point Likert scale used was confirmed with an analysis of category structure functioning. Finally, a correlation analysis with a subset (n = 97) of the participants for which English proficiency test scores were available was conducted. Results showed a small, statistically significant and positive relationship between reading proficiency and each of the three constructs.

Examining Performance on an Integrated Writing Task from a Canadian English Language Proficiency Test

Many English language proficiency (ELP) tests used for university admissions and placement now include integrated writing tasks that require examinees to use external sources when writing. Integrated writing tasks improve test authenticity and impact, but they raise several validity questions, such as what academic language skills they engage and whether performance on these tasks varies with examinee ELP level. This study addresses these questions with reference to an integrated writing task from the Canadian Academic English Language (CAEL) Test that involves reading, listening, and writing in academic contexts. Responses by 59 students to one of the CAEL integrated writing tasks are analyzed in terms of various grammatical, discourse, sociolinguistic, strategic, content, and source use aspects and compared across ELP levels (high and low) and score levels. The findings indicate that both ELP level and score level had significant effects on most writing features examined in the study, except for syntactic complexity. Additionally, except for syntactic complexity, all writing dimensions examined in the study were significantly associated with writing scores. The findings and their implications for the validity argument of source-based writing tasks are discussed.