International Journal of Testing | VOL. ahead-of-print
Read

Examining patterns of omitted responses in a large-scale English language proficiency test

Publication Date May 6, 2022

Abstract

This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses as missing rather than wrong showed that examinees had underperformed by skipping the answers, with a greater underperformance among more able participants. An analysis of omitted answer patterns showed that reading passage items were most likely to be omitted, and that native language-translation items were least likely to be omitted. We hypothesized that since reading passage items were most tempting to skip, then among examinees who did answer every question there might be a tendency to guess at these items. Using cluster analyses, we found that underperformance on the reading items was more likely than underperformance on the non-reading passage items. In large-scale operational tests, examinees must know the optimal strategy for taking the test. Test developers must also understand how examinee behavior might impact the validity of score interpretations.

Concepts

Language Proficiency Test Examinee Behavior Reading Items Large-scale Language Large-scale Test English Proficiency Test Responses In Test Cluster Analyses English Test English Proficiency

Round-ups are the summaries of handpicked papers around trending topics published every week. These would enable you to scan through a collection of papers and decide if the paper is relevant to you before actually investing time into reading it.

Coronavirus Research Articles published between Sep 26, 2022 to Oct 02, 2022

R DiscoveryOct 03, 2022
R DiscoveryArticles Included:  5

Introduction: Test solutions (Biotrue, renu Advanced [Bausch and Lomb], ACUVUE RevitaLens [Johnson and Johnson Vision], cleadew [Ophtecs corp.] or AOS...

Read More

Good health Research Articles published between Sep 26, 2022 to Oct 02, 2022

R DiscoveryOct 03, 2022
R DiscoveryArticles Included:  2

Patient and public involvement in health care is considered indispensable in the way we conduct daily pediatric neurology practice, and in the develop...

Read More

Quality Of Education Research Articles published between Sep 26, 2022 to Oct 02, 2022

R DiscoveryOct 03, 2022
R DiscoveryArticles Included:  5

Ingenta is not the publisher of the publication content on this website. The responsibility for the publication content rests with the publishers prov...

Read More

Gender Equality Research Articles published between Sep 26, 2022 to Oct 02, 2022

R DiscoveryOct 03, 2022
R DiscoveryArticles Included:  3

Introduction: As of early March 2022, the COVID-19 pandemic has killed more 5.9 million people worldwide, and infected more than 437 million.

Read More

Coronavirus Pandemic

You can also read COVID related content on R COVID-19

R ProductsCOVID-19

ONE PROBLEM . ONE PURPOSE . ONE PLACE

Creating the world’s largest AI-driven & human-curated collection of research, news, expert recommendations and educational resources on COVID-19

COVID-19 Dashboard

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on “as is” basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The Copyright Law.