The ETS iSkillsTM Assessment: a digital age tool

Abstract

PurposeThe purpose of this paper is to show how information and communications technology (ICT) literacy skills reflect twenty‐first century requirements for researching and communicating information in digital environments. An interactive problem‐based, scenario‐based, web‐based assessment tool, iSkillsTM, has been developed through a broad‐based effort to establish standards for performance and certification of ICT literacy proficiencies. This paper aims to discuss the assessment's potential in determining the effectiveness of instruction programs.Design/methodology/approachSince January 2001, a consortium of experts in ICT literacy served as advisors to the Educational Testing Service (ETS) test developers as they designed an internet‐delivered assessment that measures students' abilities to research, organize, and communicate information using technology. This paper reviews that R&D process, concluding with an example of its application to information literacy program planning and evaluation. A mixed methods approach collected and analyzed qualitative sources and iSkillsTM pre‐test/post‐test data for first‐year Purdue University students.FindingsFindings informed curricular decisions for instituting an integrated problem‐based learning (PBL) information literacy program. Secondary goals included developing an understanding of how information‐processing skills are acquired, identifying best practices for integrating information literacy into the curriculum, and assessing the impact of skill acquisition on overall academic achievement. ICT literate students are generally better problem‐solvers, more self‐directed, and communicate ideas more efficiently.Practical implicationsUniversities are beginning to require ICT literacy as competencies for graduation. This paper presents a new strategy for assessing the effectiveness of instructional programs which aim to matriculate proficient students.Originality/valueThis paper reports on the efficacy of a problem‐based learning (PBL) approach involving three convergent principles of design: the organization and dissemination of information, the creation and communication of information, and problem solving within the context of research projects and assignments. As such, it provides important insights into pairing an innovative instructional approach and the iSkillsTM ICT literacy assessment.