Lost in translation: PISA experts, brokers, and marionettes

Abstract

ABSTRACT This paper explores how the OECD acts a broker of knowledge-making in the development of PISA, the most widely known International Large-Scale Assessment. Drawing on the work of Bandola-Gill, Grek, and Tichenor (2022) and analysing empirical data gathered through interviews with OECD staff and PISA contractors and experts, the paper analyses how the OECD brokers the making of comparative knowledge on learning outcomes. The paper does this by unpacking what counts as expertise in the making of PISA, and how the OECD manages and uses this expertise. Exploring the ways that international organizations broker experts and utilize expertise reveals how IOs first select experts and then delegate their expert-brokering role; they then seek to share the delegated process; and finally, take back expert-brokering and knowledge-production by creating, or decreeing, consensus. The paper also shows how expertise – beyond informing on a technical level – is used to shift scientific responsibilities and build global consensus.