A network ethnography of international large-scale assessment contracting: scientific knowledge as messy, provisional, complex, and subjective

Abstract

ABSTRACT While methodologies are often presented as standardised procedures which, under specified conditions, should lead to the same conclusions, this case study presents the complex and deeply personal process of research (Addey and Piattoeva 2022). We analyse our application of network ethnography – an approach presented by Ball (2016) – to the study of contractors developing international large-scale assessments, exploring how we, as scholars, become with our methodology and navigate the ‘messiness’ of research (Law 2004). Drawing on Science and Technology Studies (STS) to understand the constitutive role of methodology and performativity of knowledge-making (Law and Singleton 2013, Rimpiläinen 2015), we show how methodological decisions construct what is studied and ourselves. Finally, we discuss challenges of visual representation, applying Galloway’s (2011) ‘conversion rules’ to examine what was unrepresented – or unrepresentable. This paper shows the complex, subjective, and provisional nature of knowledge, theorising ‘heterogeneity and variation’ (Law 2004) as an inherent part of methodological application.