Assessing scientific reasoning competencies of pre-service science teachers: translating a German multiple-choice instrument into English and Spanish

Abstract

ABSTRACT Scientific reasoning competencies are relevant science competencies and therefore the development of assessment instruments for scientific reasoning competencies has become an integral part of science education research. However, some authors have questioned the validity of the instruments available so far, since their psychometric quality has not been evaluated satisfactorily. In this study, an established German multiple-choice instrument to assess scientific reasoning competencies has been translated into English and Spanish and the translated versions were evaluated based on the translation, review, adjudication, pretesting and documentation (TRAPD) approach. Based on samples of German (N = 497), Australian (N = 103), and Chilean (N = 135) pre-service science teachers, statistical analyses (e.g. dimensionality and DIF analyses) provide psychometric evidence for test equivalence between the German and the translated versions of the instrument. Known groups comparisons provide evidence for the valid interpretation of the test scores as measures of scientific reasoning competencies. It is discussed that further studies might evaluate additional sources of validity evidence for the translated versions of the instrument, particularly focusing on cultural specificities. Independent of this need for further research, it is suggested that the three versions can be used to assess the scientific reasoning competencies of pre-service science teachers whose first language is English, German, or Spanish.