Different Methods – Different Results: How the Swedish Results in Mathematics Vary Depending on Methodological Approach

Abstract

The results for TIMSS population 2 in Sweden indicated that Swedish student achievement in mathematics was average. There were even mass media reports that indicated that Swedish students had some of the lowest results in mathematics. The issue that is addressed in this article is whether the performance of Swedish students is average or even low. To answer this, the basis of comparison between the different countries needs to be discussed. Mass media, for example, based its comparison on all 45 countries participating in TIMSS population 2 and in its national TIMSS report, the Swedish National Agency for Education presented a different selection of countries. The report compared the results of the 25 countries that met the sampling requirements set by the TIMSS International Study Centre. This focuses the discussion on what approaches are used when comparing results from different countries in an international comparative study. In this article the TIMSS results, as presented by the Swedish National Agency for Education, are compared with the results obtained with other methodological approaches. The comparison is based on the importance of three variables for the results of the comparison: equal number of years in school, the selection of countries, and the contents of the textbooks in the different countries. The results indicate that the number of years in school, as well as the content of the textbooks in each country, are important factors when comparing the results for different countries.