Evidence Based Social Science in China Paper 4 : The quality of social science systematic reviews and meta-analysis published from 2000-2019

Abstract

ObjectivesTo examine the characteristics, methodological and reporting quality of systematic reviews and meta-analyses in social science journals in China. Study Design and SettingThe Chinese Social Sciences Citation Index (CSSCI) databases were searched for systematic reviews and meta-analysis published between January 2000 and December 2019. We randomly selected 200 articles from the 401 identified in our search. The Assessing the Methodological Quality of Systematic Reviews (AMSTAR) and the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) checklists were used to assess the methodological and reporting quality, respectively. ResultsThe 200 articles we selected covered a wide range of research fields in 9 disciplines, most of which belonged to management, education and psychology. The mean AMSTAR score and PRISMA score was 8.99 ± 3.36 points and 14.74 ± 3.96 points, respectively. These findings indicated that the quality of the systematic reviews was below the average level. Meanwhile, year of publication was related to both methodological quality (P = 0.001) and reporting quality (P < 0.01). ConclusionAlthough many systematic reviews and meta-analysis have been published in top Chinese journals, the methodological and reporting quality is troubling. Thus, the most urgent task is to increase the standard of systematic reviews and meta-analysis of every discipline rather than continuing to publish them in great quantity.