Towards a Living Systematic Review

Abstract

Calls for examining the psychometric properties of games as assessments have continued to circulate in subsequent years. Therefore, the current authors posit that the foundation created by de Klerk and colleagues should be treated as a living systematic review and updated with the most current research. Here, the initial step is taken in updating de Klerk and colleagues' systematic review by asking the research question: What psychometric trends have emerged surrounding the analysis of performance data in game-based assessments within the current educational research? First, the current authors update the systematic review to cover the intervening years (2014 - 2021). Second, the current authors examine the trends found in de Klerk and colleagues' work and the updated findings. As an extension to de Klerk and colleagues' analysis, the current authors also evaluated sources of validity evidence and, if present, the framework used in each article to align the in-game data to the measured knowledge, skill, or ability (KSA).