The Applicability of Standard Error of Measurement and Minimal Detectable Change to Motor Learning Research-A Behavioral Study.

Leonardo Furlan,Annette Sterr

doi:10.3389/fnhum.2018.00095

Leonardo Furlan, Annette Sterr

Open Access

https://doi.org/10.3389/fnhum.2018.00095

Copy DOI

Abstract

Motor learning studies face the challenge of differentiating between real changes in performance and random measurement error. While the traditional p-value-based analyses of difference (e.g., t-tests, ANOVAs) provide information on the statistical significance of a reported change in performance scores, they do not inform as to the likely cause or origin of that change, that is, the contribution of both real modifications in performance and random measurement error to the reported change. One way of differentiating between real change and random measurement error is through the utilization of the statistics of standard error of measurement (SEM) and minimal detectable change (MDC). SEM is estimated from the standard deviation of a sample of scores at baseline and a test–retest reliability index of the measurement instrument or test employed. MDC, in turn, is estimated from SEM and a degree of confidence, usually 95%. The MDC value might be regarded as the minimum amount of change that needs to be observed for it to be considered a real change, or a change to which the contribution of real modifications in performance is likely to be greater than that of random measurement error. A computer-based motor task was designed to illustrate the applicability of SEM and MDC to motor learning research. Two studies were conducted with healthy participants. Study 1 assessed the test–retest reliability of the task and Study 2 consisted in a typical motor learning study, where participants practiced the task for five consecutive days. In Study 2, the data were analyzed with a traditional p-value-based analysis of difference (ANOVA) and also with SEM and MDC. The findings showed good test–retest reliability for the task and that the p-value-based analysis alone identified statistically significant improvements in performance over time even when the observed changes could in fact have been smaller than the MDC and thereby caused mostly by random measurement error, as opposed to by learning. We suggest therefore that motor learning studies could complement their p-value-based analyses of difference with statistics such as SEM and MDC in order to inform as to the likely cause or origin of any reported changes in performance.

Highlights

In motor learning studies, investigators typically assess individuals for their performance on a motor task before, during, and after a period of training on the same task (e.g., Pascual-Leone et al, 1994; Karni et al, 1995; Reis et al, 2009; Debas et al, 2010; Abe et al, 2011; Platz et al, 2012a,b)
We designed a computer-based motor task to illustrate the applicability of standard error of measurement (SEM) and minimal detectable change (MDC) to motor learning research
Two studies were conducted with healthy participants

Summary

Introduction

Investigators typically assess individuals for their performance on a motor task before, during, and after a period of training on the same task (e.g., Pascual-Leone et al, 1994; Karni et al, 1995; Reis et al, 2009; Debas et al, 2010; Abe et al, 2011; Platz et al, 2012a,b). It can contribute for instance to improve learning in sports, music, industry, and medical training (Schmidt and Lee, 2014), and has been extensively linked to sleep research (Landmann et al, 2014). Another relevant application includes the optimization of (re)learning in patients undergoing physical rehabilitation, for example, after brain damage such as stroke (Dayan and Cohen, 2011; Censor et al, 2012; Winstein et al, 2014; Krakauer, 2015; Torriani-Pasin et al, 2016; Buch et al, 2017). Given its practical relevance, it seems important that motor learning studies provide information on the statistical significance and size, and on the likely cause or origin of any reported changes in performance, that is, on the contribution of both real modifications in performance and random measurement error to the reported changes

Methods

Results

Conclusion