Validity arguments for creating a short motivation scale through adaptation of the Japanese motivated strategies for learning questionnaire

Abstract

Background The coronavirus disease pandemic has substantially altered the mode of medical education, transitioning it from in-person to online. Online learning requires a strong motivational foundation to support self-directed studying. In our previous study, an adapted 31-item Japanese motivation measurement scale using the motivational section from the Japanese version of the Motivated Strategies for Learning Questionnaire (J-MSLQ) was developed. The present study aimed to collect evidence on the validity of the motivation section of the J-MSLQ and clarify whether further revision was necessary. Methods The motivation section of the J-MSLQ comprises a seven-point Likert scale survey containing 31 items. Of 127 fourth-year Japanese medical students invited to participate, 112 responded. Confirmatory factor analysis with structural equation modeling (SEM) was performed using R and R studio for all data analysis. Results The initial SEM model that incorporated all 31 items exhibited inadequate goodness of fit metrics: χ2 = 823.674 (p < 0.001), the comparative fit index (CFI) = 0.786, the root mean square error of approximation (RMSEA) = 0.093, the standardized root mean square residual (SRMR) = 0.112, the goodness of fit index (GFI) = 0.664, and the adjusted goodness of fit index (AGFI) = 0.602. We optimized the scale by eliminating 12 items with a Z test statistic < 10. Improvements in the goodness of fit metrics of the optimized SEM model were observed, demonstrating moderate model fit: χ2 = 205.602 (p < 0.001), CFI = 0.929, RMSEA = 0.080, SRMR = 0.063, GFI = 0.837, AGFI = 0.768. Conclusions A compact 18-item version of the motivation scale was developed and validated, which alleviated the respondent burden and enabled the researchers to collect data in a shorter time.