Partial Strong Measurement Invariance Research Articles

New evidence of factor structure and measurement invariance of the SDQ across five European nations.

The main purpose of the present study was to analyse the internal structure and to test the measurement invariance of the Strengths and Difficulties Questionnaire (SDQ), self-reported version, in five European countries. The sample consisted of 3012 adolescents aged between 12 and 17 years (M = 14.20; SD = 0.83). The five-factor model (with correlated errors added), and the five-factor model (with correlated errors added) with the reverse-worded items allowed to cross-load on the Prosocial subscale, displayed adequate goodness of-fit indices. Multi-group confirmatory factor analysis showed that the five-factor model (with correlated errors added) had partial strong measurement invariance by countries. A total of 11 of the 25 items were non-invariant across samples. The level of internal consistency of the Total difficulties score was 0.84, ranging between 0.69 and 0.78 for the SDQ subscales. The findings indicate that the SDQ's subscales need to be modified in various ways for screening emotional and behavioural problems in the five European countries that were analysed.

Measurement Invariance of Divergent Thinking Across Gender, Age, and School Forms

The present study explores the factorial structure and the degree of measurement invariance of 12 divergent thinking tests. In a large sample of German students (N = 1328), a three-factor model representing verbal, figural, and numerical divergent thinking was supported. Multigroup confirmatory factor analyses revealed that partial strong measurement invariance was tenable across gender and age groups as well as school forms. Latent mean comparisons resulted in significantly higher divergent thinking skills for females and students in schools with higher mean IQ. Older students exhibited higher latent means on the verbal and figural factor, but not on the numerical factor. These results suggest that a domain-specific model of divergent thinking may be assumed, although further research is needed to elucidate the sources that negatively affect measurement invariance.

Examining the Measurement Invariance between Paper-and-Pencil and Internet-Administered Tests in China

Concerns about the quality of internet-based tests have been brought by the increasing applications of such tests in psychological research. Over the past years, a large body of studies has been conducted to examine the equivalence of internet-administered tests to their paper-and-pencil counterparts. Although studies based on Classic Test Theory (CTT) showed that internet-administered tests were trustable, studies based on measurement invariance tests produced mixed findings. What is more, most studies so far have been conducted in individualistic cultures. Given these,, the present study aimed to examine the equivalence between internet-based and paper-and-pencil tests in a collectivistic culture, particularly, in China. To this end, we employed Confirmatory Factor Analysis (CFA) to examine the measurement invariance of the selected scale: Satisfaction with Life Scale (SWLS) across modes. SWLS was administered via internet and the paper-and-pencil modes. Five items were rated on a 7-point likert scale ranging from 1 ("strongly disagree") to 7 ("strongly agree"). A total of 418 self-selected college students from 26 provinces in China took the internet-based test. And a total of 288 college students at Sun Yat-Sen University were sampled to take the paper-and-pencil test in classroom. For the internet sample, the age ranges from 18 to 24 years old with a mean of 21.31 (SD= 1.38); for the paper-and-pencil sample, the age ranges from 18 to 24 years old with a mean of 20.20 (SD=0.81). Multi-group CFA was employed to test measurement invariance between the internet administered and the paper-and-pencil SWLS. Results showed weak measurement invariance held across these two test modes, indicating metric similarity between the tests; partial strong measurement invariance and partial strict measurement invariance also held, suggesting that response bias existed in some items across modes; further analysis revealed that the paper-and-pencil test included more noise arising from administering environment. In terms of mean comparisons, significant differences between modes were found in observed scores but not in latent scores. For the variances, no significant differences were found between modes in either latent scores or observed scores. These findings suggested that administering environments produced potential impacts on observed scores. As the first examination of the measurement invariance in Chinese samples, the study provided initial evidence that internet-based tests have equivalent metrics with paper-and-pencil tests. Further, the results from the partial strong invariance and partial strict invariance may indicate the sensitivity of Chinese people to environments that may be resulted from collectivistic culture. Taken together, the findings from this study suggest that although internet-based tests are trustable in China, cautions of response biases should be kept in mind when conducting cross-groups (or modes) comparisons. Also, the findings underscore the importance of examining measurement invariance when a test is applied across multi-groups (or modes).