Measurement Invariance Testing Research Articles

Questionnaire for the Assessment of Coparenting (CECOP): Development and Validation

Taking coparenting into consideration is essential when assessing children and their relational environment, regardless of the family structure. This paper presents three studies we conducted with the aim of developing and validating a reliable instrument for the assessment of coparenting in Spanish. The first study consisted of developing the items to be included in the assessment tool and evaluation of this content by a panel of nine experts. In the second study, we explored both the psychometric properties and the factorial structure of the prototype instrument using a sample of 251 participants. The third study confirmed the factorial structure and tested measurement invariance, the reliability, and convergent and discriminant evidence of our tool in a general population sample of 312 participants. We obtained a 15-item unidimensional questionnaire, the Questionnaire for the Assessment of Coparenting (CECOP), with very good psychometric properties: excellent internal consistency with α of 0.97 and supported validity with the selected conceptually related metrics; convergent validity with the Instrument for the Assessment of Adaptation to Divorce–Separation’s (CADS) coparenting dimension and Questionnaire on Perceived Support from the Former Partner (CARE); and divergent validity with parenting and dyadic adjustment. Furthermore, the results in terms of measurement invariance across family structures and sex allowed us to assume the configural invariance between the groups. However, it was not possible to assume metric invariance. Finally, we also provide normative scores for its interpretation. The CECOP shows excellent psychometric properties and can be considered the first questionnaire in Spanish that assesses coparenting in any family structure, which also includes the triadic conceptualization of coparenting, providing valuable information on the relational environment in which children and adolescence live.

Exploring Chinese and Iranian EAP students’ oral communication apprehension in English: A cross-cultural mixed-methods study

The role of students' emotions in their academic performance has been widely endorsed in the literature after the rise of positive psychology. However, the scholarly context of English for academic purposes (EAP) has limitedly inspected the status of students' emotions while learning English. One such emotion is oral communication apprehension (OCA), which is a widespread pitfall among EAP students. However, the causing factors and coping strategies of OCA across cultural contexts have been overlooked, to date. To fill this gap, this mixed-methods study scrutinized the level of OCA, leading factors, and coping strategies among 1618 Chinese and Iranian EAP students via questionnaires and semi-structured interviews. The results of the measurement invariance test and independent samples t-test revealed a significant difference between Chinese and Iranian EAP students’ OCA with Chinese participants having a higher OCA. Furthermore, the results of descriptive statistics and thematic analysis demonstrated that Chinese and Iranian EAP students had analogous perceptions regarding the causes and solutions of OCA. They enumerated several instructional and psychological factors that generated OCA and proposed similar coping strategies to curb it. The study provides some practical implications for EAP teachers, students, and teacher trainers, who can realize the criticality of emotions in EAP.

Aggression of electric bike riders in China: comparisons of the Cycling Anger Expression Inventory toward drivers, pedestrians, and other riders

ABSTRACT Electric bikes (e-bikes) account for an unexpected proportion of traffic crash injuries and deaths in China. There is an urgent need to study the factors influencing the aggressive behaviours of e-bike riders and reduce their potential involvement in crashes. In addition, aggression varies when directed at different types of road users, particularly when expressed by vulnerable groups. This study aimed to validate the Cycling Anger Expression Inventory (CAX) for e-bikers and explore whether the expression of aggression in e-bikers differs depending on the recipients, such as drivers, pedestrians, or other riders. The analysis examined the aggression specificity of e-bikers by employing tests of measurement invariance (MI). These findings indicate that adaptive/constructive expression has emerged as a mainstream strategy for managing e-biker anger. E-bikers exhibited the highest levels of aggression toward drivers. These results provide a strong basis for the prevention and intervention of aggression and accidents among Chinese e-bikers.

Testing for Measurement Invariance (MI): Do the Structures of Microaggression, Discrimination, and Resilience Among Black Women Living with HIV Remain the Same Across Time?

Assessing measurement invariance and the interplay of discrimination, microaggressions, and resilience among Black women living with HIV (BWLWH) across time utilizing latent class and repeated measure analysis may provide novel insights. A total of 151 BWLWH in a southeastern U.S. city completed surveys focused on multiple forms of microaggressions and discrimination (race, gender, sexual orientation, or HIV-related) and resilience factors (social support, self-efficacy, post-traumatic growth) at baseline, 3months, and 6months. To capture the psychosocial domains of discrimination, microaggressions, and resilience, three latent factors were developed and measured across three time points. Latent class analysis was also conducted to identify and compare meaningful subgroups based on varying levels of discrimination, microaggressions, and resilience reported. Three latent classes were created. MI testing suggested that measurement invariance was partially met (established metric invariance and scalar invariance), and it is possible to compare factor means of discrimination, microaggressions, and resilience across time. Latent factor mean scores of microaggressions and discrimination decreased after 3 and 6months and increased for resilience after 6months and varied over time across the three latent classes identified. The subgroup with the lowest level of discrimination and microaggressions and the highest level of resilience reported at baseline, experienced increases in resilience after months 3 and 6. Clinical interventions, research, and policies aimed at promoting resilience and reducing structural and social barriers linked to racism, sexism, HIV stigma, and classism are needed to improve the health and well-being of BWLWH.

Mindful Mating: Testing Measurement Invariance and Associations Between Relationship Mindfulness and Relationship Quality Among White and Black Women

Mindful Mating: Testing Measurement Invariance and Associations Between Relationship Mindfulness and Relationship Quality Among White and Black Women

Measurement invariance of the Intuitive Eating Scale–2 across country, ethnicity, sex, and sexual orientation: A cross-cultural study between Brazil and the U.S.

Intuitive eating is defined as being connected to internal hunger, satiety, and appetitive cues and flexibly using these cues to determine when, what, and how much to eat. The Intuitive Eating Scale-2 (IES-2) is a widely used measure of facets of intuitive eating. However, the scale has shown unstable factor structure in several validation studies and there is a lack of studies investigating the measurement invariance of the IES-2 beyond sex. We aimed to evaluate the psychometric properties of the IES-2, testing several factor structures among Brazilian and U.S. samples of men and women; to test measurement invariance across country of origin, ethnicity, sex, and sexual orientation; and to evaluate its internal consistency. Three models of the latent structure of the IES-2 were tested using confirmatory factor analyses (CFA) in a total of 1072 young adults (452 Brazilians and 620 Americans), aged 18–35 years. Results demonstrated that only a 3-factor solution with 11 items of the IES-2 showed adequate fit to the data for both countries. This model demonstrated scalar invariance across sex and sexual orientation, but only configural invariance was found across country of origin and ethnicity. Good internal consistencies were found for both the Brazilian and American samples. The present study provides support for a 3-factor solution with 11 items of the IES-2, to Brazilian and American samples. The study also offers evidence of internal consistency, and invariance between sex (i.e., male and female) and sexual orientation (i.e., heterosexual participants and sexual minority participants).

Проверка измерительной инвариантности для тестов когнитивных и языковых способностей

<p style="text-align: justify;">This paper discusses the measurement invariance of assessment instruments. The purpose of measurement invariance testing is to assess the extent to which a measured construct has comparable meaning across different groups or measurement points, to ensure that comparisons of these groups or measures to each other are appropriate. The paper provides an overview of recent and classic papers discussing conceptual and methodological aspects of invariance testing. Specific focus is placed on the available data on invariance testing for the assessments of cognitive and language abilities, and on the significance of invariance for the accurate assessment of individual and between-group differences. Finally, current approaches to invariance testing within structural equation modelling and item response theory are discussed. This paper may serve as an introduction to the concept of measurement invariance. It will be useful to readers interested in improving the quality of measurement instruments and making more reliable inferences about psychological phenomena.</p>

Multifactorial Memory Questionnaire: a comparison of young and older adults

ABSTRACT The Multifactorial Memory Questionnaire (MMQ; Troyer & Rich, [2002]. Psychometric properties of a new metamemory questionnaire for older adults. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 57(1), P19–P27) is a widely used measure of subjective memory consisting of three scales: Satisfaction, Ability, and Strategies. Although subjective memory complaints are prevalent across different age groups, the factor structure and psychometric properties of the MMQ have yet to be examined in young adults. Here, we independently replicated the original MMQ factor structure in N = 408 young adults (YA) recruited from undergraduate courses and N = 327 older adults (OA) and, for the first time, assessed the age-invariance of the scale using measurement invariance testing. YAs made significantly higher ratings than OAs on MMQ-Satisfaction and MMQ-Strategies, indicating greater satisfaction with their memory and greater use of strategies, but the groups were similar on MMQ-Ability. The original MMQ factor structure was replicated in OAs but not in YAs, and age invariance was not supported. Future studies seeking to compare young and older adults could therefore consider either requesting modification of the MMQ for use with young adults or using a different scale.

Psychometric analysis of the kansas city cardiomiopathy questionnaire-23 in a european population

Abstract Background People affected by heart failure (HF) often exhibit poor quality of life, which places a great deal of burden on the healthcare systems. The Kansas City Cardiomyopathy Questionnaire (KCCQ)-23 is one of the most widespread instruments to measure quality of life in this population. So far, its psychometric properties have been investigated by a broad array of research, but the overall findings reveal inconsistency of the factorial structure and lack of rigorous psychometric testing. Objective The aim of this study was to evaluate the psychometric properties of the KCCQ-23 in a European cohort of HF patients. Methods The data used for this study were collected for the MOTIVATE-HF study, which was a three-arm, multicenter, randomized controlled trial to evaluate the effect of motivational interviewing for improving self-care in HF. A group of 510 patients (median age 74 years, IQR=18, 58% males) completed the KCCQ-23 along with clinical and psychosocial measures. Factorial validity was established with confirmatory factor analysis (CFA); omega and model-based internal consistency indexes were computed to examine the internal consistency of the scale. Convergent validity was established by correlating the KCCQ-23 scores with several clinical and psychosocial measures. Measurement invariance testing was conducted within a multigroup framework across patients with preserved vs those with reduced ejection fraction. Results Two CFA solutions were tested, which confirmed the theoretical and empirical models postulated by the original author. The internal consistency coefficients for the latent dimensions were adequate (Omega range =0.77-0.93; internal consistency coefficient =0.89-96)- KCCQ-23 scores were found to be correlated with ejection fraction, NYHA levels, quality of life, self-care confidence, anxiety and depression, and symptom burden, supporting its convergent validity. Finally, the KCCQ-23 was invariant across ejection fraction levels, both in the theoretical and empirical factor solution. Conclusion Overall, this study provides for the first time evidence that the KCCQ-23 has satisfactory psychometric properties, promoting its use in clinical settings and research to investigate the quality of life in patients with HF.

Psychometric properties of the KCCQ-12 in an european cohort of patients with heart failure

Abstract Background Despite medical advances, patients with heart failure continue to suffer from poor quality of life due to worsening symptoms and functional limitations. Therefore, it is important to understand the multidimensional facets of quality of life in these patients. The Kansas City Cardiomyopathy Questionnaire is a commonly used quality of life assessment tool worldwide. However, However, there is still a lack of knowledge about its psychometric properties. Purpose The aim of this study was to investigate the psychometric properties of the KCCQ-12 and its measurement invariance in a cohort of European patients with heart failure. Methods Participants (n=510, median age=72, IQR=18, 58% males) completed the KCCQ-12 alongside measures of clinical psychosocial severity. A confirmatory factor analysis was used to establish factorial validity; internal consistency was determined using the Omega coefficient and the model-based internal consistency coefficient. Zero-order correlations between the KCCQ-12 scores and clinical and psychosocial measures were performed to test convergent validity. Multigroup confirmatory factor analysis was conducted to test measurement invariance across patients with preserved vs reduced ejection fraction. Results Confirmatory factor analysis confirmed a four-factor solution, with the domains of physical limitations, symptom frequency, quality of life, and social interference. Internal consistency was excellent (Omega coefficients ranging from 0.83 and 0.90, and internal consistency index of 0.94). The KCCQ-12 scores significantly correlated with ejection fraction, New York Heart Association class, quality of life, anxiety, depression, symptom burden, and the KCCQ-23 Overall Summary score, which adequately supported the convergent validity of the KCCQ-12. Measurement invariance was confirmed at the partial scalar and strict level. Conclusions These findings support the validity and reliability of the KCCQ-12, both in patients with reduced and preserved ejection fraction. Hence, this version can be confidently used both in research and clinical practice to measure quality of life of heart failure patients.

Chinese version of the Tendency to Avoid Physical Activity and Sport (TAPAS) scale: testing unidimensionality, measurement invariance, concurrent validity, and known-group validity among Taiwanese youths

Background and objectivesPsychosocial factors affect individuals’ desire for physical activity. A newly developed instrument (Tendency to Avoid Physical Activity and Sport; TAPAS) has been designed to assess the avoidance of physical activity. Considering cultural differences could be decisive factors, the present study aimed to translate and validate the TAPAS into Chinese (Mandarin) for Taiwanese youths, and further cultural comparisons are expected.MethodsStandard translation procedure (i.e., forward translation, back translation, and reconciliation) was used to translate the English TAPAS into the Chinese TAPAS. Following translation, 608 youths (mean [SD] age 29.10 [6.36] years; 333 [54.8%] women) participated in the study via a snowballing sampling method with an online survey. All participants completed the Chinese TAPAS and additional instruments assessing weight stigma and psychological distress. Confirmatory factor analysis (CFA) was used to examine the factor structure of the Chinese TAPAS and multigroup CFA to examine measurement invariance across gender (men vs. women) and weight status (overweight vs. non-overweight). Pearson correlations were used to examine the concurrent validity; independent t-tests between gender groups and weight status groups were used to examine the known-group validity.ResultsConsistent with the English version, the Chinese TAPAS was found to have a one-factor structure evidenced by CFA results. The structure was invariant across gender and weight status groups evidenced by multigroup CFA results. Concurrent validity was supported by significant associations with the related constructs assessed (r = 0.326 to 0.676; p < 0.001). Known-group validity was supported by the significant differences in TAPAS total scores between gender and weight status groups (p = 0.004 and < 0.001; Cohen’s d = 0.24 and 0.48).ConclusionThe Chinese version of the TAPAS is a valid and reliable instrument assessing individuals’ avoidance of physical activity and sports due to underlying psychosocial issues among Taiwanese youths. It is anticipated to be applied within a large Asian population, as well as cross-cultural comparisons, for further explorations in health, behavioral and epidemiological research and practice.

The PCMT model of organizational support: Scale development and theoretical application.

The PCMT model of organizational support conceptualizes organizational support as consisting of four forms that differ in terms of their perceived target and ascribed motive. Across six studies (n = 1,853), we create and validate a psychometrically reliable scale that captures these four forms of organizational support, as well as offer a theoretical advancement to the organizational support literature. In particular, the first five studies involve content validation; assessment of factor analytic structure; tests of test-retest reliability and measurement invariance; and establishment of discriminant, convergent, and predictive validity. The final study involves deployment of the validated, 24-item scale in the field and illustrates that the four different forms of organizational support differentially predict the discrete dimensions of job burnout, the effects of which spillover and crossover into the home domain. This investigation thus offers both empirical and theoretical contributions. Empirically, we provide applied psychologists with an instrument for measuring the four forms of organizational support, enabling the emergence of new lines of research. Theoretically, we illustrate that the content and characteristics associated with the different forms of organizational support are important considerations as conceptual alignment between the type of organizational support perceived and the well-being outcome under study enhances the support's predictive validity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Measuring Aspects of Multisexuality: Initial Development of the Multisexual Identity Scale

This article outlines the development of a novel scale for assessing identity aspects of multisexual individuals. To establish the factor structure and assess the reliability and validity of the Multisexual Identity Scale (MIS), three studies in Greece were conducted. The first Study (N = 109) provided data for exploratory factor analysis. The proposed factor structure underwent confirmatory factor analysis in the second Study (N = 107), yielding a 6-factor solution with 22 items. These six subscales addressed Identity Intersection/Holistic Growth, Label Rejection, LGBTQIA2+ Community Involvement, Heterosexual Community Involvement, Rejection of Monosexual Identity, and Understanding Multisexual Identity. The third Study (N = 109) further assessed reliability and validity, including a measurement invariance test based on sex assigned at birth. Overall, the results support the adoption of this newly developed scale, offering valuable insights into multisexual identity with satisfactory psychometric outcomes. Limitations are also discussed.

In Support of Multidimensional Frailty: A Structural Equation Model from the Canadian Positive Brain Health Now Cohort.

The objective of this study was to estimate the structure and relationships between four h ypothesized frailty dimensions (physical, emotional, cognitive, and social) and the extent to which personal and HIV-related factors and comorbidity associate with these frailty dimensions. This is a secondary analysis of an existing dataset arising from Positive Brain Health Now study (n = 856) in people aging with HIV (mean age: 52.3 ± 8.1 years). Structural equation modeling (SEM) models were applied to two cross-sections of the data: one at study entry and one at second visit, 9-month apart. Multidimensional frailty was modeled based on the combined Wilson-Cleary and International Classification of Functioning, Disability and Health framework. Four dimensions were operationalized with patient-reported and self-report measures from standardized questionnaires. The SEM model from the first visit was replicated using data from the second visit, testing measurement invariance. The proposed model showed acceptable fit at both visits (including no violation of measurement invariance). The final model for the first visit showed that sex, body mass index, HIV diagnosis pre-1997, current or nadir CD4 counts, and comorbidity did not associate with any frailty dimension; however, age (β range: 0.12-0.25), symptoms (β range: -0.35 to -0.58), and measured cognition (β range: 0.10-0.24) directly associated with all frailty dimensions. The model remained stable across the two visits. This study contributes evidence for operationalizing multidimensional frailty. Evidence-based interventions are available for many of the measures considered here, offering opportunities to improve the lives of people with frailty in the context of HIV.

Why Do People Watch Pornography? Cross-Cultural Validation of the Pornography Use Motivations Scale (PUMS) and Its Short Form (PUMS-8)

ABSTRACT Motivations for pornography use may vary across gender identities, sexual orientations, and geographical regions, warranting examination to promote individual and public health. The aims of this study were to validate the Pornography Use Motivations Scale (PUMS) in a diverse, multicultural sample, and develop a short form (PUMS-8) that can assess a wide range of pornography use motivations. Using data from 42 countries (N = 75,117; Mage = 32.07; SDage = 12.37), enabled us to thoroughly evaluate the dimensionality, validity, and reliability of the Pornography Use Motivations Scale (PUMS), leading to the development of the more concise PUMS-8 short scale. Additionally, language-, nationality-, gender-, and sexual-orientation-based measurement invariance tests were conducted to test the comparability across groups. Both the PUMS and the PUMS-8 assess eight pornography use motivations, and both demonstrated excellent psychometric properties. Sexual Pleasure emerged as the most frequent motivation for pornography use across countries, genders, and sexual orientations, while differences were observed concerning other motivations (e.g. self-exploration was more prevalent among gender-diverse individuals than men or women). The motivational background of pornography use showed high similarity in the examined countries. Both the PUMS and the PUMS-8 are reliable and valid measurement tools to assess different types of motivations for pornography use across countries, genders, and sexual orientations. Both scales are recommended for use in research and clinical settings.

Factor structure and measurement invariance of the Depression anxiety stress scale (DASS-21) in Chinese left-behind and non-left-behind children: an exploratory structural equation modeling approach

BackgroundComprehensive data has shown that adolescents often suffer from depression, anxiety, and low self-esteem, and are in a particularly fragile stage of psychological, physiological, and social development. Left-behind children in particular tend to have significantly higher, state anxiety and depression compared to non-left-behind children. The Depression, Anxiety, and Stress Scale (DASS-21) is an effective tool for evaluating depression, anxiety, and stress, and is used to measure levels of depression, anxiety, and stress in groups from a variety of backgrounds. The purpose of this study was to determine the effectiveness, reliability, and measurement invariance of the DASS-21 in Chinese left-behind children.MethodThe test and re-test method was used (N = 676), and the exploratory structural equation model (Mplus v.8.3) used to verify basic measurement models. For measurement invariance, the configural, weak, strong, and strict models were tested. The reliability of the DASS-21 was also tested using the collected data.ResultsAnalysis results showed that the DASS-21 had a stable three-factor structure in the sample of left-behind children in China. The measurement invariance test showed that gender and time not only had strong invariance, but also strict invariance. The results of cross left and non-left invariance indicated a lack of strict invariance. Finally, the McDonald’s omega coefficient of the DASS-21 total scale was 0.864, and the internal consistency of each subscale was also good.ConclusionsThe DASS-21 is shown to be an effective and reliable tool for measuring depression, anxiety and stress in Chinese left-behind children.

A cross-cultural investigation of active transportation and community participation: Results from the WHO survey of Global Ageing and Adult Health

Little is known about how the associations between active transportation and community participation may vary across national contexts. Using representative datasets from China, Ghana, India, Mexico, Russia, and South Africa collected in the Study on Global Ageing and Adult Health (N = 33,535), we estimated multi-group confirmatory factor analyses, tests of measurement invariance, and predictive models. Standardized coefficients were equivalent across countries and showed a modest positive association between active transportation and community participation (the variance explained by active transportation ranged from 1.3% to 7.5% across countries). These results suggest that supporting active transportation can help mitigate negative environmental and health changes associated with increased vehicular travel and support social capital via community participation.

Teachers’ intervention strategies for handling hate-speech incidents in schools

Despite ongoing global efforts to combat discrimination, hate speech is a growing problem in many countries. Hate speech is also widespread among young people and thus also affects schools. Because of the negative consequences of hate speech for the targeted individuals and for society in general, schools and teachers are generally encouraged to moderate hate speech. This binational study examines intervention strategies for hate speech in schools using the newly developed Hate-Speech Interventions Scale for Teachers. Data from German and Swiss teachers (N = 486) were analyzed. Self-reported strategies were best described using a three-factor structure. Teachers primarily direct their interventions at those directly involved in hate speech and frequently employ teaching-oriented strategies. In comparison, external partners and colleagues are relatively rarely involved. Measurement invariance testing supported the scales’ construct validity. A link was found between the use of these strategies, teachers’ task-specific self-efficacy, gender, and professional experience. These results indicate that schools should play an important role in moderating hate speech and that increasing teachers’ confidence in their own ability to address this phenomenon could be an important element of teacher training.

Measurement invariance of two measures of positive body image among Hispanic/Latina undergraduate women

Although positive body image is associated with mental and physical health benefits, there is a relative dearth of research investigating the psychometric properties of commonly used measures of positive body image among Hispanic/Latina women in the United States. The current study explored the psychometric properties of the Body Appreciation Scale-2 (BAS-2; Tylka & Wood-Barcalow, 2015a) and the Functionality Appreciation Scale (FAS; Alleva et al., 2017) in undergraduate women. Altogether 565 undergraduates (n = 386 Hispanic/Latina; n = 179 non-Hispanic White [NHW]) completed the BAS-2, FAS, and demographic questionnaires. Confirmatory factor analysis (CFA) and measurement invariance testing across ethnicity was conducted on each measure. The CFA confirmed the 1-factor, 10-item model of the BAS-2 among Hispanic/Latina women but indicated a less than adequate model fit for the FAS which improved after correlating the residuals of items 6 and 7. Measurement invariance testing revealed evidence of partial scalar invariance of the BAS-2 and full invariance of the FAS across ethnicity. There were no significant mean differences between groups on the measures. These analyses indicate acceptable psychometric properties of the BAS-2 and FAS among Hispanic/Latina women. Nonetheless, they did suggest potentially meaningful group differences in how these items behaved, which warrant further exploration.

Examining the Psychometric Properties of the Student Behavior Checklist-Brief’s Subject Scores: Tests of Measurement Invariance

Abstract Authors evaluated the Student Behavior Checklist-Brief (SBC-B) to test whether teacher-reports of student learning approach (i.e., learned helplessness [LH] and mastery orientation [MO]) were invariant across academic subjects. The current sample includes ethnically diverse seventh and eighth grade students (N = 145; 53 percent male) and six teams of five teachers for the core academic subjects. Authors conducted confirmatory factor analyses and measurement invariance tests on ratings for each of the subject-specific SBC-B measures and total SBC-B ratings that were not subject-specific. Results supported full measurement invariance across academic subjects. This evidence supporting the SBC-B’s psychometric properties across subjects increases confidence in using the measure in research and clinical settings to identify youth with tendencies toward LH or MO and explore how LH/MO relate to academic functioning and experiences of internalizing symptoms.