Cross-cultural Measurement Invariance Research Articles

Assessing the measurement invariance of Free Will and Determinism Plus scale across four languages: a registered report.

Free will is assumed to be the core of an individual's self-concept. Belief in free will has been studied extensively and was found to be correlated with many behavioural and psychological outcomes. Although developed and validated in the West, the Free will and Determinism Plus (FAD-Plus) scale has been translated, used, and interpreted as a measurement of free will beliefs in multiple cultures. However, the cross-cultural measurement invariance of FAD-Plus has not been examined. Given the cultural differences in understanding the concept of 'free will', items of FAD-Plus may have different interpretations in different cultures, which may compromise its cross-cultural measurement invariance. To provide empirical evidence for the lack of cross-cultural measurement invariance, we collected data in China and analyzed these data together with open datasets of FAD-Plus in three other languages: Japanese, French and English. We only found partial measurement invariance between the Chinese and English datasets, as well as the Japanese and English datasets. These results provided the first assessment of cross-cultural measure invariance of FAD-Plus. We discussed the potential implications of the current study for future studies in the field.

Measuring Risk Tolerance Among Japanese Adults and Cross-National Comparison of Its Role in COVID-19 Attitudes

Abstract: Risk propensity and attitudes influence how one responds and behaves in situations with different levels of risk. To date, limited studies have investigated domain-specific risk attitudes and their measurement in Japanese contexts or had direct comparisons between Japanese and other cultural contexts. In Study 1 ( N = 567), we developed a Japanese version of the multi-domain risk tolerance (MDRT) scale applicable to Japanese populations. The scale was further examined in Study 2 ( N = 509). We also tested cross-cultural measurement invariance between the Japanese and a US sample ( N = 495). In addition, we explored cultural differences in the predictive validity of MDRT on the concerns and attitudes relating to the COVID-19 pandemic. Our results demonstrated that MDRT has promising structure validity, reliability, convergent validity, and measurement invariance in the Japanese population. Results also showed that domain-specific risk attitudes as measured by MDRT have similarly important relationships with individuals’ concerns about COVID-19 in many life aspects, and their support for COVID-19 restrictions in both Japanese and US samples.

A Persian Validation of the Occupational Depression Inventory

Abstract: The present study examined the psychometric and structural properties of the Persian version of the Occupational Depression Inventory (ODI). The ODI focuses on depressive symptoms that employed individuals specifically ascribe to their work. A sample of 355 Iranian schoolteachers was surveyed. Exploratory structural equation modeling (ESEM) bifactor analysis indicated that the ODI meets the requirements for essential unidimensionality. ESEM bifactor analysis and scalability analysis supported the use of the ODI’s total score. The instrument exhibited high reliability. Cross-cultural measurement invariance was supported. As for the concurrent validity of the ODI, occupational depression correlated, in the expected direction, with job satisfaction, life satisfaction, well-being, work engagement, sick leave, and antidepressant intake. No association was observed with sex, age, length of employment, and a history of depressive disorders over the past year. The ODI displayed a balance of convergent and discriminant validity vis-a-vis an attribution-free measure of depressive symptoms. The prevalence of occupational depression was estimated at 2.8% in our sample. Our findings endorse the Persian version of the ODI and confirm the instrument’s overall robustness.

Emotional responses to climate change in Norway and Ireland: a validation of the Inventory of Climate Emotions (ICE) in two European countries and an inspection of its nomological span.

There is an increasing research interest in emotional responses to climate change and their role in climate action and psycho-social impacts of climate change. At the same time, emotional experience of climate change is multidimensional and influenced by a variety of factors, including the local cultural context. Here, we contribute to the scientific debate about this topic with original quality-controlled data from the general populations in Norway (N = 491) and Ireland (N = 485). We investigate the cross-cultural validity and the nomological span of eight distinct emotional responses to climate change - climate anger, climate contempt, climate enthusiasm, climate powerlessness, climate guilt, climate isolation, climate anxiety, and climate sorrow - measured using the recently introduced Inventory of Climate Emotions. We first validate the 8-factor structure of the Norwegian and English language versions of the ICE. Subsequently, we demonstrate a high degree of cross-cultural measurement invariance for these eight climate emotions. Finally, we explore the relationships between these emotional responses and a range of theoretically relevant variables. In this final step, we show that climate emotions are differentially linked to climate change perceptions, support for mitigation policies, socio-demographic factors, feelings of loneliness and alienation, environmental activism, and the willingness to prioritize the natural environment over one's immediate self-interests. Some of these links are also differentiated by the cultural context. This research presents further evidence for the structural, cross-cultural, and concurrent validity of climate emotions as postulated in the ICE framework. Moreover, it provides tools in the form of validated Norwegian and English language versions of the ICE, the complete R code for the validation analysis, as well as an informed basis for cross-cultural research on emotional responses to climate change.

TEST OF INVARIANCE OF THE ANOMIE BRIEF SCALE WITH THE ALIGNMENT METHOD IN 12 LATIN AMERICAN COUNTRIES

The Social Anomie Brief Scale (SAS10) is a self-report measure of social anomie against new social standards implemented during the current COVID-19 pandemic. The main objective of this study was to evaluate the invariance of the cross-cultural measurement of the SAS10 in a sample of 12 Latin American countries. Additionally, the difficulty and discrimination characteristics of the items were evaluated using the IRT and social anomie was compared between the participating countries. A total of 4,911 people from 12 Latin American countries (Argentina, Bolivia, Chile, Colombia, Cuba, Ecuador, Guatemala, Mexico, Paraguay, Peru, Uruguay, and Venezuela) selected by non-probabilistic snowball sampling participated. The results indicated that the original two-factor model of the SAS10 shows estimation problems and low fit indices in several countries. However, a model of two related dimensions (behavioral and affective) of nine items (SAS-9) presented adequate fit indices in all countries. This model presents adequate estimation of reliability and approximate cross-cultural measurement invariance. Peru was the country with the highest score in the behavioral dimension of social anomie; while Venezuela and Bolivia presented the highest scores in the affective dimension. Mexico was one of the countries with the lowest anomie scores. The results of the IRT would indicate that the characteristics of the SAS-9 items were appropriate. It is concluded that the SAS-9 has shown good psychometric properties when evaluated in 12 Latin American countries and can be used in future studies that compare social anomie cross-culturally.

Cross-cultural measurement invariance of a developmental assessment tool in a small-scale intervention study

Development tests are widely used in the scope of cross-cultural and comparative research to support intervention studies and health care projects concerning early childhood development. Therefore, it is crucial to use culturally sensitive assessment tools. A culturally adapted version of the German development test FREDI 0–3 (Maehler, Cartschau, & Rohleder, 2016) was used to assess a German (n = 405) and an Indian (n = 2075) sample of children between ten and thirty-two months. Measurement invariance indicates psychometric equivalence of a construct across groups and is a prerequisite for test applications in a cross-cultural setting. Confirmatory factor analyses for single cohorts per age group and multi-group measurement invariance analyses were used to examine the data equivalence of the test across groups. Weak measurement invariance could be established across both groups in all four age groups (10–14; 15–21; 22–26; 27–32 months) suggesting that the development factor was measured in the same way in both groups and accounted similarly for performance differences in the developmental subdomains for the German and the Indian sample. However, scalar and strict measurement invariance were violated in almost all group comparisons suggesting differences in scale difficulty and reliability across the German and the Indian sample. This suggests that a culture-sensitive adaptation process like it was carried out within this project is necessary but not sufficient in order to create a culturally comparable development test. It is essential to always carry out measurement invariance testing to determine the psychometric equivalence of the test and additionally reduce linguistic and cultural bias through an adaption process based on empirical proven methodological principles.

Cross-cultural measurement invariance evidence of individualism and collectivism: from the idiosyncratic to universal.

Culture plays a fundamental role in shaping human behavior, with individualism and collectivism being key cultural dimensions. However, existing scales for measuring these constructs, such as the INDCOL scale, have demonstrated issues when applied in diverse cultural contexts. To address this, we present the translation and adaptation of the Mexican Vertical and Horizontal Individualism and Collectivism Scale (MXINDCOL) into English, aiming to identify both universal and culture-specific elements. Data were collected from 1124 participants (371 from the United States, 753 from Mexico) using the MXINDCOL and INDCOL scales. Propensity score matching was applied to balance demographic differences between the samples. Confirmatory Factor Analysis (CFA) assessed model fit, and cross-cultural measurement invariance was examined. Reliability, convergent and discriminant validity were also assessed. The English-translated MXINDCOL scale demonstrated good model fit in both US and Mexican samples, outperforming the INDCOL scale. Reliability values were higher for the MXINDCOL scale compared to INDCOL. Cross-cultural measurement invariance was established, allowing for meaningful comparisons between the two cultures. US participants scored higher on vertical collectivism, while Mexican participants scored higher on horizontal collectivism and horizontal individualism. The MXINDCOL scale offers a culturally sensitive measurement of individualism and collectivism, addressing issues found in existing scales. It provides a more accurate assessment of cultural orientations and enriches the understanding of cultural dimensions by incorporating idiosyncratic elements. Further research in diverse cultural contexts is recommended to validate and refine the scale, contributing to a more nuanced understanding of cultural variations in individualism and collectivism.

Evidence for environment hypothesis: Cross-cultural measurement invariance of the composite scale of morningness across Bangladesh and Spain

ABSTRACT Morningness-eveningness reflects individual differences in circadian functioning and is related to health and well-being. Cross-cultural comparison could facilitate understanding of the environmental factors affecting morningness-eveningness, which requires establishing cross-cultural validity of the relevant assessment tools. In this study, we applied the Composite Scale of Morningness (CSM) to Bangladeshi (n = 1015; 37.9% women) and Spanish (n = 1054; 73.2% women) university students (aged 18–27 years) to evaluate alternative factorial models of the CSM and to test its measurement invariance across cultures. Moreover, this study tested environment hypothesis, suggesting that higher average temperatures and lower latitudes would be related to greater morningness. From nine competing factorial models, a bifactor model with two specific factors (morning preference and morning affect) showed the best fit for both cultures. The two-factor bifactor model had full metric invariance with partial scalar and strict invariance across cultures. The Bangladesh–Spain comparison of the CSM scores revealed higher morningness in Bangladeshi students which supports the environment hypothesis. Overall, this research confirms that morningness-eveningness construct is perceived and interpreted similarly by the Bangladeshi and Spanish students. Importantly, this study highlights the effects of environmental factors including latitude and temperature on morningness-eveningness, and thus facilitates further cross-cultural morningness-eveningness research.

Cross-cultural measurement invariance of the pandemic fatigue scale (PFS) in five South American countries

Cross-cultural measurement invariance of the pandemic fatigue scale (PFS) in five South American countries

Assessing measurement invariance of the SEGUE framework among Chinese and Ghanaian patients: A cross-sectional study

ObjectiveMeasurement invariance assesses the psychometric equivalence of a construct across groups or across time. This study aimed to find out whether the newly modified 5-point Likert scale SEGUE Framework for evaluating doctor's communication skills demonstrates measurement invariance among Chinese and Ghanaian patients. MethodsMeasurement invariance tests were conducted using two samples collected from the two cultures respectively (China: N = 598 and Ghana: N = 591). Confirmatory Factor Analysis (CFA) was used to test for the factor structure. Multiple-group CFA was used to test the measurement invariance of the SEGUE between the two samples. ResultsThe same five-factor model showed acceptable model fit in both Chinese and Ghanaian samples. Cross-cultural measurement invariance tests revealed that scalar invariance was observed across the two samples. ConclusionCross-cultural adaptations of instruments should exhibit measurement invariance to ensure that measures are interpreted and used consistently. Findings of our study suggest that the SEGUE Framework is invariant across the two cultures, which increases confidence in data collection and comparison. InnovationThis is the first study to establish measurement invariance among Chinese and Ghanaians using the SEGUE Framework which assesses doctors' communication from patients' perspectives.

Psychometric properties of the Burnout Assessment Tool across four countries

BackgroundThe Burnout Assessment Tool (BAT) is a new burnout measure developed to replace the Maslach Burnout Inventory (MBI). Studies have supported the psychometric properties and cross-cultural measurement invariance of the BAT. However, some unresolved questions remain. These questions are the appropriate level of score interpretation, convergent validity with the MBI, and measurement invariance using sample groups from countries outside of Europe.MethodsWe used a cross-sectional survey approach to obtain 794 participants from Australia (n = 200), the Netherlands (n = 199), South Africa (n = 197), and the United States (n = 198). In brief, we used bifactor modelling to investigate the appropriate score interpretation and convergent validity with the MBI. Hereafter, we used the Rasch model and ordinal logistic regression to investigate differential item functioning.ResultsThe bifactor model showed a large general factor and four small group factors, which suggests calculating and interpreting a general burnout score. This model further shows that the BAT and MBI measure the same burnout construct but that the BAT is a more comprehensive burnout measure. Most items fit the Rasch model, and few showed non-negligible differential item functioning.ConclusionsOur results support the psychometric properties and cross-cultural measurement invariance of the BAT in Australia, the Netherlands, South Africa, and the United States. Furthermore, we provide some clarity on the three previously mentioned unresolved questions.

Is the meaning of subjective well-being similar in Latin American countries? A cross-cultural measurement invariance study of the WHO-5 well-being index during the COVID-19 pandemic

BackgroundThere is an urgent need to assess changes in well-being on a multinational scale during the COVID-19 pandemic, thus culturally valid scales must be available.MethodsWith this in mind, this study examined the invariance of the WHO well-being index (WHO-5) among a sample of 5183 people from 12 Latin Americans countries (Argentina, Bolivia, Chile, Colombia, Cuba, Ecuador, El Salvador, Guatemala, Mexico, Paraguay, Peru, and Uruguay).ResultsThe results of the present study indicate that the WHO-5 is strictly invariant across samples from different Latin American countries. Furthermore, the results of the IRT analysis indicate that all items of the WHO-5 were highly discriminative and that the difficulty required to respond to each of the five items is ascending. Additionally, the results indicated the presence of moderate and small size differences in subjective well-being among most countries.ConclusionThe WHO-5 is useful for assessing subjective well-being in 12 Latin American countries during the COVID-19 pandemic, since the differences between scores can be attributed to differences in well-being and not in other characteristics of the scale.

Assessment of cross-cultural measurement invariance of the NIH toolbox fluid cognition measures between Jamaicans and African-Americans

The NIH Toolbox Cognitive Battery (NIHTB-CB) was developed as a common-metric, computerized cognitive screener for research. Although extensively normed and validated in Americans of different ethnicities, there is little data on how generalizable such results would be when used outside of the United States. The objective of this study was to assess measurement invariance (MI) of the NIHTB-CB across Jamaican and African-American samples and determine appropriateness of comparisons across groups. Multi-group confirmatory factor analyses using a single-factor model were conducted using five tests of fluid cognitive abilities from the NIHTB-CB, which assess working memory, episodic memory, processing speed, and executive function. MI was tested sequentially for configural, metric and scalar invariance. 125 Jamaican and 154 American adults of African descent were included. The Jamaican mean age was 31.6 ± 8.6 years (57% males) compared to 43.5 ± 15.5 years (25% males) for the African-American group. The Jamaicans had on average 11.3 ± 2.7 years of education compared to 13.9 ± 2.6 years for the African-Americans. We found metric and configural invariance across both samples but not scalar invariance. These findings suggest that the single factor emerging from the NIHTB-CB measures the same construct, i.e. fluid cognitive ability, in both groups and hence the battery is appropriate for assessments within cultures. However, lack of scalar invariance indicates that direct cross-cultural comparisons of performance levels should be interpreted with caution, also suggesting that U.S. normative standards are not generalizable to the Jamaican population.

Cross-national measurement invariance of the Purpose in Life Test in seven Latin American countries.

The Purpose in Life Test (PIL) is a measure of purpose in life widely used in many cultures and countries; however, cross-cultural assessments are scarce. The present study aimed to evaluate the cross-cultural measurement invariance of the PIL in the general population of seven Latin American countries (Colombia, Ecuador, El Salvador, Mexico, Paraguay, Argentina, and Uruguay). A total of 4306 people participated, selected by non-probabilistic convenience sampling, where Uruguay has the highest mean age (M = 41.8; SD = 16.6 years); while Ecuador has the lowest mean age (M = 24.6; SD = 7.8 years). Furthermore, in each country, there is a higher proportion of women (>60%) than men (<40%). Using Multi-Group Confirmatory Factor Analysis, the factorial structure does not show evidence of invariance among the included countries. However, based on the Multi-Group Factor Analysis Alignment, there is evidence that a three-dimensional structure of the PIL (Meaning of existence, Freedom to make meaning in daily life and Will to find meaning in the face of future challenges) is the same in the participating countries. Results based on item response theory indicate that most PIL items can significantly differentiate responses according to the level of life purpose. In addition, people with low life purpose will tend to choose the lower response alternatives on the PIL; while people with higher life purpose will choose higher response alternatives. The findings indicate that the PIL has the potential to increase knowledge about how people conceive and experience their purpose in life in different countries.

Cross-cultural equivalence of parental ratings of child difficulties during the pandemic: Findings from a six-site study.

The Strengths and Difficulties Questionnaire (SDQ) has been shown to be invariant across informants, developmental stage and settings, but tests of cross-cultural equivalence are limited to adolescents' self-reports. The COVID-19 pandemic makes this gap particularly pertinent, given the need to understand whether distinct government approaches (e.g., school closures) are uniquely associated with variability in children's psychosocial outcomes and the reliance on parents' ratings for young children. Within a Confirmatory Factor Analysis framework, we tested the cross-cultural measurement invariance of the SDQ across six countries: Australia, China, Italy, Sweden, the United Kingdom and USA, using a sample of 1761 parents of 3- to 8-year-olds (M=5.76, SD=1.09). A five-factors model showed good fit to the data and partial cross-cultural scalar invariance. In this sample, Swedish parents reported the fewest peer problems (Cohen's d=0.950) and the highest prosocial scores (Cohen's d=0.547), whilst British parents reported the greatest child emotional (Cohen's d=0.412) and hyperactivity problems (Cohen's d=0.535). The present results indicate that the parent-version of the SDQ is appropriate for use and comparison across different contexts during the pandemic.

Cross-cultural measurement invariance of the purpose in life test - Short form (PIL-SF) in seven Latin American countries.

The aim was to test the cross-cultural measurement invariance of the PIL-SF in a sample of people from seven Latin American countries. Additionally, the characteristics of the PIL-SF items were evaluated and to assess the relationship between purpose in life, as measured by the PIL-SF, and fear of COVID-19. A total of 4306 people from seven Latin American countries participated in the study. The results indicated that the PIL-SF is invariant in the seven participating countries and, therefore, there is evidence that the items reflect the purpose of life in the same way in all countries. This allows comparisons of purpose in life between countries that are free of bias, reflecting the true differences in how countries respond to items. From IRT, the discrimination parameters are adequate and indicate that the items cover a wide range of the purpose in life construct. The difficulty parameters are adequate and increase monotonically. This indicates that people would need a higher level of purpose in life to respond to the higher response categories. Thus, the PIL-SF items would be useful in determining people with a relatively high degree of purpose in life. Identifying people with different levels of purpose in life would allow them to be part of intervention programs, either to support those with low levels or to maintain and reinforce their purpose in life. The evidence of cross-country measurement invariance of the PIL-SF provides a measure to be used in cross-cultural studies about the meaning of life.

Cross-cultural measurement invariance of the Quality of Life Enjoyment and Satisfaction Questionnaire-Short form across ten countries: the application of Bayesian approximate measurement invariance

BackgroundThe Quality of Life Enjoyment and Satisfaction Questionnaire-Short Form (Q-LES-Q-SF) is the most frequently used generic quality of life (QOL) measure in many countries and cultures worldwide. However, no single study has been carried out to investigate whether this questionnaire performs similarly across diverse cultures/countries. Accordingly, this study aimed to assess the cross-cultural measurement invariance of the Q-LES-Q-SF across ten different countries.MethodsThe Q-LES-Q-SF was administrated to a sample of 2822 university students from ten countries: Bangladesh, Brazil, Croatia, India, Nepal, Poland, Serbia, Turkey, the United Arab Emirates, and Vietnam. The Bayesian approximate measurement invariance approach was used to assess the measurement invariance of the Q-LES-Q-SF.ResultsApproximate measurement invariance did not hold across the countries for the Q-LES-Q-SF, with only two out of 14 items being non-invariant; namely items related to doing household and leisure time activities.ConclusionsOur findings did not support the cross-cultural measurement invariance of the Q-LES-Q-SF; thus, considerable caution is warranted when comparing QOL scores across different countries with this measure. Item rewording and adaptation along with calibrating non-invariant items may narrow these differences and help researchers to create an invariant questionnaire for reliable and valid QOL comparisons across different countries.

Cross-Cultural Measurement Invariance of the Harvard Trauma Questionnaire Across Nine Adolescent Samples.

Trauma researchers often make claims about the severity of posttraumatic stress disorder (PTSD) across populations, and yet cross-cultural measurement invariance (MI) is rarely assessed. Nine youth samples with Harvard Trauma Questionnaire (HTQ) responses were grouped based on sampling strategy used into two sets: representative (Denmark, the Faroe Islands, Iceland, and Lithuania, n = 1,457), and convenience (Greenland, India, Kenya, Malaysia, and Uganda, n = 2,036). Confirmatory factor analysis (CFA) was used to gauge whether configural, metric, scalar, and residual invariance of different models held between national samples within the two sets. Configural invariance held for most PTSD models in convenience samples, not in representative samples. Metric invariance was less common, and scalar and residual in general did not hold. Cultural similarity between samples seemed to be associated with invariance. Findings suggest that although PTSD symptoms may cluster similarly across culturally distal groups, comparisons of the severity of symptoms using the HTQ across adolescent samples are not likely valid.

Cross-Cultural Measurement of Positive and Negative Emotions in Adolescence: Evidence from Three Countries.

Cross-cultural assessment of affective well-being among adolescents has received scarce attention in positive psychological research. The present study investigated cross-cultural measurement invariance of the Scale of Positive and Negative Experience (SPANE) among adolescents from three countries (India, Poland, and Serbia). The sample included a total of 1080 adolescents (53.6% female; Mage = 16.75, range = 15–19 years). Surveys were administered online in each country. Measurement invariance testing provided evidence for partial scalar invariance of the SPANE across cultures, with item “afraid” showing nonivariance across the three countries. Latent factor correlations between positive and negative emotions were stronger in Serbia compared to Poland and India. Positive emotions and life satisfaction had strong positive associations in all three countries (ranging from 0.68 to 0.75). The inverse correlations between negative emotions and life satisfaction were − 0.27, − 0.54, − 0.69 in India, Poland, and Serbia, respectively. Polish adolescents demonstrated the lowest levels of affective well-being, whereas Indian and Serbian adolescents did not differ substantially in levels of positive and negative emotions. The present study demonstrated that the SPANE is a reliable and useful tool for the assessment of positive and negative emotions among adolescents from different cultural settings.Supplementary InformationThe online version contains supplementary material available at 10.1007/s10902-022-00521-6.

Cross-cultural validity of the five items Mindful Attention Awareness Scale (MAAS-5) in Peru and Mexico during the COVID-19 pandemic

The Spanish version of the 5-item Mindful Attention Awareness Scale (MAAS-5) is a brief measure of the general tendency to be attentive and aware of experiences in the present moment during daily life. The MAAS-5 has been used in different countries; however, an assessment of its cross-cultural measurement invariance (MI) has not been conducted. Therefore, the study aimed to evaluate the cross-cultural measurement invariance of the MAAS-5 in university students from two countries: Peru and Mexico. A total of 1144 university students from Peru (N = 822) and Mexico (N = 322) responded online to the Spanish version of the 5-item Mindful Attention Awareness Scale (MAAS-5). A multigroup confirmatory factor analysis was performed. Measurement invariance tests the hypothesis that the model behind a set of scores is comparable between groups. The results showed that the unidimensional structure of the MAAS-5 is the same between Peruvian and Mexican university students. Therefore, it is suggested that university students from both countries conceptualize the mindfulness in a similar way. As a result, the MAAS-5 can be used to compare differences between countries. No significant differences were observed in the MAAS-5 score between Peruvian and Mexican university students. The present study contributes to a better understanding of the psychometric properties of the MAAS-5 by presenting MI results in two Latin American countries. Implications of the findings are discussed, which will facilitate a more solid and reliable use of the MAAS-5 in future cross-cultural studies.