Multiple-group Confirmatory Factor Analysis Research Articles

Measurement invariance testing of the patient health questionnaire-9 (PHQ-9) across people with and without diabetes mellitus from the NHANES, EMHS and UK Biobank datasets

BackgroundThe prevalence of depression is higher among those with diabetes than in the general population. The Patient Health Questionnaire (PHQ-9) is commonly used to assess depression in people with diabetes, but measurement invariance of the PHQ-9 across groups of people with and without diabetes has not yet been investigated. MethodsData from three independent cohorts from the USA (n=1,886 with diabetes, n=4,153 without diabetes), Quebec, Canada (n= 800 with diabetes, n= 2,411 without diabetes), and the UK (n=4,981 with diabetes, n=145,570 without diabetes), were used to examine measurement invariance between adults with and without diabetes. A series of multiple group confirmatory factor analyses were performed, with increasingly stringent model constraints applied to assess configural, equal thresholds, and equal thresholds and loadings invariance, respectively. One-factor and two-factor (somatic and cognitive-affective items) models were examined. ResultsResults demonstrated that the most stringent models, testing equal loadings and thresholds, had satisfactory model fit in the three cohorts for one-factor models (RMSEA = .063 or below and CFI = .978 or above) and two-factor models (RMSEA = .042 or below and CFI = .989 or above). LimitationsData were from Western countries only and we could not distinguish between type of diabetes. ConclusionsResults provide support for measurement invariance between groups of people with and without diabetes, using either a one-factor or a two-factor model. While the two-factor solution has a slightly better fit, the one-factor solution is more parsimonious. Depending on research or clinical needs, both factor structures can be used.

The Religious Perfectionism Scale: A Cross-cultural Psychometric Evaluation Among Christians in the United States

The Religious Perfectionism Scale (RPS) was first developed among Chinese Buddhists, Christians, and Muslims. It consists of the following two subscales: Zealous Religious Dedication and Religious Self-Criticism. In this study, a cross-cultural psychometric evaluation of RPS was performed in a US Christian sample ( N = 233). The confirmatory factor analysis (CFA) results presented a strong data-to-model fit statistics for the two-factor oblique model (CFI = .977, SRMR = .051, RMSEA = .034) in the US sample. The measurement of invariance between US and Chinese samples was examined by multiple-group CFA. The results indicated that the RPS fulfilled invariance for factor loadings and residual variances, but intercepts were partially invariant. The internal consistency reliability coefficients for the two subscales were adequate (above .70). The construct validity test results confirmed our hypotheses that the ZRD was positively correlated with Religious Commitment ( r = .56), and the RSC was positively correlated with Scrupulosity ( r = .58). Overall results suggest that the RPS is a promising measure of religious perfectionism for Christians in the United States. The implications of this were discussed.

The development and initial validation of the Breast Cancer Recurrence instrument (BreastCaRe)—a patient-reported outcome measure for detecting symptoms of recurrence after breast cancer

Patient-reported outomes (PRO) may facilitate prompt treatment. We describe the development and psychometric properties of the first instrument to monitor for symptoms of breast cancer (BC) recurrence. This study is nested in the MyHealth randomized trial of nurse-led follow-up based on electronically-collected PROs. We constructed items assessing symptoms of potential recurrence through expert interviews with six BC specialists in Denmark. Semi-structured cognitive interviews were carried out with a patient panel to assess acceptability and comprehensibility. Items were subsequently tested in a population of 1170 women 1-10years after completing BC treatment. We carried out multiple-groups confirmatory factor analysis (CFA) and Rasch analysis to test dimensionality, local dependence (LD) and differential item functioning (DIF) according to sociodemographic and treatment-related factors. Clinical data was obtained from the Danish Breast Cancer Group registry. Twenty-two items were generated for the Breast Cancer Recurrence instrument (BreastCaRe). Cognitive testing resulted in clearer items. Seven subscales based on general, bone, liver, lung, brain, locoregional and contralateral recurrence symptoms were proposed. Both CFA and Rasch models confirmed the factor structure. No DIF was identified. Five item pairs showed LD but all items were retained to avoid loss of clinical information. Rasch models taking LD into account were used to generate a standardized scoring table for each subscale. The BreastCaRe has good content and structural validity, patient acceptability and measurement invariance. We are preparing to examine the predictive validity of this new instrument.

Studying the context effect of family norms on gender role attitudes: An experimental design

The measurement of gender role attitudes has been found to be problematic in previous studies, especially in comparative perspective. The present study adopts a novel approach and investigates the position of the gender role attitudes scale in the questionnaire as a potential source of bias. In particular, the present study aims at assessing the context effect of the family norms question on the measurement of gender role attitudes by adopting the theoretical perspective of the construal model of attitudes, according to which the adjacent questions constitute the context for interpreting and answering a stimulus. The study employs data from the CROss-National Online Survey panel, which was fielded in 2017 and contained an experiment where the order of the questions under investigation varied. The reliability, validity and invariance of the measurement of gender role attitudes across experimental settings and countries (Estonia, Great Britain and Slovenia) are explored adopting several analytical techniques, such as regression models and multiple-group confirmatory factor analysis. Differences between experimental settings emerged, suggesting that the questionnaire context matters for the validity and stability of the gender role attitudes items; however, the lack of patterns hinders general conclusions on what is the order of questions yielding better measurement of the gender role attitudes scale. Clear differences among the countries indicate that the cultural context may interact with the question context. Finally, we stress that the measurement is overall poor, urging to find a better formulation of the items measuring gender role attitudes.

Psychometric properties of two abbreviated Connor-Davidson Resilience scales in Chinese infertile couples.

This study aimed to evaluate the psychometric properties of the 10-item and 2-item Connor-Davidson Resilience Scale (CD-RISC), the agreement between these two versions, and the measurement invariance of the CD-RISC-10 across genders in Chinese infertile couples. A total of 170 infertile couples were enrolled from an infertility outpatient clinic between September 2019 and January 2020. The CD-RISC scores were tested for floor and ceiling effects. Reliability was evaluated by calculating Cronbach's α. Convergent and divergent validity were assessed by bivariate correlations between resilience and infertility-related stress, depression, anxiety, and two divergent variables. Agreement between the two versions was evaluated using the intraclass correlation coefficient (ICC) and Bland-Altman analysis. A multiple-group confirmatory factor analysis (CFA) was conducted to assess the measurement equivalence of CD-RISC-10 across genders. No floor or ceiling effects were observed. Internal consistencies of CD-RISC-10 and CD-RISC-2 were 0.91 and 0.63, respectively. The CFA analysis indicated an excellent model fit for a one-factor structure of CD-RISC-10 (TLI > 0.950, CFI > 0.950, RMSEA < 0.060). Both scales displayed good convergent and divergent validity, and the agreement between them was significant with an ICC of 0.80 (95% CI ranging from 0.76 to 0.84). Measurement invariance across genders was supported by multigroup CFA, and a higher level of resilience was found in men than in women. Our findings showed significant reliability, validity, and stability of CD-RISC-10 and acceptable internal consistency and validity of CD-RISC-2. CD-RISC-10 is recommended as a resilience measure in clinical evaluations of infertile patients.

Validation of Motivational Regulation Strategies for Korean Elementary, Middle, and High School Students

This study investigates the possibility of utilizing motivational regulation strategies for elementary through high school students using a motivational regulation scale originally developed for US college students by Wolters (The 11th International Conference on Education Research. New Educational paradigm for learning and instruction, Seoul, South Korea, 2010) and Wolters and Benzon (J Exp Edu 8(2):199–221, https://doi.org/10.1080/00220973 , 2013). Of primary concern were questions whether the scale would work in a very different culture and educational system and whether it could be legitimately expanded from original validation efforts for college and high school students to Korean children attending upper primary school levels. Six correlated factors were identified and corroborated across elementary, middle, and high school students using multidimensional multiple group confirmatory factor analysis. With relatively minor exceptions, this validation study indicates that the questions posed about different cultures and age groups could be answered in the affirmative: Wolters’s (The 11th International Conference on Education Research. New Educational paradigm for learning and instruction, Seoul, South Korea, 2010) and Wolters and Benzon (J Exp Edu 8(2):199–221, https://doi.org/10.1080/00220973 , 2013) motivational regulation scale can be used for the three age classifications of Korean students and could be used as a tool interrogating popular motivation regulation strategies across three school levels.

The Italian Validation of OSCI: The Organizational and Safety Climate Inventory

Although safety climate has been the object of multiple studies in the last thirty years, the relationship between safety climate and organizational climate has been scarcely investigated. The Organizational and Safety Climate Inventory (OSCI) was the first and only validated instrument to allow the assessment of organizational and safety climates simultaneously and by using the same theoretical framework. The present work investigated the psychometric properties of OSCI in an Italian sample at the group level; study 1 (N = 745) examined the factor structure of the scale by using confirmatory factor analyses. Study 2 (N = 471) advanced the original Portuguese validation by testing its measurement equivalence across gender and company sector through multiple-group confirmatory factor analyses. Results confirmed one higher-order factor structure with four first-order factors for both Organizational Climate and Safety Climate, with Organizational Climate predicting Safety Climate. Moreover, the scale was found to be invariant between men and women and between different types of company. Reliability, discriminant, and criterion validities of the scale showed very good values. Overall, the findings strengthened the original claim of the OSCI to be a valid and innovative instrument, which allows the identification of specific dimensions of safety climate, starting from a more general model of organizational climate.

Examining the Measurement Invariance of TIMSS 2015 Mathematics Liking Scale through Different Methods

Studies aiming to make cross-cultural comparisons first should establish measurement invariance in the groups to be compared because results obtained from such comparisons may be artificial in the event that measurement invariance cannot be established. The purpose of this study is to investigate the measurement invariance of the data obtained from the "Mathematics Liking Scale" in TIMSS 2015through Multiple Group CFA, Multiple Group LCA and Mixed Rasch Model, which are based on different theoretical foundations and to compare the obtained results. To this end, TIMSS 2015 data for students in the USA and Canada, who speak the same language and data for students in the USA and Turkey, who speak different languages, are used. The study is conducted through a descriptive study approach. The study revealed that all measurement invariance levels were established in Multiple Group CFA for the USA-Canada comparison. In Multiple Group LCA, on the other hand, measurement invariance was established up to partial homogeneity. However, it was not established in the Mixed Rasch Model. As for the USA-Turkey comparison, metric invariance was established in Multiple Group CFA whereas in Multiple Group LCA it stopped at the heterogeneity level. Measurement invariance for data failed to be established for the relevant sample in the Mixed Rasch Model. The foregoing findings suggest that methods with different theoretical foundations yield different measurement invariance results. In this regard, when deciding on the method to be used in measurement invariance studies, it is recommended to examine the necessary assumptions and consider the variable structure.

Confirmatory factor analysis and measurement invariance of the English, Mandarin, and Malay versions of the SF-12v2 within a representative sample of the multi-ethnic Singapore population

BackgroundThe Short Form Health Survey (SF-12v2) is an increasingly popular measure of health-related quality of life (HRQoL) in Singapore. In order to examine whether the SF-12v2 was appropriate for use in the population, the factor structure and validity of the English, Mandarin, and Malay versions were assessed in a representative sample of the general population of Singapore.Methods6126 respondents were recruited for the Singapore Mental Health Study 2016 (SMHS 2016), a cross-sectional and population-based survey. Confirmatory factor analyses (CFA) were conducted to examine the fit of a two-factor model for the SF-12v2 within a representative sample and amongst the different language (English, Mandarin, Malay) subgroups. Multiple-group CFAs (MGCFA) were conducted to test measurement invariance across the different languages, ethnicities, and chronic illnesses subgroups. CFA-generated latent factor scores (FSCORE command in MPlus) were also compared with the composite scores derived from the developer’s scoring method via correlations. Sociodemographic correlates of the latent physical and mental health scores were explored.ResultsCFA results within the full sample supported a two-factor model (RMSEA = 0.044; CFI = 0.991; TLI = 0.988; SRMR = 0.044) in which physical functioning, role physical, bodily pain and general health items loaded onto a latent physical health factor, while role emotional, mental health, social functioning, and vitality items loaded onto a latent mental health factor. Physical and mental health factors were allowed to correlate, unlike the developer’s orthogonal scoring method. All standardized loadings were high and statistically significant. Both factors had high internal consistency. CFA within subsamples of English, Mandarin, and Malay languages indicated similar findings. MGCFA results indicate that measurement invariance held across the different languages, ethnicities, and those with and without chronic illnesses. ConclusionThe present study identified a two-factor (physical and mental health) structure within the general population and amongst the three different languages and demonstrated the measurement invariance of SF-12v2 across different subgroups. Findings indicate that algorithm-derived PCS and MCS should be interpreted with caution as they may result in inaccurate conclusions regarding the relationships between HRQoL and its correlates. Future studies using the SF-12v2 within the general population of Singapore should consider utilizing the factor structure put forth in the present study to obtain more appropriate estimates of HRQoL.

Measurement invariance of the CD-RISC-10 across gender, age, and education: A study with Slovenian adults.

The study aimed to investigate measurement invariance of the 10-item Connor-Davidson Resilience Scale (CD-RISC-10) across gender, age, and education. Adults from a general population of Slovenia (N = 431; 58% female; age 18 to 59 years) filled in the CD-RISC-10, the short form of the Mental Health Continuum and the Depression, Anxiety and Stress Scale. Measurement invariance of the proposed one-factor model of CD-RISC-10 by gender, age, and level of education was examined using multiple-group confirmatory factor analysis. The results showed configural, metric, and scalar invariance of the CD-RISC-10 across gender, age, and educational groups. The measure showed satisfactory reliability, positive associations with emotional, psychological, and social well-being, and negative links with negative emotional states. Group differences in latent means suggested higher resilience in men than women, early adults as compared to emerging adults, and people with higher as compared to those with lower level of education. The Slovenian version of the CD-RISC-10 is an acceptably reliable and valid measure of resilience, suitable to detect possible differences between gender, age, and educational groups. Resilience shows favorable associations with enhanced positive mental health and diminished symptoms of mental problems.

Exploring the Measurement Invariance of the Calling Scale with College Students and Employees

The most widely used instrument to assess perceiving a calling, the CVQ(Calling and Vocational Questionnaire), is composed of three constructs: transcendent sermon, purposeful work, and prosocial orientation. Recently assessing perceiving a calling has received great attention and it is critical not only for job incumbents but also college students who are in the job search stage. The purpose of this study is to investigate measurement invariance of the Korean CVQ between employees and college students. 339 job incumbents and 252 college students participated in this study, and based on the multiple group confirmatory factor analysis from the structural equation model, we confirmed the measurement invariance between employees and college students at the scale level. Thus, the perceived calling scale is applicable to both employees and college students without biases. This study provided meaningful information in understanding calling, and we discussed limitations and future directions.

Adaptation and Validation of a Short Acculturation Scale in a Multi-Ethnic Asian Population

The Short Acculturation Scale (SAS) has been widely used for assessing the level of the acculturation of migrants in Western countries. However, the validity of SAS for use in cosmopolitan settings without a single prevailing culture is unclear. We examined the validity and reliability of a version of the SAS adapted to a multi-ethnic Asian society. We used cross-sectional data from 12,610 Singaporean citizens and permanent residents, aged 21–75 years, of Chinese, Malay, and Indian ethnicity. Our version used 11 items, with 5 questions on language use, 3 on media use, and 3 on ethnic social relations, to measure acculturation. Our version of the SAS had good internal consistency. The three-factor CFA model had a good fit to our data. The results from the multiple group CFA supported metric invariance and partial scalar invariance across the three ethnic groups. The total score was positively correlated with generation in Singapore and the number of languages spoken. Among first generation immigrants, country of origin, but not the duration of residence was significantly associated with the acculturation score. Our three-factor version of the SAS is a reliable and valid tool for measuring acculturation in Singapore residents. These findings indicate that adapted SAS can be used to assess acculturation in multicultural settings.

Prenatal attachment: using measurement invariance to test the validity of comparisons across eight culturally diverse countries

Studies in high-income countries (HICs) have shown that variability in maternal-fetal attachment (MFA) predict important maternal health and child outcomes. However, the validity of MFA ratings in low- and middle-income countries (LMICs) remains unknown. Addressing this gap, we assessed measurement invariance to test the conceptual equivalence of the Prenatal Attachment Inventory (PAI: Muller, 1993) across eight LMICs. Our aim was to determine whether the PAI yields similar information from pregnant women across different cultural contexts. We administered the 18-item PAI to 1181 mothers in the third trimester (Mean age = 28.27 years old, SD = 5.81 years, range = 18–48 years) expecting their first infant (n = 359) or a later-born infant (n = 820) as part of a prospective birth cohort study involving eight middle-income countries: Ghana, Jamaica, Pakistan, Philippines, Romania, South Africa, Sri Lanka and Vietnam. We used Multiple Group Confirmatory Factor Analyses to assess across-site measurement invariance. A single latent factor with partial measurement invariance was found across all sites except Pakistan. Group comparisons showed that mean levels of MFA were lowest for expectant mothers in Vietnam and highest for expectant mothers in Sri Lanka. MFA was higher in first-time mothers than in mothers expecting a later-born child. The PAI yields similar information about MFA across culturally distinct middle-income countries. These findings strengthen confidence in the use of the tool across different settings; future studies should explore the use of the PAI as a screen for maternal behaviour that place children at risk.

Assessing the comparability of teacher-related constructs in TIMSS 2015 across 46 education systems: an alignment optimization approach

Research related to the “teacher characteristics” dimension of teacher quality has proven inconclusive and weakly related to student success, and addressing the teaching contexts may be crucial for furthering this line of inquiry. International large-scale assessments are well positioned to undertake such questions due to their systematic sampling of students, schools, and education systems. However, researchers are frequently prohibited from answering such questions due to measurement invariance related issues. This study uses the traditional multiple group confirmatory factor analysis (MGCFA) and an alignment optimization method to examine measurement invariance in several constructs from the teacher questionnaires in the Trends in International Mathematics and Science Study (TIMSS) 2015 across 46 education systems. Constructs included mathematics teacher’s Job satisfaction, School emphasis on academic success, School condition and resources, Safe and orderly school, and teacher’s Self-efficacy. The MGCFA results show that just three constructs achieve invariance at the metric level. However, an alignment optimization method is applied, and results show that all five constructs fall within the threshold of acceptable measurement non-invariance. This study therefore presents an argument that they can be validly compared across education systems, and a subsequent comparison of latent factor means compares differences across the groups. Future research may utilize the estimated factor means from the aligned models in order to further investigate the role of teacher characteristics and contexts in student outcomes.

Effect of Item Order on Certain Psychometric Properties: A Demonstration on a Cyberloafing Scale.

Many studies have been conducted on the effect of item order in self-report questionnaires on mean scores. This research aims to study the effect of item order on measurement invariance in addition to mean scores. To this end, two groups randomly obtained from the same sample were presented a fixed order form in which all items belonging to the same dimension were adjacent to each other, and a random order form in which the items were randomly sequenced respectively. The results obtained revealed a statistically significant difference between the mean scores of the two forms. In the next stage of the study, the fit indices obtained from the confirmatory factor analysis (CFA) applied to the two separate forms and the modification indices (MI) suggested by the software were compared. Both forms returned high modification suggestions for adjacent items or items presented near each other. Additionally, it was found that high χ2 reductions suggested by the MIs in one form resulted in low χ2 reductions in the other. Lastly, multiple group CFA (mg-CFA) was conducted to determine whether or not measurement invariance was achieved through different item order presentations of the scale. The findings indicate that measurement invariance could not be achieved even at the first stage of analysis. It may specifically be stated that presenting respondents items under the same dimension together ensures empirical findings congruent with theoretical structure.

Measuring psychosocial stress during pregnancy: a multiple-group confirmatory factor analysis across race/ethnicity among Medicaid-covered pregnant women in the United States

Background Differential experiences of psychosocial stress during pregnancy may contribute to racial inequities in adverse pregnancy outcomes in the US. Valid and unbiased measurement scales are needed to assess the effect of psychosocial stress on pregnancy outcomes, however, the numerous modified scales implemented to measure stress are not always validated. Methods The construct validity and measurement invariance of maternal stress among Medicaid-covered pregnant women (N = 1,632) were examined. Model fit estimates of three confirmatory factor analysis (CFA) models were compared to determine the appropriate measurement structure. Multiple-group CFA assessed measurement invariance across Black or African American women (51.7%) and women of all other races. Results Robust estimates of model fit supported a hierarchical CFA model composed of four latent domains of stress. Standardized factor loadings of three of these latent domains—external stress, perceived stress, and enhancers of stress- indicated positive correlations with a second-order latent factor for overall maternal stress, whereas the fourth domain, buffers of stress, had a negative association. Multiple-group CFA demonstrated strong measurement invariance. Conclusions Among Medicaid-covered pregnant women, measures for psychosocial stress were unbiased across two subgroups of maternal race/ethnicity. These findings support the construct validity of overall maternal stress underlying the common variability among four latent domains of stress.

Organizational health and independent sector healthcare organizations

ABSTRACT With an increasing proportion of UK healthcare delivered by independent sector providers (ISPs) it is important that performance data is reviewed with a similar rigour as within the public sector. However, there is a relative paucity of work considering quotients of performance in the independent healthcare sector. This study sets out to measure organizational health within ISPs in the UK and juxtapose this with contemporaneous data taken from public sector NHS organizations. Survey data was tested for construct validity with fit of the existing factor structure of the Healthcare-OH survey examined using confirmatory factor analysis (CFA). Multiple-group CFA was used to establish measurement invariance to permit comparison of latent sum scores between ISP and NHS organizations. Measurement invariance analysis evaluated the fit of sequential invariance models, proceeding iteratively to establish partial metric and scalar invariance. Latent sum scores comparisons demonstrated ISPs outperformed NHS trusts across all elements of organizational health. This is the first time organizational health has been measured in ISPs explicitly for comparison with results in the public sector. Comparative measurement and analysis in this way is novel and has the potential of fostering a two-way learning process for the ultimate benefit of both NHS and ISP organizations.

The English and Chinese language versions of the Short Form 12-item Health Survey are equivalent

BackgroundThe Short Form 12-item Health Survey (SF-12v2) was originally developed in English, but it is also available in Hong Kong (HK) Chinese. While both language versions had their measurement properties well assessed in their respective populations, their measurement invariance in scores has not been examined. Therefore, we aimed to assess their measurement invariance.MethodsWe conducted a cross-sectional study on individuals aged 18 years or older at a university campus. Those who were bilingual in English and Chinese were randomly assigned to self-complete either the standard English or the HK Chinese SF-12v2. Measurement invariance of the two components and eight scales of the SF-12v2 was concluded if the corresponding 90% confidence interval (CI) for the difference between the two language versions entirely fell within the minimal clinically important difference of ± 3 units. Multiple-group confirmatory factor analysis (CFA) was also performed.ResultsA total of 1013 participants completed the SF-12v2 (496 in English and 517 in HK Chinese), with a mean age of 22 years (Range 18–58), and 626 participants (62%) were female. There were no significant differences in demographics. Only the physical and mental components and the mental health (MH) scale had their 90% CIs (0.21 to 1.61, − 1.00 to 0.98, and − 0.86 to 2.84, respectively) completely fall within the ± 3 units. The multiple-group CFA showed partial strict invariance.ConclusionsThe English and HK Chinese versions of the SF-12v2 can be used in studies with their two components and MH scores pooled in the analysis.

Factor Structure and Measurement Invariance of the Hospital Anxiety and Depression Scale Across the Peripartum Period Among Pregnant Japanese Women

PurposeThe Hospital Anxiety and Depression Scale (HADS) is a self-report questionnaire widely used to assess anxiety and depression. To the best of our knowledge, only four studies have examined the factor structure of the HADS for assessing pregnant women, with conflicting results. This study aimed to assess the factor structure and measurement invariance of the HADS for use with pregnant Japanese women.Participants and MethodsA total of 936 pregnant Japanese women completed the HADS questionnaire at three time points: the first and third trimester of pregnancy, and postpartum. We examined the factor structure of the HADS in Group 1 (n = 466) using exploratory factor analysis (EFA). We then compared the models identified in Group 1 with those from previous studies using confirmatory factor analysis (CFA) in Group 2 (n = 470). We performed multiple-group CFA for Group 2 to test the measurement invariance of the best-fit model across the three time points.ResultsThe EFA for the Group 1 data at the three time points revealed a two-factor model. In the CFA, the two-factor model from Group 1 showed the best fit with the data at the three time points. In the multiple-group CFA for Group 2, we confirmed the configural and metric invariance of the two-factor model across the three time points.ConclusionOur findings provide evidence for a two-factor structure and weak measurement invariance of the HADS in pregnant Japanese women during the peripartum period.

Measurement Invariance Testing with Alignment Method: Many Groups Comparison

It is necessary to examine the measurement invariance (MI) among groups in studies where different groups are compared by using a measurement instrument. Most of the studies, measurement invariance is tested with multiple group confirmatory factor analysis. This model applies many model adjustments based on the modification indexes. Therefore, it is not practical due to too many large modification indexes while testing MI over many groups. Besides scalar model is a poor model fit when comparing many groups and so does not hold MI. In this study, the aim is to explain the basic concepts and processes of the alignment method which is offered as a new method for testing MI and illustrate an application on the real data set. In this study, measurement invariance among 56 countries including Turkey is tested with alignment method in order to set an example for researchers. For this purpose, the Instrumental Motivation Scale data, which is one of the psychological measurement instruments used in PISA 2015, was used. As a result of MG-CFA, it was found that configural invariance was ensured. The fit indexes of CFI and TLI were calculated as 0.982 and 0.946 respectively in this stage. After that, metric invariance was tested by considering the difference of fit indices obtained for the two stages. It was found that the metric invariance could not be provided. Alignment results show which countries hold MI and which do not. Besides it provides information which items have the most invariants for groups that hold MI.