Multiple-group Confirmatory Factor Analysis Research Articles

Validation of the extended e-health literacy scale: structural validity, construct validity and measurement invariance

BackgroundGiven the rapid proliferation and use of online health resources, many of which may be of dubious quality, there is an increasing need to develop electronic health literacy (e-health literacy) skills among the population of internet users. E-health literacy encompasses the skills and abilities needed to access, understand, validate, evaluate, interpret, and apply online health-related information. Measuring e-health literacy has become crucial for developing targeted interventions, assessing their impact, and producing high-quality research findings that can inform health policy and clinical practice, which can lead to improved health outcomes and potentially reducing health inequalities. The scales need to be valid and reliable so that decisions are based on high-quality data. In this regard, the issue of the measurement invariance of scales across different demographic groups has been neglected. This is critical, as assessments should be valid across different sociodemographic groups to avoid bias when comparing them. The aim of this study was to validate the Extended e-health literacy scale (eHEALS-E) on general population and investigate its structural validity and internal consistency, construct validity in terms of convergent and discriminant validity, and examine its measurement invariance across gender, age, education and social status.MethodsThe data were collected as a part of a national health literacy survey conducted by the Slovenian National Institute of Public Health. For this survey the initial eHEALS-E scale was revised in order to address its limitations and applicability to general population. Based on a nationally representative sample, the final sample for the analysis comprised 1,944 individuals who at least occasionally used one of the various internet services to obtain health-related information. Multiple group confirmatory factor analysis was used to examine the measurement invariance of the scale.ResultsWith some adjustments, the measurement model of the revised 6-dimensional eHEALS-E scale demonstrated a good fit to the data (χ2 = 2508, df = 282, RMSEA = 0.064, SRMR = 0.070, CFI = 0.90). The scale had good internal consistency (alpha = 0.89). Although evidence of the scale’s convergent and discriminant validity was partially provided, the analysis revealed robust measurement invariance across sociodemographic groups.ConclusionsWith a minor limitation, the scale ensures an unbiased e-health literacy assessment across different social groups, which is crucial for interventions that aim to reduce health-related social inequalities. This ensures that the interventions derived from the assessment of reality are equally valid and effective for everyone, regardless of their sociodemographic background.

Measurement invariance of the action competence in sustainable development questionnaire: can we compare between groups?

There is a need for valid and reliable instruments to assess learning outcomes in education for sustainable development (ESD). Measurement invariance (MI) needs to be established before results of these instruments can be validly compared between groups. Despite its importance, establishing MI is an often overlooked validation step. To provide an example of testing for MI in the field of ESD, thereby setting a precedent for subsequent studies, this study tested the MI of the Action Competence in Sustainable Development Questionnaire (ACiSD-Q). First, Confirmatory Factor Analyses (CFAs) were carried out to make refinements to the original model. Subsequently, nested multiple-group CFAs were performed to test for MI of the ACiSD-Q for the grouping variables of educational level (primary versus secondary), language spoken at home (instructional language versus other languages), and gender. Model fit indices of the refined model and the ACiSD-Q’s proneness to MI are discussed.

Validation of the Interpersonal Relationships in Eating Disorders (IR-ED) Scale in an Eating Disorder Sample.

Interpersonal problems have been identified as a plausible mechanism underlying the onset and maintenance of eating disorders. The Interpersonal Relationships in Eating Disorders (IR-ED) scale is the first eating disorders-specific measure of interpersonal problems, which was developed in a nonclinical sample. The aims of the current study were to (a) confirm the factor structure of the IR-ED within a large clinical sample, (b) investigate measurement invariance of the IR-ED across nonclinical and clinical samples, (c) examine the convergent validity of the IR-ED using a generic measure of interpersonal problems, and (d) investigate the incremental clinical utility of the IR-ED in uniquely predicting eating disorder symptomatology. Treatment-seeking individuals (N = 437) completed the IR-ED at their initial assessment appointment at a specialist eating disorder outpatient service. A multiple-group confirmatory factor analysis supported an invariant bifactor structure comprising a general interpersonal problems factor and two group factors-Avoidance of Body Evaluation and Food-Related Interpersonal Tension. Convergent validity was demonstrated by a large, statistically significant correlation with a generic measure of interpersonal problems (r = 0.62, p < 0.001). A series of structural equation models further revealed unique incremental predictive utility of the IR-ED for eating disorder symptomatology. The IR-ED has strong psychometric properties and may prove beneficial in the assessment, formulation, and treatment of eating-specific interpersonal problems among patients with eating disorders.

Psychometric Properties of Scales Assessing Psychosocial Determinants of Staff Compliance with Surgical Site Infection Prevention: The WACH-Study.

Psychosocial determinants influence healthcare workers' compliance with surgical site infection (SSI) preventive interventions. In order to design needs-based interventions promoting compliance, such determinants must first be assessed using valid and reliable questionnaire scales. To compare professional groups without bias, the scales must also be measurement-equivalent. We examine the validity/reliability and measurement equivalence of four scales using data from physicians and nurses from outside the university sector. Additionally, we explore associations with self-reported SSI preventive compliance. N = 90 physicians and N = 193 nurses (response rate: 31.5%) from nine general/visceral or orthopedic/trauma surgery departments in six non-university hospitals in Germany participated. A written questionnaire was used to assess the compliance with SSI preventive interventions and the determinants of compliance based on the Capability-Opportunity-Motivation-Behavior-Model. Psychometric testing involved single- and multiple-group confirmatory factor analyses, and explorative analyses used t-tests and multiple linear regression. The scales assessing individual determinants of compliance (capability, motivation, and planning) were found to be reliable (each Cronbach's α ≥ 0.85) and valid (each Root-Mean-Square-Error of Approximation ≤ 0.065, each Comparative-Fit-Index = 0.95) and revealed measurement equivalence for physicians and nurses. The scale assessing external determinants (opportunity) did not demonstrate validity, reliability, or measurement equivalence. Group differences were found neither in compliance (p = 0.627) nor determinants (p = 0.192; p = 0.866; p = 0.964). Capability (β = 0.301) and planning (β = 0.201) showed associations with compliance for nurses only. The scales assessing motivation, capability, and planning regarding SSI preventive compliance provided reliable and valid scores for physicians and nurses in surgery. Measurement equivalence allows group comparisons of scale means to be interpreted without bias.

The universality of anxiety experiences between Germany, Indonesia, and the US: A measurement invariance analysis

BackgroundGeneralized Anxiety Disorder-7 (GAD-7) is a widely used self-report that assesses generalized anxiety disorder symptomatology. Whilst previous studies have reported good-to-excellent psychometric properties across different languages, it remains unclear whether GAD-7 measures the same construct across Western and non-Western countries. Here, we tested the hypothesis that the GAD-7 is measurement invariant across Western and non-Western countries and the hypothesis that a less severe GAD symptomatology can be found in non-Western countries. MethodsThe present study employed an online survey to examine the GAD-7's measurement invariance (MI) across community samples from Indonesia, Germany, and the USA (N = 2350). MI was computed using multiple-group confirmatory factor analyses with a general factor model of the GAD-7. ResultsThe general factor of the GAD-7 had good model fit and configural, metric, scalar, and residual MI across the three countries. No significant differences were found in mean scores (Indonesia, M = 1.78, SD = 0.64, Germany, M = 1.84, SD = 0.69, USA, M = 1.87, SD = 0.79; F (2, 1514) = 3.079, p = 0.046; Games-Howell post-hoc analysis, tGermany-Indonesia = 1.720, p = 0.199; tGermany-USA = 0.750, p = 0.734; tIndonesia-USA = 2.330, p = 0.053). LimitationsThis study's online nature may have inflated cross-country similarities and reduced data generalizability. ConclusionThe full MI demonstrates the GAD-7 captures the same GAD construct across Western and non-Western countries. Inconsistent with the previous findings GAD severity levels were similar across countries. Despite some possible reservations, the GAD-7 appears to be a culturally fair GAD measure.

The eTIMSS and TIMSS Measurement Invariance Study: Multigroup Factor Analyses and Differential Item Functioning Analyses with the 2019 Cycle

In this study, measurement invariance and differential item functioning (DIF) studies of the TIMSS 2019 4th and 8th-grade mathematics and science achievement tests were conducted for the country groups participating in both TIMMS and eTIMMS. The study sample consisted of 9560 responders of the first booklet of the 2019 cycle. Multiple Group Confirmatory Factor Analysis (MGCFA) was utilized to test measurement invariance, and Mantel-Haenszel (MH), Logistic Regression (LR), and SIBTEST were used for the DIF analyses. The measurement invariance results indicated strict invariance between groups for all subtests which included 111 items in total. In the DIF analyses, for the 4th and 8th-grade mathematics subtests, only three items showed moderate DIF with MH, and four items showed DIF with SIBTEST. For the 4th-grade science subtest, one item showed moderate DIF with both MH and SIBTEST. However, in the 8th-grade science subtest, no items showed DIF with MH and LR methods, while four items showed moderate DIF with SIBTEST. Overall, MH and SIBTEST techniques were in agreement, whereas LR method produced inconsistent results and showed disagreement with these two methods. The results of the measurement invariance analysis and the LR method were consistent and indicated equivalency of TIMMS and e-TIMMS scores.

Validity of a common measure of intimate partner violence perpetration: Impact on study inference in trials in low- and middle-income countries

BackgroundIn lower-and middle-income countries (LMICs), studies of interventions to reduce intimate partner violence (IPV) perpetration are expanding yet measurement equivalence of the construct has not been established. We assessed the measurement equivalence of physical and sexual IPV perpetration used in recent trials in LMICs and tested the impact of non-invariance on trial inference. MethodsWith data from three recent intervention trials among men (sample size 505–1537 across studies), we calculated tetrachoric correlations among items and used multiple-group confirmatory factor analysis to assess invariance across arms and over time. We also assessed treatment effects adjusting for covariate imbalance and using inverse probability to treatment weights to assess concordance of invariant measures with published results, where warranted. Findings.The average correlation among items was high and increased over time with several items in two studies showing correlations ≥0.85 at endline. Increases in correlation for physical IPV were concentrated in the treatment arm in two of the studies. The increase in correlation in sexual IPV differed by arm across studies. Across all studies, a correlated two-factor solution was the best fitting model according to the EFAs and CFAs. One study demonstrated measurement invariance across arms and over time. In two of the studies, longitudinal measurement non-invariance was detected in the intervention arms. In post hoc testing, one study attained invariance with a one-factor model and study inference was concordant with published findings. The other study did not attain even partial invariance. ConclusionCommon measures of physical and sexual IPV perpetration cannot be used for valid effect estimation without further refinement. The study highlights the need for an expanded item set, content validity assessments, further measurement invariance testing, and then consistent use of the item sets in future intervention trials to support accurate inference on the effectiveness of IPV perpetration prevention interventions.

Structural Validity Evidence for the Oxford Utilitarianism Scale Across 15 Languages

Abstract: Background: The Psychological Science Accelerator (PSA) recently completed a large-scale moral psychology study using translated versions of the Oxford Utilitarianism Scale (OUS). However, the translated versions have no validity evidence. Objective: The study investigated the structural validity evidence of the OUS across 15 translated versions and produced version-specific validity reports. Methods: We analyzed OUS data from the PSA, which was collected internationally on a centralized online questionnaire . We also collected qualitative feedback from experts for each translated version. Results: For each version, we produced version-specific psychometric reports which include the following: (1) descriptive item and demographics analyses, (2) factor structure evidence using confirmatory factor analyses, (3) measurement invariance testing across languages using multiple-group confirmatory factor analyses and alignment optimization, and (4) reliability analyses using coefficients α and ω.

Reliability and validity of the Patient Health Questionnaire-4 scale and its subscales of depression and anxiety among US adults based on nativity

BackgroundThe burdens of anxiety and depression symptoms have significantly increased in the general US population, especially during this COVID-19 epidemiological crisis. The first step in an effective treatment for anxiety and depression disorders is screening. The Patient Health Questionnaire-4 (PHQ-4, a 4-item measure of anxiety/depression) and its subscales (PHQ-2 [a 2-item measure of depression] and Generalized Anxiety Disorder [GAD-2, a 2-item measure of anxiety]) are brief but effective mass screening instruments for anxiety and depression symptoms in general populations. However, little to no study examined the psychometric properties (i.e., reliability and validity) of the PHQ-4 and its subscales (PHQ-2 and GAD-2) in the general US adult population or based on US nativity (i.e., foreign-born vs. the US-born). We evaluated the psychometric properties of the PHQ-4 and its subscales in US adults, as well as the psychometric equivalence of the PHQ-4 scale based on nativity.MethodsWe conducted a cross-sectional survey of 5,140 adults aged ≥ 18 years. We examined the factorial validity and dimensionality of the PHQ-4 with confirmatory factor analysis (CFA). A multiple-group confirmatory factor analysis (MCFA) was used to evaluate the comparability of the PHQ-4 across nativity groups. Reliability indices were assessed. Also, the scales’ construct validities were assessed by examining the associations of both the PHQ-4 and its subscales’ scores with the sociodemographic characteristics and the 3-item UCLA Loneliness scale.ResultsThe internal consistencies were high for the PHQ-4 scale (α = 0.92) and its subscales of PHQ-2 (α = 0.86) and GAD-2 (α = 0.90). The CFA fit indices showed evidence for the two-factor structure of the PHQ-4. The two factors (i.e., anxiety and depression) were significantly correlated (r = 0.92). The MCFA demonstrated measurement invariance of the PHQ-4 across the nativity groups, but the model fits the data better in the foreign-born group. There were significant associations of the PHQ-4 scale and its subscales’ scores with the sociodemographic characteristics and the UCLA Loneliness scale (all p < 0.001).ConclusionsThe PHQ-4 and its subscales are reliable and valid measures to screen anxiety and depression symptoms in the general US adult population, especially in foreign-born individuals during the COVID-19 pandemic.

THE DEVELOPMENT OF COVID-19 BRIEF ANXIETY SCALE IN OMAN

Introduction: The global COVID-19 pandemic has caused increased levels of anxiety and stress. A recent study reported that 99% of its sample experienced anxiety, stress, stigma, and concerns about potential social isolation. Aims: This study aims to address the lack of a specific COVID-19 anxiety scale in Oman. Methods: The online scale was distributed via Google Form to 431 students, representing 3% of the total student population at Sultan Qaboos University (SQU). The students were enrolled in different colleges of Sultan Qaboos University. Exploratory factor analysis revealed a unidimensional factorial structure consisting of four items. Item loadings ranged from 0.617 (item 4) to 0.847 (item 3). Results: The results indicated that the validity fit indices were excellent. The RMSEA and SRMR values were greater than 0.05 indicating a perfect fit. The X2/DF value was 0.854, with a p-value of less than 0.653, while the GFI, AGFI, IFI, NFI, TLI, CFI, RMR, and RMSEA values were 0.999, 0.995, 1.003, 0.998, 0.959, 1.00, 0.015, 0.000, respectively (90% CI [0.000; 0.074]). The COBAS-4 showed convergent validity through its significant association with similar scales. Discriminant validity was established via its insignificant correlation to distinct constructs. McDonald’s omega and Cronbach’s alpha showed adequate reliability at 0.810 each. The results of multiple group CFA indicated configural, metric, and scalar invariance between male and female students (ΔCFI ≤ 0.01, ΔRMSEA ≤ 0.015). No significant differences were found between the two sexes. The scale was calibrated using the Rasch rating scale, which provided robust results. The Mantel-Haenszel test showed no differential item functioning (DIF) across sexes. Conclusion: The COBAS-4 is a valid, reliable, simple, and easy-to administer self-report instrument for assessing COVID-19-related anxiety.

Assessment of psychopathy among justice-involved adult males with low versus average intelligence: Differential links to violent offending.

Psychopathic personality is a multidimensional construct (De Brito et al., 2021) and the dimensions have differential associations with general and violent offending. Impairment in cognitive functioning, particularly intelligence (IQ), is another construct linked to both general and violent offending. However, the evidence is mixed on whether the combination of elevated psychopathy and low IQ increases the risk for violent offending (Hampton et al., 2014; Heilbrun, 1982; Walsh et al., 2004). Also, before this interaction can be firmly established, assessment of whether psychopathic traits are equivalent among individuals with different levels of IQ, especially those in the justice system, is needed. Using multiple-group confirmatory factor analysis (MG-CFA), this study of justice-involved adult males tested whether Psychopathy Checklist-Revised (PCL-R; Hare, 2003) item parameters were invariant among those with low (< 85) versus average IQ (≥ 85). In addition, moderated nonlinear factor analysis was conducted using continuous IQ scores to test for its effect on a range of model parameters. Both approaches provided evidence of measurement invariance. Adding criminal offenses to the MG-CFA revealed differential associations of the psychopathy dimensions with violent offending. Finally, analysis of variance results suggested an interaction between psychopathy status and IQ level-that is, those meeting diagnostic criterion for psychopathy with low IQ had the highest number of violent offenses. This study provides evidence of measurement invariance for the PCL-R among justice-involved persons with varying levels IQ and helps to extend research on the dynamic associations between psychopathy, IQ, and violent behavior. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Measurement and Construct-Level Invariance of the Revised Child Anxiety and Depression Scale (RCADS)

Abstract: Measurement and construct-level invariance of the Dutch Revised Child Anxiety and Depression Scale’s test scores (RCADS) across gender and ethnic (minority) backgrounds of the four largest ethnic groups of children living in the Netherlands (i.e., native Dutch; Moroccan; Turkish; or Surinamese/Antillean) was evaluated. Symptoms of generalized anxiety disorder, social phobia, separation anxiety disorder, panic disorder, obsessive-compulsive disorder, and major depressive disorder were rated by 2,679 mainstream elementary schoolchildren ( Mage = 10.61). Results from discrete multiple-group confirmatory factor analyses showed that factor means were generally insensitive to gender bias. However, moderate violations of measurement invariance between native Dutch and the three ethnic minority groups were found for social phobia, panic disorder, and separation anxiety disorder symptoms. Girls had higher mean levels on all RCADS subscales compared to boys. Furthermore, with a few exceptions, children from ethnic minority groups reported higher levels of symptoms of panic disorder, generalized anxiety disorder, and obsessive-compulsive disorder compared to native Dutch children. Scores derived from the RCADS are largely comparable between elementary school boys and girls, but for three out of six subscales, caution is warranted when comparing mean level differences of native Dutch children with children of Turkish, Moroccan, and Surinamese/Antillean ethnic backgrounds.

Measurement invariance and differential item functioning of the PHQ-9 and GAD-7 between working age and older adults seeking treatment for common mental disorders

BackgroundThe nine-item Patient Health Questionnaire (PHQ-9) and seven-item Generalised Anxiety Disorder (GAD-7) scale are widely used clinically and within research, and so it is important to determine how the measures, and individual items within the measures, are answered by adults of differing ages. This study sought to evaluate measurement invariance and differential item functioning (DIF) of the PHQ-9 and GAD-7 between working age and older adults seeking routine psychological treatment. MethodsData of working age (18–64 years old) and older (≥65) adults in eight Improving Access to Psychological Therapies (IAPT) services were used. Confirmatory factor analysis (CFA) was used to establish unidimensionality of the PHQ-9 and GAD-7, with multiple-group CFA to test measurement invariance and The Multiple Indicators, Multiple Causes Models approach to assess DIF. The employed methods were applied to a propensity score matched (PSM) sample in sensitivity analyses to control for potential confounding. ResultsData from 166,816 patients (159,325 working age, 7491 older) were used to show measurement invariance for the PHQ-9 and GAD-7, with limited evidence of DIF and similar results found with a PSM sample (n = 5868). LimitationsThe localised sample creates an inability to detect geographical variance, and the potential effect of unmeasured confounders cannot be ruled out. ConclusionsThe findings support the use of the PHQ-9 and GAD-7 measures for working age and older adults, both clinically and in research settings. This study validates using the measures for these age groups to assess clinically significant symptom thresholds, and monitor treatment outcomes between them.

Parents’ Educational Involvement: What is More Important Mothers’ Reports or Adolescents’ Perceptions?

The present study examined both mothers’ reports and adolescents’ perceptions of parents’ educational involvement and their effects on the adolescents’ functioning in school. The sample was drawn from 5 urban schools in Israel. Participants were 449 eighth grade students/adolescents (Female = 47%) and 126 mothers. Adolescents and their mothers completed parallel parents’ educational involvement questionnaires, and adolescents completed questionnaires on learning strategies and self-evaluation. Multiple-group confirmatory factor analyses, based on the mothers’ reports and adolescents’ perceptions of parents’ educational involvement revealed three factors: home-based, school-based, and communication-based knowledge of adolescents’ activities in school. The analysis showed no relation between mothers’ reports and adolescents’ perceptions. However, adolescents’ perceptions of their parents’ educational involvement were significant predictors of the adolescents’ learning strategies, self-evaluation, and academic achievement. Findings underline the congruence and incongruence between mothers and their adolescents, and the significant role parents play in their adolescents’ schooling according to the adolescents’ perceptions.

Validating the Unmind Index as a measure of mental health and wellbeing among adults in USA, Australia, and New Zealand.

The Unmind Index is a 26-item, 7-subscale measure of mental health and wellbeing designed for use on the Unmind digital workplace mental health platform. The Unmind Index was developed and validated in the UK but is used internationally. This paper reports further psychometric validation of this measure for use in USA, Australia, and New Zealand (ANZ). Participants in four countries completed the Unmind Index and a battery of existing measures. In Study 1 (N = 770), we validated the Unmind Index separately in USA and in ANZ. In Study 2 (N = 600), we used multiple group confirmatory factor analysis to test the measurement invariance of the Unmind Index across the UK, USA, and ANZ. Study 1 establishes the factor structure, reliability, convergent and discriminant validity, and measurement invariance by age and gender of the Unmind Index separately for USA and for ANZ. Study 2 further demonstrates measurement invariance across locations, and establishes benchmark scores by location, age, and gender. We conclude that the Unmind Index is valid and reliable as a measure of mental health and wellbeing in these locations.

Measurement and structural invariance of a neuropsychological battery among Middle Eastern/North African, Black, and White older adults.

There is a lack of guidance on common neuropsychological measures among Arabic speakers and individuals who identify as Middle Eastern/North African (MENA) in the United States. This study evaluated measurement and structural invariance of a neuropsychological battery across race/ethnicity (MENA, Black, White) and language (Arabic, English). Six hundred six older adults (128 MENA-English, 74 MENA-Arabic, 207 Black, 197 White) from the Detroit Area Wellness Network were assessed via telephone. Multiple-group confirmatory factor analyses examined four indicators corresponding to distinct cognitive domains: episodic memory (Consortium to Establish a Registry for Alzheimer's Disease [CERAD] Word List), language (Animal Fluency), attention (Montreal Cognitive Assessment [MoCA] forward digit span), and working memory (MoCA backward digit span). Measurement invariance analyses revealed full scalar invariance across language groups and partial scalar invariance across racial/ethnic groups suggesting a White testing advantage on Animal Fluency; yet this noninvariance did not meet a priori criteria for salient impact. Accounting for measurement noninvariance, structural invariance analyses revealed that MENA participants tested in English demonstrated lower cognitive health than Whites and Blacks, and MENA participants tested in Arabic demonstrated lower cognitive health than all other groups. Measurement invariance results support the use of a rigorously translated neuropsychological battery to assess global cognitive health across MENA/Black/White and Arabic/English groups. Structural invariance results reveal underrecognized cognitive disparities. Disaggregating MENA older adults from other non-Latinx Whites will advance research on cognitive health equity. Future research should attend to heterogeneity within the MENA population, as the choice to be tested in Arabic versus English may reflect immigrant, educational, and socioeconomic experiences relevant to cognitive aging. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Measurement invariance and response consistency of single-item assessments for suicidal thoughts and behaviors.

The present study aimed to expand the literature on single-item assessments for suicidal thoughts and behaviors (STBs) by examining measurement invariance of commonly used single-item assessments of suicidal ideation (SI), planning (SP), and attempts (SA) with respect to race and ethnicity. Predictive invariance with respect to depression, and multi-item measures of passive and active SI were also explored. Measurement invariance was examined across (a) Black and White respondents and (b) Hispanic/Latinx and non-Hispanic/-Latinx respondents. Participants (N = 1,624; 51.66% male) were recruited from Mechanical Turk and Prime Panels. Participants were administered four distinct single-item measures each for SI, SP, and SA across three timeframes (past month, past year, lifetime). Items were drawn from well-known large-scale studies (e.g., National Comorbidity Survey) and common suicide risk assessments. Multiple group confirmatory factor analysis was used to examine measurement invariance; regression with group by measure interactions were used to evaluate predictive invariance. Measurement invariance was observed for both Black (N = 534) and White (N = 1,089) respondents as well as Hispanic/Latinx (N = 335) and non-Hispanic/-Latinx (N = 1,288) respondents across single-item outcomes. Thus, SI, SP, and SA rates can be defensibly compared between Black and White and Hispanic/Latinx and non-Hispanic/-Latinx respondents within studies; however, comparison of SI and SP rates across studies with differing assessment prompts should be met with caution. Multiple single-item STB measures demonstrated predictive bias across race and ethnicity suggesting potential differential screening capabilities. Elevated SI, SP, and SA rates for Hispanic/Latinx individuals were also observed. Findings reiterate the importance of minor language differences in single-item STB assessments. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Examining Appropriacy of CFI and TLI Cutoff Value in Multiple-Group CFA Test of Measurement Invariance to Enhance Accuracy of Test Score Interpretation

The most common effect size when using a multiple-group confirmatory factor analysis approach to measurement invariance is ΔCFI and ΔTLI with a cutoff value of 0.01. However, this recommended cutoff value may not be ubiquitously appropriate and may be of limited application for some tests (e.g., measures using dichotomous items or different estimation methods, sample sizes, or model complexity). Moreover, prior cutoff value estimations often have ignored consequences resulting in using measures that more accurately estimate countries’ or learners’ proficiency for some countries or groups versus others. In this study, we investigate whether the cutoff value proposed by Cheung and Rensvold (ΔCFI or ΔTLI &gt; 0.01) is appropriate across educational measurement contexts. Specifically, we investigated the performance of ΔCFI and ΔTLI in capturing LOI at the scalar level in dichotomous items within item response theory on groups whose test characteristic curves differed by 0.5. Simulation results showed that the proposed cutoff value of 0.01 in ΔCFI and ΔTLI was not appropriate to capture LOI under the study conditions, which may result in the misinterpretation of test results or inaccurate inferences.

Investigation of The Measurement Invariance of Affective Characteristics Related to TIMSS 2019 Mathematics Achievement by Gender

This research examines whether the affective characteristics of the TIMSS 2019 Turkey mathematics application provide measurement invariance according to gender. The research sample consists of 4048 8th-grade students participating in the TIMSS in 2019. Research data were downloaded from the international website of TIMSS. The research data collection tools are “Sense of School Belonging”, “Students Confident in Mathematics”, “Students Like Learning Mathematics”, and “Students Value Mathematics” scales. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were performed in the context of validity analyses to examine measurement invariance. In terms of reliability, the Cronbach Alfa internal consistency coefficient was calculated. Accordingly, out of the four scales in the study, only “Students Confident in Mathematics” scale could not be confirmed in confirmatory factor analysis. Therefore, while “Students Confident in Mathematics” scale was not examined for measurement invariance, the other three scales were examined within the scope of measurement invariance. For measurement invariance, research data were tested with Multiple Group Confirmatory Factor Analysis (MG-CFA), one of the Structural Equation Modeling (SEM) techniques. As a result of the analyses, while the strict invariance model was provided in “Students Like Learning Mathematics” scale and “Students Value Mathematics” scale, strong invariance/scale invariance model was provided in “Sense of School Belonging” scale. It was concluded that there was no gender bias in the three scales for which MG-CFA was performed, and the mean scores were comparable according to gender. In this context, it can be said that “Sense of School Belonging”, “Students Like Learning Mathematics”, and “Students Value Mathematics” scales are valid in determining the differences according to gender.

Validating a Short Version of the Intolerance of Uncertainty Scale-12 (IUS-12)

Background: This study aims to validate the short version of the Intolerance of Uncertainty Scale-12 (IUS-12).Methods: A comprehensive set of questionnaires, including the IUS-12, STAI-T, PSWQ, CES-D, and K-CSI, was administered and completed by 404 participants. The average age of the participants was 31.29 years (SD=9.18), comprising 114 men, 287 women, and 3 individuals identifying with the other gender. We conducted a factor analysis on the collected data and compared the fit indices of one-factor, two-factor, and bifactor models. Furthermore, a multiple-group confirmatory factor analysis evaluated measurement invariance between the men’s and women’s groups. Correlational analyses were also conducted.Results: Data from the study show that the bifactor model was the most appropriate, demonstrating good internal consistency. The Omega coefficients and explained common variance were computed to evaluate the dimensionality of the IUS-12, validating the use of the total score of the scale. Its factor model also showed that the measurement invariance sustained between two gender groups. The correlation analyses between the IUS-12 and other scales assessing attributes such as trait anxiety, worry, depression, and avoidance coping strategy supported convergent validity.Conclusions: These findings suggest that the IUS-12 is a reliable and valid measure for assessing the intolerance of uncertainty. The study also discusses its limitations and offers recommendations for future research endeavors.