Exploratory Structural Equation Modeling Solution Research Articles

Psychometric properties of the Italian version of the Occupational Fatigue Exhaustion/Recovery (OFER) scale among healthcare professionals

ABSTRACT Objective The purpose of this study was to analyze the psychometric properties of the Italian version of the Occupational Fatigue Exhaustion/Recovery (OFER). Methods A cross-sectional study among 434 healthcare workers was undertaken. The factorial validity of the OFER, was compared using standard confirmatory factor analysis (CFA) with exploratory structural equation modeling (ESEM). Internal consistency, convergent validity, and factorial invariance (across gender) were assessed. Results A three-factor first-order ESEM solution provided the best and most parsimonious representation of the data: χ2(63) = 212.81, p < .001, RMSEA = 0.074 (90% CI 0.063–0.085), CFI = 0.949, TLI = 0.915. The three-factors were chronic fatigue, acute fatigue, and intershift recovery. Chronic and acute factors showed excellent internal consistency (ω > 0.80), however intershift recovery showed less internal consistency (ω < 0.70). OFER scores were found to be positively correlated with FAS scores, supporting its convergent validity. Conclusions The OFER was factorially invariant across gender. Overall, our findings provided evidence for the satisfactory psychometric properties of the OFER among Italian workers, confirming its value for use in both practical occupational and academic research settings.

The psychometric properties of the Burnout Assessment Tool in Norway: A thorough investigation into construct-relevant multidimensionality.

The World Health Organization recognizes burnout as an occupational issue. Nevertheless, accurately identifying employee burnout remains a challenging task. To complicate matters, current measures of burnout have demonstrated limitations, prompting the development of the Burnout Assessment Tool (BAT). Given these circumstances, conducting an in-depth examination of the BAT's construct-relevant multidimensionality is crucial. This study focuses on both the original 23-item BAT and the short 12-item version, using modern factor analytic methods to investigate reliability, validity, and measurement invariance in a representative sample from Norway (n = 493; 49.54% women). Our findings revealed that the bifactor exploratory structural equation modeling solution (burnout global factor and four specific burnout component factors) best explained the data for both BAT versions. All factors demonstrated adequate omega coefficients, with the global factor showing exceptional strength. Both BAT versions correlated highly with each other and with another burnout measure, suggesting convergent validity. Furthermore, both BAT versions achieved full (strict) measurement invariance based on gender. Finally, our results showed that burnout acts as a mediator in our proposed job demands-resources model as preliminary evidence of predictive validity. The study validates the Burnout Assessment Tool in the Norwegian context. The study supports the reliability, validity, and unbiased nature of the tool across genders. The findings also reinforce the importance of job demands and resources, along with burnout as a key mediator, in understanding workplace dynamics in accordance with job demands-resources theory.

Measuring the classroom level of the Dynamic Model of Educational Effectiveness through teacher self-report: development and validation of a new instrument

In the Dynamic Model of Educational Effectiveness, classroom-level effectiveness factors are assessed through observations or aggregated students’ ratings. The current study is aimed at developing and validating a complementary teacher self-report instrument of effective practices at classroom level (the DMEE-Class-T). The new instrument showed concurrent validity with the CSS-T. Dimensionality of both instruments was examined using the bifactor exploratory structural equation modeling (ESEM) framework, testing for alternative factorial representations of the data collected in a large-scale study conducted in all Luxembourgish elementary schools. For both instruments, the bifactor-ESEM and ESEM models showed excellent fitting indices and parameters, but the ESEM solution was retained as the best model for parsimony purpose. These results suggest that the eight types of practices assessed through the DMEE-Class-T could be considered as distinct facets of effective teaching practices while taking items cross-loadings into account. Implications for research and teachers’ professional development are discussed.

Cross-cultural adaptation and psychometric properties of the Italian version of the Orthorexia Nervosa Inventory (ONI)

BackgroundOrthorexia Nervosa (ON) is an emerging clinical condition characterized by a pathological fixation with healthy eating. Recently, the Orthorexia Nervosa Inventory (ONI) has emerged as a promising tool for assessing orthorexic tendencies and behaviours, aiming to overcome the well-established limitations of existing measures for ON. The present study aimed to examine the psychometric properties of the Italian version of the ONI.MethodsA total of 879 participants (Mage = 33.22 years, SD = 9.19; 56.9% females) completed the ONI along with the Düsseldorf Orthorexia Scale (DOS), measures of disordered eating, obsessive-compulsive symptoms (OCD), and psychosocial impairment. To establish the factorial validity of the ONI, a competing measurement modeling approach was employed by comparing standard confirmatory factor analytic (CFA) with exploratory structural equation modeling (ESEM) solutions. Model-based omega coefficients were computed to examine the internal consistency of the scale. Factorial invariance tests across gender were conducted within a multi-group framework.ResultsA three-factor first-order ESEM solution provided the best and most parsimonious representation of the data: χ2(207) = 558.641, p < .001, RMSEA = 0.044 (90% CI 0.040–0.048), CFI = 0.976, TLI = 0.968, SRMR = 0.036. The three latent dimensions, labelled behaviors, emotions, and impairments, showed excellent internal consistency (ω > 0.88). Furthermore, ONI scores were found to be positively correlated with DOS scores, disordered eating, OCD symptoms, and psychosocial impairment, supporting its convergent and criterion validity. Eventually, the ONI was factorially invariant across gender.ConclusionsOverall, the present study provides evidence for the satisfactory psychometric properties of the ONI in the Italian context, endorsing its use in both clinical and research settings.

Exploratory structural equation modeling (ESEM) and bifactor ESEM for construct validation purposes: Guidelines and applied example

The present study aims to introduce the advancement of the exploratory structural equation modeling (ESEM) and bifactor ESEM for construct validation purposes in second language research. It does so by applying the methods to the Basic Psychological Needs in Second Language (BPN-L2) Scale (Alamer, 2021a) to assess its factorial validity from a novel perspective. Bifactor ESEM is useful in situations where the theory postulates two layers of constructs (global and specific constructs). A comparison was made between four CFA and ESEM models, and the bifactor ESEM was the model of choice because it provided sufficient details about the multidimensionality of the BPN-L2 scale which accounted for the specific constructs (i.e., autonomy, competence, and relatedness) and the general construct (i.e., the basic psychological needs) and allowed for the assessment of convergent, discriminant, and predictive (criterion) validity from a new perspective. Predictive (criterion-related) validity was assessed using the structural bifactor ESEM by showing that the specific factors explained autonomous motivation differently compared to the global BPN factor, thus confirming the presence of imbalance at the specific factors level. The study provided guidelines in applying bifactor ESEM and presented an applied example with the syntax required to run the models in Mplus. The findings showed that the BPN-L2 scale is reliable and valid through the bifactor ESEM solution and that CFA solutions failed to support the measurement model.

The Infertility-Related Stress Scale: Validation of a Brazilian-Portuguese Version and Measurement Invariance Across Brazil and Italy.

Infertility constitutes an essential source of stress in the individual and couple’s life. The Infertility-Related Stress Scale (IRSS) is of clinical interest for exploring infertility-related stress affecting the intrapersonal and interpersonal domains of infertile individuals’ lives. In the present study, the IRSS was translated into Brazilian–Portuguese, and its factor structure, reliability, and relations to sociodemographic and infertility-related characteristics and depression were examined. A sample of 553 Brazilian infertile individuals (54.2% female, mean aged 36 ± 6 years) completed the Brazilian–Portuguese IRSS (IRSS-BP), and a subsample of 222 participants also completed the BDI-II. A sample of 526 Italian infertile individuals (54.2% female, mean aged 38 ± 6 years) was used to test for the IRSS measurement invariance across Brazil and Italy. Results of exploratory structural equation modeling (ESEM) indicated that a bifactor solution best represented the structure underlying the IRSS-BP. Both the general and the two specific intrapersonal and interpersonal IRSS-BP factors showed satisfactory levels of composite reliability. The bifactor ESEM solution replicated well across countries. As evidence of relations to other variables, female gender, a longer duration of infertility, and higher depression were associated with higher scores in global and domain-specific infertility-related stress. The findings offer initial evidence of validity and reliability of the IRSS-BP, which could be used by fertility clinic staff to rapidly identify patients who need support to deal with the stressful impact of infertility in the intrapersonal and interpersonal life domains, as recommended by international guidelines for routine psychosocial care in infertility settings.

Disentangling symptoms of externalizing disorders in children using multiple measures and informants.

The trait impulsivity theory suggests that a single, highly heritable externalizing liability factor, expressed as temperamental trait impulsivity, represents the core vulnerability for externalizing disorders. The present study sought to test the application of latent factor models derived from this theory to a clinical sample of children. Participants were 474 German children (age 6-12 years, 81% male) with symptoms of attention-deficit/hyperactivity disorder and externalizing behavior problems participating in an ongoing multicenter intervention study. Using confirmatory factor analyses (CFA) and exploratory structural equation modeling (ESEM), we evaluated several factor models of externalizing spectrum disorders (unidimensional; first-order correlated factors; higher-order factor; fully symmetrical bifactor; bifactor S-1 model). Furthermore, we assessed our prevailing factor models for measurement invariance across raters (clinicians, parents, teachers) and assessment modes (interview, questionnaires). While both CFA and ESEM approaches provided valuable insights into the multidimensionality, ESEM solutions were generally superior since they showed a substantially better model fit and less biased factor loadings. Among the models tested, the bifactor S-1 CFA/ESEM models, with a general hyperactivity-impulsivity reference factor, displayed a statistically sound factor structure and allowed for straightforward interpretability. Furthermore, these models showed the same organization of factors and loading patterns, but not equivalent item thresholds across raters and assessment modes, highlighting cross-situational variability in child behavior. Our findings are consistent with the assumption of the trait impulsivity theory that a common trait, presented as hyperactivity-impulsivity symptoms, underlies all externalizing disorders. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Psychometric Properties of the Adult Self-Report: Data from over 11,000 American Adults

The first purpose of this study was to examine the factor structure of the Adult Self-Report (ASR) via traditional confirmatory factor analysis (CFA) and contemporary exploratory structural equation modeling (ESEM). The second purpose was to examine the measurement invariance of the ASR subscales across age groups. We used baseline data from the Adolescent Brain Cognitive Development study. ASR data from 11,773 participants were used to conduct the CFA and ESEM analyses and data from 11,678 participants were used to conduct measurement invariance testing. Fit indices supported both the CFA and ESEM solutions, with the ESEM solution yielding better fit indices. However, several items in the ESEM solution did not sufficiently load on their intended factors and/or cross-loaded on unintended factors. Results from the measurement invariance analysis suggested that the ASR subscales are robust and fully invariant across subgroups of adults formed on the basis of age (18–35 years vs. 36–59 years). Future research should seek to both CFA and ESEM to provide a more comprehensive assessment of the ASR.

Psychometric properties of the MHC-SF: An integration of the existing measurement approaches.

The purpose of the current study is to test the factorial structure of the Mental Health Continuum-Short Form (MHC-SF) in Asian population. The study was conducted across three different Vietnamese samples (N=2741). We present a comparison of the existing measurement models of the MHC-SF using two methodological approaches: confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) (both in exploratory-using bi-geomin rotation; and in confirmatory variant-using target rotation). The current report supported the targeted bifactor ESEM solution as better describing the factorial structure of the MHC-SF than the originally assumed three-factor solution in all samples. The structure of the MHC-SF is best represented as combination of the bifactor and ESEM model.

The Italian Version of the Inventory of Interpersonal Problems (IIP-32): Psychometric Properties and Factor Structure in Clinical and Non-clinical Groups.

All versions of the Inventory of Interpersonal Problems (IIP) are broadly used to measure people's interpersonal functioning. The aims of the current study are: (a) to examine the psychometric properties and factor structure of the Italian version of the Inventory of Interpersonal Problems—short version (IIP-32); and (b) to evaluate its associations with core symptoms of different eating disorders. One thousand two hundred and twenty three participants (n = 623 non-clinical and n = 600 clinical participants with eating disorders and obesity) filled out the Inventory of Interpersonal Problems—short version (IIP-32) along with measures of self-esteem (Rosenberg Self-Esteem Scale, RSES), psychological functioning (Outcome Questionnaire, OQ-45), and eating disorders (Eating Disorder Inventory, EDI-3). The present study examined the eight-factor structure of the IIP-32 with Confirmatory Factor Analysis (CFA) and Exploratory Structural Equation Modeling (ESEM). ESEM was also used to test the measurement invariance of the IIP-32 across clinical and non-clinical groups. It was found that CFA had unsatisfactory model fit, whereas the corresponding ESEM solution provided a better fit to the observed data. However, six target factor loadings tend to be modest, and ten items showed cross-loadings higher than 0.30. The configural and metric invariance as well as the scalar and partial strict invariance of the IIP-32 were supported across clinical and non-clinical groups. The internal consistency of the IIP-32 was acceptable and the construct validity was confirmed by significant correlations between IIP-32, RSES, and OQ-45. Furthermore, overall interpersonal difficulties were consistently associated with core eating disorder symptoms, whereas interpersonal styles that reflect the inability to form close relationships, social awkwardness, the inability to be assertive, and a tendency to self-sacrificing were positively associated with general psychological maladjustment. Although further validation of the Italian version of the IIP-32 is needed to support these findings, the results on its cross-cultural validity are promising.

Exploring the Multidimensional Structure of Sensory Processing Sensitivity in Turkish Samples

We compared alternative models to explore the multidimensionality of the Highly Sensitive Person Scale (HSPS; Aron and Aron 1997) on two Turkish samples. Using exploratory factor analysis, first study (N = 412) yielded four factors representing diverse domains of sensory processing sensitivity (SPS). Using both traditional confirmatory factor analysis and exploratory structural equation modeling (ESEM), a second study (N = 341) confirmed the multidimensionality of the HSPS, and demonstrated that the four-factor ESEM solution (sensitivity to external stimuli, aesthetic sensitivity, harm avoidance, and sensitivity to overstimulation) was superior to the previously reported alternative models. Four factors were also systematically associated with the external validators including big five personality traits. Findings suggested that a multifaceted approach to SPS representing domain-specific sensitivities is needed.

Development and initial validation of the Life Skills Scale for Sport

ObjectivesThe aim of this research was to develop a measure of life skills development through sport. MethodFour studies were conducted to develop the Life Skills Scale for Sport (LSSS). Study 1 developed items for the scale and included 39 reviewers’ assessment of content validity. Study 2 included 338 youth sport participants and used exploratory factor analysis (EFA) and descriptive statistics to reduce the number of items in the scale and explore the factor structure of each subscale and the whole scale. Study 3 included 223 youth sport participants and assessed the factor structure of the scale using confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM) and bifactor modeling. Study 4 investigated the test-retest reliability of the scale over a two-week period with 37 youth sport participants. ResultsStudy 1 resulted in the development of the initial 144-item LSSS and provided content validity evidence for all items. Study 2 refined the scale to 47 items and provided preliminary evidence for the unidimensional factor structure of each subscale. Study 3 supported the factorial validity of the scale, with ESEM solutions providing the best fit and resulting in more differentiated factors. Study 4 provided evidence for the test-retest reliability of the scale. ConclusionsCollectively, these studies provided initial evidence for the validity and reliability of the LSSS; a measure which can be used by researchers and practitioners to assess participants’ perceived life skills development through sport.

Evaluating the Student–Teacher Relationship Scale in Italian Young Children: An Exploratory Structural Equation Modeling Approach

The study analyzed the factorial and concurrent validity of the Student–Teacher Relationship Scale (STRS) using an exploratory structural equation modeling (ESEM) approach. Participants were 368 Italian children aged 3 to 6 ( M = 4.60, SD = 0.98). The three-factor ESEM solution fit the data better than the classical confirmatory factor analysis (CFA) model and the measurement invariance of the scale was confirmed across sex and age (3-4 vs. 5-6 years) groups. The concurrent validity of the STRS was investigated within the ESEM approach using children’s social behaviors as validity criteria. Findings supported the goodness of ESEM over CFA and attested to the validity of the STRS to understanding the teacher–child relationship quality in young children.

Revisiting the Leadership Scale for Sport: Examining Factor Structure Through Exploratory Structural Equation Modeling.

This study examines the factor structure of the shortened version of the Leadership Scale for Sport, through a survey of 201 collegiate swimmers at National Collegiate Athletic Association Division II and III institutions, using both exploratory structural equation modeling and confirmatory factor analysis. Both exploratory structural equation modeling and confirmatory factor analysis showed that a five-factor solution fit the data adequately. The sizes of factor loadings on target factors substantially differed between the confirmatory factor analysis and exploratory structural equation modeling solutions. In addition, the inter-correlations between factors of the Leadership Scale for Sport and the correlations with athletes' satisfaction were found to be inflated in the confirmatory factor analysis solution. Overall, the findings provide evidence of the factorial validity of the shortened Leadership Scale for Sport.

Demographic and psychological factors associated with lifetime cocaine use: An exploratory factor analysis of baseline questionnaires.

Underlying heterogeneity among individuals with cocaine dependence is widely postulated in the literature, however, identification of a group of factors that explain risk of cocaine use severity has yet to be confirmed. Latent mixture modeling evaluated 338 cocaine-dependent individuals recruited from the community to assess the evidence for the presence of distinct subgroups. Variables included 5 baseline questionnaires measuring cognitive function (Shipley), impulsivity (BIS), mood (BDI), affective lability (ALS), and addiction severity (ASI). Results failed to suggest multiple subgroups. Given a lack of evidence for discrete latent classes, an exploratory factor analysis (EFA) followed by exploratory structural equation modeling (ESEM) was implemented to identify functional dimensions to enhance interpretation of these variables. Findings from the EFA indicated a 3-factor model as the best fit, and the subsequent ESEM solution resulted in associations with lifetime cocaine use. Factor 1, best characterized by demographic factors (gender, age), is associated with less lifetime cocaine use. Psychological problems best characterize factor 2, which is associated with higher lifetime cocaine use. Finally, factor 3 is characterized by other substance use (alcohol and marijuana). Although this factor did not demonstrate a statistically reliable relation with self-reported, lifetime cocaine use, it did indicate a potentially meaningful positive association. These 3 factors delineate dimensions of functioning that likewise help characterize the variability found in previously established associations with self-reported cocaine use.

The Coaching Behavior Scale for Sport: Factor Structure Examination for Singaporean Youth Athletes

The Coaching Behavior Scale for Sport (CBS-S) is designed to evaluate coaches' involvement in developing athletes, taking into considerations the complex training and competition environment. Although the CBS-S has been used in a number of empirical studies, the factor structure of the instrument has not been examined rigorously. The present study was, therefore, conducted to assess the factor structure of the CBS-S for Singaporean youth athletes. A total of 519 participants completed the CBS-S, and their responses were examined with confirmatory factor analysis (CFA) and recent exploratory structural equation modeling (ESEM). Both seven-factor CFA and ESEM models fit to the sample data adequately. In addition, the sizes of factor loadings on target factors were substantial and found comparable between the CFA and ESEM solutions. The findings from this study supported the factorial validity of the CBS-S for the present sample.

Exploratory Structural Equation Modeling of Personality Data

The current article compares the use of exploratory structural equation modeling (ESEM) as an alternative to confirmatory factor analytic (CFA) models in personality research. We compare model fit, factor distinctiveness, and criterion associations of factors derived from ESEM and CFA models. In Sample 1 (n = 336) participants completed the NEO-FFI, the Trait Emotional Intelligence Questionnaire-Short Form, and the Creative Domains Questionnaire. In Sample 2 (n = 425) participants completed the Big Five Inventory and the depression and anxiety scales of the General Health Questionnaire. ESEM models provided better fit than CFA models, but ESEM solutions did not uniformly meet cutoff criteria for model fit. Factor scores derived from ESEM and CFA models correlated highly (.91 to .99), suggesting the additional factor loadings within the ESEM model add little in defining latent factor content. Lastly, criterion associations of each personality factor in CFA and ESEM models were near identical in both inventories. We provide an example of how ESEM and CFA might be used together in improving personality assessment.