Multisample Confirmatory Factor Analysis Research Articles

Factorial Invariance of the ASIS Across Years

ABSTRACT In this study, the factorial invariance of the ASIS (Anadolu-Sak Intelligence Scale) was examined across time. Data were obtained from there groups of first-grade students who were administered the ASIS in 2020, 2021, and 2022. The analyses were conducted using multisample confirmatory factor analyses. Factorial invariance was tested with six models, developed from unconstrained to more constrained models to test the factorial invariance. Each model was used to test one hypothesis. The subtest intercept invariance of the ASIS was found to have a partial invariance. The second-order g model, first and second-order factor loadings, and g variance of the ASIS were invariant across years. The results showed that ASIS scores were invariant and comparable across years.

Factorial Invariance of the Anadolu Sak Intelligence Scale Across Gender

The purpose of this study was to examine the factorial invariance of the ASIS (Anadolu Sak Intelligence Scale) across gender. Raw scores from the ASIS standardization study ( N = 4641) were used in the analyses. Factorial invariance was analyzed by gender across three age groups: 4–7 ( N = 2528), 8–9 ( N = 848), and 10–12 ( N = 1265) using the Multisample Confirmatory Factor Analysis. Six models were developed from unconstrained to more constrained to test the factorial invariance. Each model tested one hypothesis. The findings showed that the second-order g model of the ASIS was invariant in all age groups. In addition, the first-order and second-order factor loadings and g variance were invariant across gender. A partial subtest intercept invariance was found for ages 4–7. Findings imply that ASIS factor scores mean the same latent variable for boys and girls in different age groups.

Self-Concept in China: Validation of the Chinese Version of the Five-Factor Self-Concept (AF5) Questionnaire

The principle of invariance is a mandatory methodological requirement for the psychological measures, even when items such as self-concept measures frequently present asymmetric heavy-tailed distributions. Few validated self-concept instruments can be applied in Eastern–Western cross-cultural studies. The Five-Factor Self-Concept Questionnaire (AF5) is one of the few psychometrically sound instruments used to assess multidimensional self-concept in Spanish-speaking samples. The availability of the AF5 in Spanish and Chinese would facilitate cross-cultural research. To validate the Chinese version of the AF5, we used multisample confirmatory factor analysis with transformed dichotomous scales from the median to compare four alternative theoretical models. The sample consisted of 2507 participants (52.3% women) from China (n = 1298) and Spain (n = 1209), ranging in age from 19 to 35. Analyses confirmed the five-factor structure of the Chinese AF5 (i.e., academic, social, emotional, family, and physical) compared to the Spanish sample. Moreover, the Chinese version of the AF5 was found to be invariant in terms of item-factor weights, factor variance, and between-factor covariance, compared to the original Spanish version. The findings from this first validation study indicate that the Chinese version of the AF5 is an acceptable measure for use with Chinese-speaking adolescents and young adults.

The Brief Situational Confidence Questionnaire for alcohol: A psychometric assessment with incarcerated youth.

The factor structure, measurement invariance, validity, reliability, and stability of scores on the Brief Situational Confidence Questionnaire (BSCQ) were evaluated for use with incarcerated youth. The BSCQ is an 8-item measure that assesses self-efficacy to resist alcohol use in tempting situations. The brevity of the measure may make it a useful tool for clinicians and researchers in a forensic setting. Analyses were conducted with 2 separate samples (N = 205 and N = 189) of incarcerated youth (M age = 16.90 and 17.12 years, respectively; 88% and 86% male). Based on prior theory and confirmatory factor analyses (CFAs), results indicated that a correlated 2-factor model best fit the data. Multisample CFAs suggested that BSCQ scores demonstrated configural and metric invariance across our 2 samples. Further, the BSCQ scores demonstrated sufficient test-retest stability in Samples 1 and 2 (Pearson's r = .66, .55) and internal consistency (Cronbach's α = .84 and .86, respectively). Negative binomial regressions showed that the overall BSCQ scores were significantly associated with concurrent alcohol use (number of drinking days, number of heavy drinking days, average drinks per week) and significantly predicted future alcohol use. Scores on the BSCQ demonstrated sufficient stability, internal consistency, and validity, and the 2-factor structure was largely invariant across 2 separate samples of incarcerated youth. Given its brevity, the BSCQ may provide valid and reliable scores to use with this population when time and resources are scarce. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Multidimensional Scales of Perceived Self-Efficacy (MSPSE): Measurement invariance across Italian and Colombian adolescents

Multidimensional Perceived Self-Efficacy Scale for Children has been developed as an important tool to measure Self-Efficacy in school contexts. The present study assesses the measurement invariance of the MSPSE across two samples of Italian and Colombian adolescents using Multi-sample Confirmatory Factor Analysis. Participants were Italian (N = 564) and Colombian (N = 645) students attending the 7th grade (age 12–13) drawn from a residential community near Rome and three Colombian cities: Medellin, Manizales and Santa Marta. Findings from gender invariance provide high support for full and partial invariance among Colombian and Italian adolescents respectively. Cross-national comparison showed partial scalar invariance between Italy and Colombia, with Italian students perceiving themselves as more efficacious on Academic, Social and Self-Regulatory dimensions. MSPSE’s structural validity has been confirmed, along with its three-factor-structure across gender, for the Italian and Colombian samples. The findings support the invariance and the validity of this scale to measure Self-Efficacy in school contexts from a cross-cultural perspective.

Invarianza cultural del Cuestionario de la Orientación a la Tarea y al Ego (TEOSQ) y diferencias en las orientaciones motivacionales entre adolescentes de España, Argentina, Colombia y Ecuador

El objetivo del presente trabajo fue examinar la medida en que las propiedades psicométricas del cuestionario de la orientación a la tarea y al ego (TEOSQ) resultan estables en muestras de estudiantes de educación física de España, Argentina, Colombia y Ecuador. Participaron 3376 estudiantes de educación física (1726 chicos y 1650 chicas) de colegios públicos y privados de entre 12 y 16 años (M = 14.02; DT = 1.39). Los análisis factoriales multigrupo mostraron que la estructura factorial, las cargas factoriales y los interceptos eran invariantes entre los grupos. Sin embargo, se encontraron diferencias entre las varianzas residuales. Los resultados mostraron una adecuada consistencia interna en las cuatro muestras Los hallazgos de este trabajo respaldan posteriores comparaciones interculturales utilizando el TEOSQ.

Development and validation of Attitudes towards Recovery Questionnaire across Chinese people in recovery, their family carers, and service providers in Hong Kong

Considering the lack of existing measures on attitudes toward personal recovery and the need to acknowledge the cultural milieu in recovery attitude assessment, the present study developed and validated the Attitudes towards Recovery Questionnaire (ARQ) in a sample of people in recovery of mental illness, family carers, and mental health service providers in Hong Kong. The ARQ was developed based on existing literature and measures of recovery, and focus group discussions with various stakeholders. Findings of the multi-sample confirmatory factor analyses supported a five-factor structure: (1) resilience as a person in recovery, (2) self-appreciation and development, (3) self-direction, (4) family involvement, and (5) social ties and integration. The ARQ was positively correlated with recovery outcomes, empowerment, recovery knowledge, and recovery orientation of mental health services. As a tool for examining recovery attitudes, the ARQ informs us of the mindset across stakeholders and areas that need enhancement to facilitate the recovery process.

Quality in bank service encounters

PurposeThe purpose of this paper is to discuss the need to evaluate perception-based quality in service encounters. It sets out to diagnose potential mismatches in how customers and front-line employees perceive quality in high-involvement service settings, based on the premise that any initiative toward quality enhancement in service encounters is advisable only when employees and customers evaluate quality utilizing common perceptual structures.Design/methodology/approachThe study utilizes invariance analysis. The survey involved 165 bank branches and 1,522 respondents (463 front-line employees and 1,059 customers) and operationalized the same set of questions for both groups of participants. Multisample confirmatory factor analysis tested a series of measurement models.FindingsResults revealed equivalence for tangibles, responsiveness and assurance but also mismatches between customers and front-line employees perceptions of reliability and empathy.Practical implicationsFindings add to current knowledge of how both groups of participants evaluate quality in service encounters and are discussed with reference to managerial consequences for perception-based quality mismatches.Originality/valueSo far only a few studies have simultaneously examined front-line employees’ and customers’ perceptions of service quality in service encounters. Unlike previous research designs, this study addresses the critical aspect of potential mismatches in how customers and employees perceive service quality, and presents a methodological procedure to detect them.

Psychometric Evaluation of the Pain Attitudes Questionnaire-Revised for People With Advanced Cancer.

This article presents the psychometric properties of a measure of 2 particular pain-related attitudes. The measure can help clarify whether these attitudes adversely influence pain reporting in older patients with advanced cancer as hypothesized and, in turn, explain the inadequate pain management frequently reported with this clinical group.

Feeling Guilty or Not Guilty. Identifying Burnout Profiles among Italian Teachers

This study aimed at the assessment of psychometric properties of the Italian version of the Spanish Burnout Inventory (SBI-Ita) in a sample of Italian teachers and the analysis of burnout profiles based on a model that includes four dimensions: Enthusiasm toward job, Psychological exhaustion, Indolence, and Guilt. A self-reported questionnaire was filled out by 689 Italian teachers. Data analyses performed Multi-sample Confirmatory Factor Analysis and Hierarchical Cluster Analysis. Results confirmed the hypothesized four-factor structure and the discriminant role of Guilt in differentiating clusters. Results highlights the reliability of the SBI-Ita in the assessment of teachers’ burnout. Furthermore, results evidence for a new typology of burnout that differentiate guilty from non-guilty professionals.

A cross-cultural validation of the controlling teacher behaviours scale in physical education

The present study examined the validity of the factor structure and invariance of the Controlling Teacher Behaviours Scale (CTBS) across two nations. Data were collected from Estonian ( n=453) and Lithuanian ( n=431) students using the multidimensional measure of teachers’ controlling behaviours. Multi-sample confirmatory factor analyses showed that the measure of teachers’ controlling behaviours with four scales (negative conditional regard, controlling use of rewards, excessive personal control and intimidation) were partially invariant at the configural, metric and strong invariance level. The results of the latent mean estimates showed no differences between Estonian and Lithuanian students in respect of the perception of the use of reward, whereas the perception of negative conditional regard, intimidation and excessive personal control appeared to be higher for Estonian students. The results indicated that CTBS is generally suitable for measuring the perceptions of teachers’ controlling behaviour among Estonian and Lithuanian students. Furthermore, results established that one item was perceived differently across samples and, therefore, there is a need for further research to test the invariance of the CTBS among student samples with different cultural backgrounds.

The Measurement Invariance of the Student Opinion Scale across English and Non-English Language Learner Students within the Context of Low- and High-Stakes Assessments.

Student effort on large-scale assessments has important implications on the interpretation and use of scores to guide decisions. Within the United States, English Language Learners (ELLs) generally are outperformed on large-scale assessments by non-ELLs, prompting research to examine factors associated with test performance. There is a gap in the literature regarding the test-taking motivation of ELLs compared to non-ELLs and whether existing measures have similar psychometric properties across groups. The Student Opinion Scale (SOS; Sundre, 2007) was designed to be administered after completion of a large-scale assessment to operationalize students’ test-taking motivation. Based on data obtained on 5,257 (41.8% ELL) 10th grade students, study purpose was to test the measurement invariance of the SOS across ELLs and non-ELLs based on completion of low- and high-stakes assessments. Preliminary item analyses supported the removal of two SOS items (Items 3 and 7) that resulted in improved internal consistency for each of the two SOS subscales: Importance, Effort. A subsequent multi-sample confirmatory factor analysis (MCFA) supported the measurement invariance of the scale’s two-factor model across language groups, indicating it met strict factorial invariance (Meredith, 1993). A follow-up latent means analysis found that ELLs had higher effort on both the low- and high-stakes assessment with a small effect size. Effect size estimates indicated negligible differences on the importance factor. Although the instrument can be expected to function similarly across diverse language groups, which may have direct utility of test users and research into factors associated with large-scale test performance, continued research is recommended. Implications for SOS use in applied and research settings are discussed.

Factorial invariance of the Satisfaction with Life Scale in adolescents from Spain and Portugal.

The Satisfaction with Life Scale is one of the most widely used scales to measure the global cognitive judgment of satisfaction with one’s life. This study assesses the equivalence of the SWLS across Spanish and Portuguese adolescents, using multi-sample Confirmatory Factor Analysis. Participants were Spanish (N = 2183) and Portuguese (N = 4082) junior high school. The results provide high support for the internal consistency of both the Spanish and Portuguese versions of this scale. The results also showed that factor structure, factor loadings, could be considered invariant across groups. However, the full scalar invariance between Spanish and Portuguese samples was not found, with the intercept for SWLS item 5 varying across countries. Similar findings have also been found in other cross-national studies with this scale. Implications of the findings are discussed and we conclude that the Spanish and Portuguese versions of the SWLS can be used for cross-national comparisons with Spanish and Portuguese adolescents.

Satisfaction Scale For Athlete (SSA): A Study Of Validity And Reliability

The purpose of this study is to develop a Satisfaction Scale for Athlete and to test its reliability and validity. Three hundred forty one professional soccer players from Turkish Super League, First and Second League voluntarily participated in this study. SSA consists of 16 items and three subscales, which are satisfaction with coach, satisfaction with team performance and satisfaction with teammates. Exploratory Factor Analysis, Confirmatory Factor Analysis, Multi-Sample Confirmatory Factor Analysis and Factorial Invariance were conducted to construct validity of the Satisfaction Scale for Athlete. MANOVA was performed for known-groups validity analysis of the Satisfaction Scale for Athlete by comparing the scores of soccer players from Turkish Super League with the soccer players from First and Second Leagues. As a result, support for construct validity, reliability and with soccer athletes was established, along with measurement invariance. MANOVA analyses showed predicted discrimination between the leagues. Overall, these results show the reliability and validity of the newly established Satisfaction Scale for Athlete.

Las preferencias participativas del profesorado de educación física en su actividad profesional

Nowadays the collaborative learning environments have been promoted by the physical education teachers as the best way for decreasing teaching problems independently of teachers’ personal achievements. The aim of the present study was to develop a scale for physical education teachers about social interactions preferences in the workplace environment. Based on the scale GR developed by Ruiz et al. (2010), the multi-sample confirmatory factor analysis was used to assess the equivalence measure between years of experience and gender. The participants were 1413 Spanish physical education teachers. The final scale was composed of the 4 initial dimensions: cooperation, competition, individualization, and affiliation. The four dimensions accounted for 66.43% of the total variance, and showed high values of internal consistency. Also, the results pointed out a strict factorial invariance. Finally, the results showed that the more experienced teachers prefer individualized and competitive workplace environments than the less experienced ones, and on the other hand, men’s teachers were more individualistic and competitive compared with women’s teachers whom prefer cooperative orientations in the workplace environment.

A Cross-National Validation of the Short Employment Hope Scale (EHS-14) in the United States and South Korea.

The Short Employment Hope Scale (EHS-14) has been developed in the United States to assess an individual's level of psychological self-sufficiency-a complementary measure to the widely used economic self-sufficiency in workforce development programs. This study examined the comparability of the EHS-14 between U.S. and South Korean low-income job seeker groups. A multisample confirmatory factor analysis (CFA) and a series of invariance tests were conducted to validate EHS-14 using two independent samples. A latent means analysis (LMA) was used to test the latent mean difference between the two samples. The results indicate that CFAs on both U.S. and South Korean samples verified the four-factor structure of EHS-14. The study also found evidence for cross-national equivalence, based on satisfying configural, metric, scalar, and factor covariance invariance. LMA results found no significant difference between the two samples. EHS-14 was found to be a reliable and valid measure with cross-cultural applicability in the South Korean socio-politico-economic context. EHS-14 can be used to benchmark the client empowerment process and monitor individualized human development paths to employment success.

The Posttraumatic Growth Inventory: Factor Structure and Invariance in a Sample of Breast Cancer Patients and in a Non-Clinical Sample.

The Posttraumatic Growth Inventory (PTGI) is frequently used to assess positive changes following a traumatic event. The aim of the study is to examine the factor structure and the latent mean invariance of PTGI. A sample of 205 (M age = 54.3, SD = 10.1) women diagnosed with breast cancer and 456 (M age = 34.9, SD = 12.5) adults who had experienced a range of adverse life events were recruited to complete the PTGI and a socio-demographic questionnaire. We use Confirmatory Factor Analysis (CFA) to test the factor-structure and multi-sample CFA to examine the invariance of the PTGI between the two groups. The goodness of fit for the five-factor model is satisfactory for breast cancer sample (χ2(175) = 396.265; CFI = .884; NIF = .813; RMSEA [90% CI] = .079 [.068, .089]), and good for non-clinical sample (χ2(172) = 574.329; CFI = .931; NIF = .905; RMSEA [90% CI] = .072 [.065, .078]). The results of multi-sample CFA show that the model fit indices of the unconstrained model are equal but the model that uses constrained factor loadings is not invariant across groups. The findings provide support for the original five-factor structure and for the multidimensional nature of posttraumatic growth (PTG). Regarding invariance between both samples, the factor structure of PTGI and other parameters (i.e., factor loadings, variances, and co-variances) are not invariant across the sample of breast cancer patients and the non-clinical sample.

An initial assessment of measurement invariance in sales force coaching

ABSTRACTCoaching is an essential attribute of effective managers and leaders and it is becoming progressively more important for managerial practice and research. Given the increased interdependence between countries due to global commerce and the changing demographic landscape due to migration and mobility through borders, the interest for developing multilingual research increased. However, there are no published studies offering a translation of the original English coaching scales into languages that can be relevant for research in America and Europe. This paper presents a Spanish and French translation of the Perceptions of Supervisor/Line Manager Coaching Behaviour measure (Ellinger, Ellinger & Keller, 2003. Supervisory coaching behavior, employee satisfaction, and warehouse employee performance: A dyadic perspective in the distribution industry. Human Resource Development Quarterly, 14(4), 435–458) thus offering scholars and practitioners the possibility of conducting coaching studies in English, Spanish or French using the same standardised instrument. The paper also presents an initial assessment of measurement invariance using multisample confirmatory factor analysis across two languages (French and Spanish) using two samples: one with French-speaking Canadian respondents and the other one with Spanish-speaking Argentinian respondents. Results suggest that the proposed translations present partial invariance across the samples, with six items out of eight showing invariance and only two showing non-invariance.

Psychometric Properties of the Turkish Version of Sleep Hygiene Index in Clinical and Non-clinical Samples

Objective Sleep hygiene can be described as practices to ease sleep and to avoid factors which decrease sleep quality. Inadequate sleep hygiene generally results in disturbance of daily life activities due to inability to sustain sleep quality and daytime wakefulness. The aim of the study was to assess psychometric properties of the Sleep Hygiene Index in clinical and non-clinical Turkish samples. Methods Data were collected from 106 patients with major depression and 200 were volunteers recruited from community sample who were enrolled at the university. The Sleep Hygiene Index (SHI), Pittsburgh Sleep Quality Index (PSQI), Insomnia Severity Index (ISI) and Epworth Sleepiness Scale (ESS) were administered to the subjects. All depression patients and thirty-two healthy volunteers underwent a twenty-day test-retest procedure. Factor structure of the SHI was evaluated with explanatory and multi-sample confirmatory factor analyses. Pearson product-moment correlation coefficients of the SHI with the PSQI, ISI and ESS were performed. Item analyses, internal consistency coefficients and intra-class correlations between two repeated applications in both patient and healthy subjects were calculated. Results Cronbach's alphas for the SHI in community sample and patients with major depression were 0.70 and 0.71, respectively. Scale scores had comparatively good temporal stability over a three-week time for either clinical or non-clinical samples. SHI had good internal reliability. Conclusion The findings of this present study suggest that the SHI may be a useful research or clinical assessment tool for evaluating sleep hygiene to guide case formulation, treatment planning in depression as well as nonclinical population.

Psychometric properties of the Turkish version of the Sleep Hygiene Index in clinical and non-clinical samples

ObjectiveSleep is one of the most significant of human behaviors, occupying roughly one third of human life. Sleep is a process the brain requires for proper functioning. Sleep hygiene can be described as practices to ease sleep and to avoid factors which decrease sleep quality. Inadequate sleep hygiene generally results in disturbance of daily life activities due to inability to sustain sleep quality and daytime wakefulness. Therefore, the importance of development and utilization of measures of sleep hygiene increases. The aim of the study was to assess psychometric properties of the Sleep Hygiene Index (SHI) in clinical and non-clinical Turkish samples. MethodData were collected from 106 patients with major depression consecutively admitted to the psychiatry clinic of Yüzüncü Yıl University School of Medicine and 200 were volunteers recruited from community sample who were enrolled at the university. The SHI, Pittsburgh Sleep Quality Index (PSQI), Insomnia Severity Index (ISI) and Epworth Sleepiness Scale (ESS) were administered to the subjects. Factor structure of the SHI was evaluated with explanatory and multi-sample confirmatory factor analyses. Pearson product-moment correlation coefficients of the SHI with the PSQI, ISI and ESS were computed. Item analyses, internal consistency coefficients and intra-class correlations between two repeated applications in both patient and healthy subjects were calculated. ResultsThe SHI revealed a unidimensional factor structure. Significant strong partial associations of the SHI with depression, insomnia and poor sleep quality and a modest partial association with sleepiness were detected. Cronbach's alphas for the SHI in community sample and patients with major depression were 0.70 and 0.71, respectively. Additionally, we found acceptable three-week temporal reliability in terms of intra-correlation coefficients of r=0.62, p<0.01 for the community sample and of r=0.67, p<0.01 among patients with major depression. ConclusionThe SHI revealed adequate validity and reliability to be used by researchers in Turkish sample. Current results were discussed in light of previous findings and theoretical considerations.