Second-order Factor Structure Research Articles

An abridged Spanish version of Sexual Double Standard Scale: Factorial structure, reliability and validity evidence

Background/ObjectiveSexual double standard (SDS) has long been associated to several dimensions of sexual health. Therefore the assessment of SDS is relevant and requires self-reported measures with adequate psychometric properties. This study aims to adapt the Sexual Double Standard Scale (SDSS) into heterosexual Spanish population and examine its psychometric properties. Method: Using quota incidental sampling, we recruited a sample of 1,206 individuals (50% women), distributed across three groups based on their age (18-34, 35-49 and 50 years old and older). Results: We performed both, Exploratory Factor Analysis and Confirmatory Factor Analysis. An abridged version was yielded, consisting of 16 items distributed into two factors (Acceptance for sexual freedom and Acceptance for sexual shyness). A second-order factor structure was also adequate, which facilitates the use of a global index for SDS. Reliability, based on internal consistency and temporal stability was good for the factors. Evidence of validity is also shown and reported. Conclusions: This adapted version of the SDSS is reliable and valid. The importance for its use to estimate the prevalence of both traditional and modern forms of this phenomenon is discussed.

Studying Latent Criterion Validity for Complex Structure Measuring Instruments Using Latent Variable Modeling.

Validity coefficients for multicomponent measuring instruments are known to be affected by measurement error that attenuates them, affects associated standard errors, and influences results of statistical tests with respect to population parameter values. To account for measurement error, a latent variable modeling approach is discussed that allows point and interval estimation of the relationship of an underlying latent factor to a criterion variable in a setting that is more general than the commonly considered homogeneous psychometric test case. The method is particularly helpful in validity studies for scales with a second-order factorial structure, by allowing evaluation of the relationship between the second-order factor and a criterion variable. The procedure is similarly useful in studies of discriminant, convergent, concurrent, and predictive validity of measuring instruments with complex latent structure, and is readily applicable when measuring interrelated traits that share a common variance source. The outlined approach is illustrated using data from an authoritarianism study.

The Development of the Problematic Pornography Consumption Scale (PPCS)

To date, no short scale exists with strong psychometric properties that can assess problematic pornography consumption based on an overarching theoretical background. The goal of the present study was to develop a brief scale, the Problematic Pornography Consumption Scale (PPCS), based on Griffiths’s (2005) six-component addiction model that can distinguish between nonproblematic and problematic pornography use. The PPCS was developed using an online sample of 772 respondents (390 females, 382 males; Mage = 22.56, SD = 4.98 years). Creation of items was based on previous problematic pornography use instruments and on the definitions of factors in Griffiths’s model. A confirmatory factor analysis (CFA) was carried out—because the scale is based on a well-established theoretical model—leading to an 18-item second-order factor structure. The reliability of the PPCS was excellent, and measurement invariance was established. In the current sample, 3.6% of the users belonged to the at-risk group. Based on sensitivity and specificity analyses, we identified an optimal cutoff to distinguish between problematic and nonproblematic pornography users. The PPCS is a multidimensional scale of problematic pornography use with a strong theoretical basis that also has strong psychometric properties in terms of factor structure and reliability.

The Greek elementary “What Is Happening In this Class?” (G-EWIHIC): A three-phase multi-sample mixed-methods study

Students’ perceptions of their classroom psycho-social climate (CPSC) have been found to relate significantly to students’ learning outcomes. The What Is Happening In this Class? (WIHIC) being one of most prominent instruments in measuring these perceptions. The purpose of the present study was to thoroughly examine the structure of preadolescents’ perceptions of the CPSC, through an elaborate mixed-methods three-phase design, in the Greek elementary school context. The study included semi-structured interviews with students and teachers, and two large-scale administrations of the qualitatively adapted WIHIC version. Both qualitative and quantitative results supported the seven-subscale structure of the instrument and identified potential issues with the conceptual content of two of the subscales. Quantitative findings also supported the theoretical second-order factorial structure of the instrument, but with different subscale allocation. The advantages of mixed-methodology in the cross-cultural examination of student’s perceptions of the learning environment and implications for research are discussed.

Adaptation of the short version of the Psychological Capital Questionnaire (PCQ-12) into Spanish / Adaptación al español de la versión reducida del Cuestionario de Capital Psicológico (PCQ-12)

Psychological capital (PsyCap) has been a topic of increasing interest in the last decade. However, there is a lack of validated instruments in Spanish to map PsyCap and its consequences for individuals’ well-being. Consequently, the goal of this study is to adapt the 12-item short version of the Psychological Capital Questionnaire (PCQ-12) to the Spanish context by analysing its internal consistency and reliability, factor solution and external validity. Results indicated that the PCQ-12 exhibited good Cronbach’s alpha (.87) and omega coefficient (.93) values in a sample from a vehicle inspection company (n = 798). As expected, results also revealed that a second-order factor structure provided the best fit. Moreover, PsyCap is associated with increased job engagement (β = .579; R2adjusted = .333), decreased job burnout (β = −.409; R2adjusted = .166), and lower psychological distress (β = −.349; R2adjusted = .121) (all p < .01), which provided additional support for using the PCQ-12 in the Spanish context. Implications for theory and practice are discussed.

Estudo psicométrico preliminar do Inventário Dimensional dos Transtornos da Personalidade (IDTP)

O presente estudo teve como objetivo desenvolver um instrumento para avaliação dos transtornos dapersonalidade e buscar por evidências de validade baseadas na estrutura interna desse instrumento. Oinstrumento desenvolvido, o Inventário Dimensional de Transtornos da Personalidade (IDTP), foiaplicado em 350 participantes, entre 1 8 e 67 anos, de ambos os sexos. Foram realizadas análisesexploratórias por componentes principais de primeira e de segunda ordem, correlações entre as escalas doinstrumento, e calculados os coeficientes alfa de Cronbach. De acordo com a literatura utilizada eespecificamente as categorias diagnósticas para transtornos da personalidade, a maior parte dos fatoreshipotetizados para o teste foi encontrada, e os coeficientes alfa variaram entre 0,65 e 0,89. Além disso, aestrutura fatorial de segunda ordem, composta por três fatores, foi coerente de acordo com a literaturaprévia.

Multilevel structural equation modeling analysis of the servant leadership construct and its relation to job satisfaction

Purpose The purpose of this paper is to address the statistical issues associated with the hierarchically structured data in previous studies that focused on servant leadership. To resolve these issues, multilevel modeling methods were applied to re-visit the construct validity of the servant leadership questionnaire developed by Barbuto and Wheeler (2006) and investigate the relationship between servant leadership and job satisfaction under a multilevel framework. Design/methodology/approach The survey data was obtained from a sample of 2,089 teachers from 117 primary and secondary schools in Hong Kong. The analyses were conducted using multilevel confirmatory factor analysis (MLCFA) and multilevel structural equation modeling (MLSEM). Findings The results revealed the significant and non-trivial variances that were explained at the organization level in the items measuring servant leadership, which justified the use of MLCFA and MLSEM. The results of MLCFA provided empirical support for the multidimensional construct as well as the second-order factorial structure of servant leadership measures at both the individual and organization levels. In addition, the positive relationships between servant leadership and the followers’ job satisfaction were found to vary at different levels. Originality/value This study reiterates the importance of using appropriate methods to capture a solid definition of the construct of servant leadership and provides new insights into the conceptual framework of servant leadership as well as the effects of servant leadership on individual and organizational outcomes.

Preventing Rater Biases in 360-Degree Feedback by Forcing Choice

We examined the effects of response biases on 360-degree feedback using a large sample ( N = 4,675) of organizational appraisal data. Sixteen competencies were assessed by peers, bosses, and subordinates of 922 managers as well as self-assessed using the Inventory of Management Competencies (IMC) administered in two formats—Likert scale and multidimensional forced choice. Likert ratings were subject to strong response biases, making even theoretically unrelated competencies correlate highly. Modeling a latent common method factor, which represented nonuniform distortions similar to those of “ideal-employee” factor in both self- and other assessments, improved validity of competency scores as evidenced by meaningful second-order factor structures, better interrater agreement, and better convergent correlations with an external personality measure. Forced-choice rankings modeled with Thurstonian item response theory (IRT) yielded as good construct and convergent validities as the bias-controlled Likert ratings and slightly better rater agreement. We suggest that the mechanism for these enhancements is finer differentiation between behaviors in comparative judgements and advocate the operational use of the multidimensional forced-choice response format as an effective bias prevention method.

Travelers' switching behavior in the airline industry from the perspective of the push-pull-mooring framework

We tested the applicability of the push-pull-mooring (PPM) migration theory to travelers' airline selection in order to clarify their switching behavior. Based on the extensive review of the literature and open-ended survey, we identified the constituents of four push, three pull, and four mooring factors. A field survey was conducted at an international airport in South Korea, and a total of 529 complete responses were used for data analysis. Our results showed that the PPM model comprising the second-order factor structure provided an acceptable representation of the observed variables in a comparison with the first-order construct model. Results of the structural analysis also indicated that all PPM categories directly affected switching intention. In addition, mooring dimension had a significant moderating effect on the relationship between pull category and switching intention. However, no moderating effect of mooring factor on the relationship between push factor and switching intention was found.

Cross-Validation of the Implementation Leadership Scale (ILS) in Child Welfare Service Organizations.

The Implementation Leadership Scale (ILS) is a brief, pragmatic, and efficient measure that can be used for research or organizational development to assess leader behaviors and actions that actively support effective implementation of evidence-based practices (EBPs). The ILS was originally validated with mental health clinicians. This study validates the ILS factor structure with providers in community-based organizations (CBOs) providing child welfare services. Participants were 214 service providers working in 12 CBOs that provide child welfare services. All participants completed the ILS, reporting on their immediate supervisor. Confirmatory factor analyses were conducted to examine the factor structure of the ILS. Internal consistency reliability and measurement invariance were also examined. Confirmatory factor analyses showed acceptable fit to the hypothesized first- and second-order factor structure. Internal consistency reliability was strong and there was partial measurement invariance for the first-order factor structure when comparing child welfare and mental health samples. The results support the use of the ILS to assess leadership for implementation of EBPs in child welfare organizations.

The Barratt Impulsiveness Scale-11 Among a School Sample of Portuguese Male and Female Adolescents

Few personality traits are as socially relevant as impulsivity, but few self-report measures have been specifically developed for adolescents and children. The aim of the present study was to examine the psychometric properties of the Barratt Impulsiveness Scale version 11 (BIS-11) among a mixed-gender sample of 782 Portuguese youth (M = 15.87 years; SD = 1.72), in a school context. Confirmatory factor analysis revealed the expected 6-factor first-order structure, but the 3-factor second-order factorial structure did not present a good fit. Cross-gender measurement invariance was demonstrated only in terms of weak invariance. Nonetheless, the Portuguese adaptation of the BIS-11 demonstrated some generally acceptable psychometric properties of internal consistency, mean inter-item correlation, convergent validity, discriminant validity, and criterion-related validity of statistically significant associations with conduct disorder symptoms, alcohol abuse, drug use, and unprotected sex. The use of the BIS-11 among the male and female youth population is psychometrically justified, and it can be a useful measure to identify impulsive adolescents who are at considerable risk of personal injury and present a potential source of injury to others.

On the measurement of low self-control in Add Health and NLSY79

ABSTRACTLimited attention has been devoted to the dimensionality of the low self-control scales commonly constructed in two nationally representative datasets routinely used to test self-control theory (SCT) – Add Health and NLSY79. We assess the measurement properties of the low self-control scales by comparing a series of exploratory and confirmatory models that are appropriate for the categorical nature of the observed items, including unidimensional, correlated factors, second-order factor, and bifactor models. Additionally, based on these results we explore the predictive validity of the respective scales on adolescents’ delinquent behavior. The results indicate that the low self-control scales in these data have acceptable levels of internal consistency but do not represent unidimensional latent factors. Rather, scales are best represented by a second-order factor structure. When measured this way, our Add Health scale is associated with delinquency in a cross-sectional context and our NLSY79 scale predicts delinquency longitudinally. This study reveals that low self-control is best conceptualized as a multidimensional construct within these data. The results of this study provide guidance to researchers measuring low self-control in either dataset (or other data sources) and inform the larger SCT measurement literature.

The Historical Loss Scale: Longitudinal measurement equivalence and prospective links to anxiety among North American indigenous adolescents.

Thoughts of historical loss (i.e., the loss of culture, land, and people as a result of colonization) are conceptualized as a contributor to the contemporary distress experienced by North American Indigenous populations. Although discussions of historical loss and related constructs (e.g., historical trauma) are widespread within the Indigenous literature, empirical efforts to understand the consequence of historical loss are limited, partially because of the lack of valid assessments. In this study we evaluated the longitudinal measurement properties of the Historical Loss Scale (HLS)-a standardized measure that was developed to systematically examine the frequency with which Indigenous individuals think about historical loss-among a sample of North American Indigenous adolescents. We also test the hypothesis that thoughts of historical loss can be psychologically distressing. Via face-to-face interviews, 636 Indigenous adolescents from a single cultural group completed the HLS and a measure of anxiety at 4 time-points, which were separated by 1- to 2-year intervals (Mage = 12.09 years, SD = .86, 50.0% girls at baseline). Responses to the HLS were explained well by 3-factor (i.e., cultural loss, loss of people, and cultural mistreatment) and second-order factor structures. Both of these factor structures held full longitudinal metric (i.e., factor loadings) and scalar (i.e., intercepts) equivalence. In addition, using the second-order factor structure, more frequent thoughts of historical loss were associated with increased anxiety. The identified 3-factor and second-order HLS structures held full longitudinal measurement equivalence. Moreover, as predicted, our results suggest that historical loss can be psychologically distressing for Indigenous adolescents.

Development of the Connectedness to Treatment Setting Scale for Children with Cancer and Their Parents

Treatment for pediatric cancer requires periodic and long hospital admissions. The intensity and frequency of the interactions taking place in the treatment setting indicate that this is a context to which children and their families can feel connected. This study’s main goal was to develop the Connectedness to Treatment Setting Scale (CTSS-Pediatric Cancer), a 10-item scale assessing children’s and parents’ connectedness to the health setting where children receive cancer treatment. Participants were 128 dyads of children receiving treatment at two Portuguese public hospitals and their parents. Two exploratory factor analyses with children’s and parents’ data separately and a dyadic confirmatory factor analysis with the whole sample supported a second-order factorial structure of the CTSS-Pediatric Cancer, where three dimensions (Sense of Belonging, Comfort and Emotional Care) loaded onto a total score of connectedness. Findings suggest that the CTSS-Pediatric Cancer is a valid and useful assessment measure.

Singapore primary and secondary students' motivated approaches for learning: A validation study

This study aimed to develop and validate a 28-item questionnaire to measure Singapore primary and secondary students' (N=1035) motivation in relation to their self-directed learning (SDL) and collaborative learning (CL), with and without Information and Communication Technology (ICT), with an emphasis on investigating the high-order factor structure, if any. The instrument consists of seven dimensions: task value, self-efficacy, extrinsic goal, SDL, SDL with ICT, CL, and CL with ICT. By using confirmatory factor analysis with maximum likelihood method, the instrument was found to express satisfactory reliability and validity, and it can be best represented by a two-correlated-second-order-factor model. Besides, measurement invariance of the second-order model was also tested, and results showed that the second-order factor structure was generally invariant across gender (boys vs. girls) and grade levels (primary vs. secondary).

Examining First- and Second-Order Factor Structures for News Credibility

The construct of news credibility has been of interest to communication scholars for decades, yet researchers have struggled to develop a measure of news credibility that demonstrates a reliable factor structure and construct validity. This study uses confirmatory factor analysis (CFA) and discriminant analysis to evaluate Abdulla and colleagues’ (2004) measure of news credibility. Results indicate that although the factor structure of the measure is replicable, the measure exhibits significant concerns related to discriminant validity. A revised measurement model employing a second-order factor for the news credibility scale that eliminates the discriminant validity concerns is proposed, and the implications of second-order factors in measurement models are discussed.

Validity, Reliability, and Invariance of the Greek Version the Physical Activity Perceived Barriers Scale

he study aimed to examine the validity, reliability, and factorial invariance across gender of the PAPBS (Physical Activity Perceived Barriers Scale) in Greek children. 613 students (322 boys and 291 girls) from a city of Greece completed the above scale in 3 periods during a school year. Confirmatory factor analysis was applied. Strong evidence was found for the hypothesized second-order factor structure of the physical activity perceived barriers scale in the 3 measurements (comparative fit index = 0.951, 0.933, 0.922, and root mean square error of approximation = 0.061, 0.069, 0.074). The scale’s internal consistency was supported satisfactorily, whereas correlations coefficients between scale and several physical activity scores were significant moderate to high. Finally, results provided support of the invariance of the first- and second-order factor loadings and invariance structural residuals, but weak support of the invariance of the residual variance of observed variables of the examined scale across gender. The findings suggest that physical activity perceived barriers scale is appropriate for use with Greek children and it is considered as a useful tool for researches interested in studying the children’s participation in physical activity.

Perceived constraints of campus recreational sports programs: Development and validation of an instrument

The aim of the present study was to develop and validate an instrument to measure students’ perceived constraints in participating in recreational sports programs in Greek universities. There were 3041 male and female Greek university students who voluntarily participated in the study. Cross-validation procedures using exploratory and confirmatory factor analysis resulted in 25 retained items from the initial item pool, which form the University Sport Constraints Questionnaire (USCQ). Findings also showed a second-order factor structure of students’ perceived constraints. In particular, the USCQ items seem to assess nine first-order constraints, which are manifestations of three second-order factors. The USCQ seems to be a valid and reliable instrument for measuring students’ reasons for not participating in recreational sports programs. Key words: Constraints, leisure activities, instrument development, university sport, participation.

Determinants of mobile value-added service continuance: The mediating role of service experience

In previous research, MVAS subscribers have been regarded as technology users. By adopting the service-dominant logic perspective from the service management discipline, this study proposes and empirically tests a model integrating both technology user and service consumer perspectives, emphasizing the role of service experience in MVAS continuance. The findings show that both technology excellence and service experience are principal determinants of MVAS continuance intention. Moreover, this study proposes the second-order factor structure of service experience and demonstrates the mediating role of service experience on the relationship between technology excellence and MVAS subscribers’ continuance intentions. The theoretical and practical implications are discussed.

Cross-national and longitudinal investigation of a short measure of workaholism.

: The present study investigated the factor structure of the 10-item version of the Dutch Work Addiction Scale (DUWAS). The DUWAS-10 is intended to measure workaholism with two correlated factors: working excessively (WE) and working compulsively (WC). The factor structure of the DUWAS-10 was examined among multi-occupational samples from the Netherlands (n=9,010) and Finland (n=4,567) using confirmatory factor analysis (CFA). CFAs revealed that the expected correlated two-factor solution showed satisfactory fit to the data. However, a second-order factor solution, where WE comprised the first-order factors “working frantically” and “working long hours”, and WC the first-order factors “obsessive work drive” and “unease if not working”, showed significantly better fit to the data. The expectation of factorial group invariance of the second-order factor structure between the Dutch and Finnish samples was also supported. Moreover, factorial time invariance was observed across a two-year time lag in a sub-sample of Finnish managers (n=459). In conclusion, the DUWAS-10 was found to be a comprehensive measure of workaholism, meeting the criteria of factorial validity in multiple settings, and can thus be recommended for use in both research and practice.