Competing Measurement Models Research Articles

Assessing structural models of neighborhood and family sociodemographic characteristics and their relations with externalizing psychopathology.

Externalizing psychopathology has been found to have small to moderate associations with neighborhood and family sociodemographic characteristics. However, prior studies may have used suboptimal operationalizations of neighborhood sociodemographic characteristics and externalizing psychopathology, potentially misestimating relations between these constructs. To address these limitations, in the current study we test different measurement models of these constructs and assess the structural relations between them. Using a population-representative sample of 2,195 twins and siblings from the Georgia Twin Study and data from the National Neighborhood Data Archive and 2000 U.S. Census, we assessed the fit of competing measurement models for family sociodemographic, neighborhood sociodemographic, and neighborhood environment characteristics. In structural models, we regressed a general externalizing dimension on different operationalizations of these variables separately and then simultaneously in a final model. Latent variable operationalizations of family sociodemographic, neighborhood sociodemographic, and neighborhood environment characteristics explained no more variance in broad externalizing psychopathology than other operationalizations. In an omnibus model, family sociodemographic characteristics showed a small association with externalizing psychopathology, while neighborhood sociodemographic and environmental characteristics did not. Family sociodemographic characteristics showed small associations with neighborhood sociodemographic and environmental characteristics, and neighborhood sociodemographic characteristics were moderately associated with neighborhood environment. These findings suggest that family sociodemographic characteristics are more associated with the development of broad externalizing psychopathology in youth than neighborhood sociodemographic characteristics and neighborhood environment. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Short-Scale Construction Using Meta-Analytic Ant Colony Optimization

Abstract: The Need for Cognition Scale (NCS) is a self-report scale measuring individual differences in the tendency to engage in and enjoy thinking. The shortened version with 18 items (NCS-18; Cacioppo et al., 1984 ) has widely been administered in research on persuasion, critical thinking, and educational achievement. Whereas most studies advocated for essential uni-dimensionality, the question remains which psychometric model yields the best representation of the NCS-18. In the present study, we compared six competing measurement models for the NCS-18 with meta-analytic structural equation models using summary data of 87 samples ( N = 90,215). Results demonstrated that the negatively worded items introduced considerable measurement bias that was best accounted for with an acquiescence model. In a further analytical step, we showcased how the pooled correlation matrix can be used to compile short versions of the NCS-18 via Ant Colony Optimization. We examined model fit and reliability of short scales with varying item numbers (between 4 and 15) and a balanced ratio of positively and negatively worded items. We discuss the potentials and limits of the newly proposed method.

"Show Me What You Got": The Nomological Network of the Ability to Pose Facial Emotion Expressions.

Just as receptive emotional abilities, productive emotional abilities are essential for social communication. Although individual differences in receptive emotional abilities, such as perceiving and recognizing emotions, are well-investigated, individual differences in productive emotional abilities, such as the ability to express emotions in the face, are largely neglected. Consequently, little is known about how emotion expression abilities fit in a nomological network of related abilities and typical behavior. We developed a multitask battery for measuring the ability to pose emotional expressions scored with facial expression recognition software. With three multivariate studies (n1 = 237; n2 = 141; n3 = 123), we test competing measurement models of emotion posing and relate this construct with other socio-emotional traits and cognitive abilities. We replicate the measurement model that includes a general factor of emotion posing, a nested task-specific factor, and emotion-specific factors. The emotion-posing ability factor is moderately to strongly related to receptive socio-emotional abilities, weakly related to general cognitive abilities, and weakly related to extraversion. This is strong evidence that emotion posing is a cognitive interpersonal ability. This new understanding of abilities in emotion communication opens a gateway for studying individual differences in social interaction.

Revisiting the factor structure of the Short-Form McGill Pain Questionnaire-2 (SF-MPQ-2): Evidence for a bifactor model in individuals with Chiari malformation.

The Short-Form McGill Pain Questionnaire-2 (SF-MPQ-2; Dworkin et al., 2009) is intended to measure the multidimensional qualities of pain (i.e., continuous, intermittent, neuropathic, and affective) as well as total pain. Using structural equation modeling, we evaluated the fit of four competing measurement models of the SF-MPQ-2-an oblique 4-factor model, a 1-factor model, a higher-order model, and a bifactor model-in 552 adults diagnosed with Chiari malformation, a chronic health condition whose primary symptoms include head and neck pain. Results revealed the strongest support for the bifactor model, suggesting that SF-MPQ-2 item responses are due to both a general pain factor and a specific pain factor that is orthogonal to the general pain factor. Additional bifactor analyses of the SF-MPQ-2's model-based reliability and dimensionality revealed that most of the SF-MPQ-2's reliable variance is explained by a general pain factor, and that the instrument can be modeled unidimensionally and scored as a general pain measure. Results also indicated that the general and affective pain factors in the bifactor model uniquely predicted pain-related external criteria (e.g., depression, anxiety, and stress); however, the continuous, intermittent, and neuropathic factors did not.

Organizational citizenship behavior in civil society workplaces

AbstractOrganizational citizenship behavior is argued to be particularly important to civil society organizations (Akhtar, Hakeem, & Naeem, 2017). However, organizational citizenship behavior needs further theoretically driven research in the civil society sector, which is the overarching aim of this study which compared two competing models of organizational citizenship behavior within the New Zealand's civil society sector: Organ (1988) and Williams and Anderson (1991) models. Participants were N = 442 employees from 217 civil society organizations in New Zealand. Confirmatory factor analysis tested these two competing measurement models of organizational citizenship behavior. Results suggested employees of civil society organizations tended to perform citizenship behavior in accordance with Organ (1988) structured five‐factor model, independent of their organization. Results are discussed, with a focus on why employees working in New Zealand's civil society sector seem to be more likely to perform Organ (1988) model of organizational citizenship behavior, and practical implications presented.

The Reflective Functioning Questionnaire-Revised- 7 (RFQ-R-7): A new measurement model assessing hypomentalization.

Although it is a widely used questionnaire, limitations regarding the scoring procedure and the structural validity of the eight-item Reflective Functioning Questionnaire (RFQ-8) were raised. The present study aimed to examine further the latent dimensionality of the RFQ-8 and to examine linear and non-linear associations between mentalization difficulties and maladaptive psychological characteristics. Data from two separate representative samples of young adults (N = 3890; females: 51.68%; mean age: 27.06 years [SD = 4.76]) and adults (N = 1385; females: 53.20%; mean age: 41.77 years [SD = 13.08]) were used. In addition to the RFQ-8, standardized questionnaires measured the levels of impulsivity, sensation seeking, rumination, worry and well-being. Confirmatory factor analysis (CFA) was used to test the model fit of competing measurement models. CFA revealed that a revised, seven-item version of the RFQ (RFQ-R-7) with a unidimensional structure showed the most optimal levels of model fit in both samples. Impulsivity, sensation seeking, rumination and worry consistently presented significant, positive, linear associations with general mentalization difficulties in both samples. Significant quadratic associations were also identified, but these relationships closely followed the linear associations between the variables and increased only marginally the explained variance. The supported unidimensional measurement model and the associations between the general mentalization difficulties factor and maladaptive psychological characteristics indicated that the RFQ-R-7 captures a dimension of hypomentalization ranging between low and high levels of uncertainty. Increasing levels of hypomentalization can indicate a risk for less adaptive psychological functioning. Further revisions of the RFQ-8 might be warranted in the future to ensure adequate measurement for hypermentalization.

Examining the structure of credibility evaluation when sixth graders read online texts

AbstractBackgroundPrevious research indicates that students lack sufficient online credibility evaluation skills. However, the results are fragmented and difficult to compare as they are based on different types of measures and indicators. Consequently, there is no clear understanding of the structure of credibility evaluation.ObjectivesThe present study sought to establish the structure of credibility evaluation of online texts among 265 sixth graders.MethodsStudents' credibility evaluation skills were measured with a task in which they read four online texts, two more credible (a popular science text and a newspaper article) and two less credible (a layperson's blog text and a commercial text). Students read one text at a time and evaluated the author's expertise, the author's benevolence and the quality of the evidence before ranking the texts according to credibility. Four competing measurement models of students' credibility evaluations were assessed.ResultsThe model termed the Genre‐based Confirming‐Questioning Model reflected the structure of credibility evaluation best. The results suggest that credibility evaluation reflects the source texts and requires two latent skills: confirming the more credible texts and questioning the less credible texts. These latent skills of credibility evaluation were positively associated with students' abilities to rank the texts according to credibility.ImplicationsThe study revealed that the structure of credibility evaluation might be more complex than previously conceptualized. Consequently, students would benefit from activities that ask them to carefully analyse different credibility aspects of more and less credible texts, as well as the connections between these aspects.

Examining the Factor Structure and Measurement Invariance of the Difficulties in Emotion Regulation Scale Across Taiwanese and American University Students

The Difficulties in Emotion Regulation Scale (DERS) is a widely used measure of emotion dysregulation. However, limited research has examined its factor structure and measurement invariance in cross-national samples. The present study tested competing measurement models and the measurement invariance of the DERS in university student samples from the United States ( n = 324) and Taiwan ( n = 399). Results indicated that the bifactor model with the Awareness subscale items removed demonstrated the best fit. The results of model-based indices provided evidence for the general emotion dysregulation factor of the DERS. Cross-national measurement invariance testing found partial strong invariance. These findings indicate that DERS would best be used as a measure of general emotion dysregulation among college students in the United States and Taiwan. These findings emphasize that future work is needed to examine cross-national differences in the construct and assessment of emotion dysregulation.

Psychopathy checklist: Screening version: A bifactor structure for forensic and community samples.

We evaluated competing measurement models for the Psychopathy Checklist: Screening Version (PCL:SV), one of the most widely used assessment instruments of psychopathy, which applies to clinical, forensic, and community samples. With four all-male community and forensic samples collected in Germany and the United States (nTotal = 853), we evaluated several measurement models of the PCL:SV, including correlated factor models, higher-order models, and bifactor models, on numerous psychometric criteria including model fit, factor saturation, and predictive utility. Across the samples, we found that a bifactor model had better fit to the data and explained comparable or more variance in measures of fluid intelligence, crystallized intelligence, and characteristics of antisocial personality disorder relative to the four correlated factors model. The best bifactor structure model differed between forensic and community samples. With both populations, in addition to a g factor which loaded on all items, a nested factor representing the lifestyle and antisocial facets was also modeled. With the forensic sample, an additional orthogonal nested factor representing the interpersonal facet was needed. We conclude that there is strong communality across the 12 PCL:SV items, which is best captured by a bifactor structure. However, the specific nesting structure differs due to whether or not the sample includes a forensic or community population. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Relational Uncertainty Within Relational Turbulence Theory: The Bifactor Exploratory Structural Equation Model

Abstract Relational uncertainty consists of self, partner, and relationship uncertainty, which are core parameters in relational turbulence theory (RTT). Advances in latent variable modeling allow researchers to examine the multidimensional construct as a bifactor model, including a general factor of relational uncertainty and residualized factors of self, partner, and relationship uncertainty. This advance is theoretically consequential because RTT maintains the importance of distinctions among the facets of relational uncertainty, even while empirical evidence demonstrates considerable overlap among them. In two data sets (college sample, N = 513; married sample, N = 354), competing measurement models specified Relational Uncertainty Scale items as a unidimensional confirmatory factor model, 3-factor independent clusters confirmatory factor model, 3-factor exploratory structural equation model (ESEM), bifactor confirmatory factor model, and bifactor-ESEM. The bifactor-ESEM provided the best fit in both samples, and bifactor statistics clarified how variance from the scale is partitioned to yield essential unidimensionality for the general factor of relational uncertainty, controlling for its residualized factors. Tests of a latent predictive model using a bifactor specification of relational uncertainty were consistent with RTT. Implications for testing communication theory using bifactor-ESEM are discussed in light of these findings.

On the Trail of Creativity: Dimensionality of Divergent Thinking and its Relation with Cognitive Abilities, Personality, and Insight

Divergent thinking (DT) is an important constituent of creativity that captures aspects of fluency and originality. The literature lacks multivariate studies that report relationships between DT and its aspects with relevant covariates, such as cognitive abilities, personality traits (e.g. openness), and insight. In two multivariate studies ( N = 152 and N = 298), we evaluate competing measurement models for a variety of DT tests and examine the relationship between DT and established cognitive abilities, personality traits, and insight. A nested factor model with a general DT and a nested originality factor described the data well. In Study 1, DT was moderately related with working memory, fluid intelligence, crystallized intelligence, and mental speed. In Study 2, we replicate these results and add insight, openness, extraversion, and honesty–humility as covariates. DT was associated with insight, extraversion, and honesty–humility, whereas crystallized intelligence mediated the relationship between openness and DT. In contrast, the nested originality factor (i.e. the specificity of originality tasks beyond other DT tasks) had low variance and was not meaningfully related with any other constructs in the nomological net. We highlight avenues for future research by discussing issues of measurement and scoring.

Assessing psychological stress in South African university students: Measurement validity of the perceived stress scale (PSS-10) in diverse populations

Valid psychological measures of stress are essential for the detection, management and prevention of stress and related mental illnesses. In this study the factorial structure, measurement invariance (gender and race), and reliability of the Perceived Stress Scale (PSS-10) were evaluated in a sample of university students (N = 862). Five competing measurement models of the PSS-10 (i.e., one-factor; correlated two-factor; bifactor with two domain specific factors; a bifactor, with the perceived self-efficacy factor; and a bifactor model, with the distress factor) were examined using confirmatory factor analysis and cross-validated using Rasch analysis. The two-factor model prevailed over the alternative latent structures, was invariant across gender and race groups, and had acceptable internal consistency reliability. This study supports the validity of the PSS-10 for use with diverse student populations.

Is there a higher-order factor of alcohol-related protective behavioral strategies? Further analysis of the Protective Behavioral Strategies Scale’s (PBSS) factor structure

Background Although it is a widely used instrument, there is still no consensus related to the factor structure of the Protective Behavioral Strategies Scale (PBSS), particularly the function of a higher-order protective behavioral strategies (PBS) factor is needed to be explored. The present research aimed to test and validate competing measurement models of the PBSS, with a special focus on exploring the role of a higher-order PBS factor. Method Two independent samples of university students (between 18-29 years of age) who reported alcohol use in the past 12 months were used. Overall, 327 and 488 participants were included in the present study (females: 68% and 71%). The questionnaire assessed excessive alcohol consumption and PBS use. Results Based on a series of confirmatory factor analyses, the second-order factor model with a higher order factor and four first-order factors presented the most parsimonious solution and closest fit to the data in both samples. Validation analyses indicated that the higher-order factor of PBS use and the first order factor of manner of drinking (MOD) and stopping/limiting drinking-mixing (SLD-M) were consistently associated with lower level of excessive alcohol use. Conclusions Present findings supported the role of a higher-order factor of PBS use which might represent a general measure of PBS. First-order PBS factors showed divergent harm-reduction capacity: MOD and SLD-M rather than Planned limits strategies (SLD-P) were associated with more beneficial alcohol use-related outcomes.

Well-being profiles in adolescence: psychometric properties and latent profile analysis of the mental health continuum model \u2013 a methodological study

BackgroundThe Adolescent Mental Health Continuum Short Form (MHC-SF) is a psychometrically valid tool to evaluate the domains of subjective well-being, but there is a lack of investigations which could distinguish subgroups with distinct subjective well-being profiles based on this measurement. Therefore, after testing the competing measurement models of the MHC-SF, our main aim was to identify subjective well-being profiles in a large adolescent sample.MethodsOn a representative Hungarian adolescent sample (N = 1572; 51% girl; mean age was 15.39, SD = 2.26) confirmatory factor analyses (CFA) and exploratory structural equation modeling (ESEM) were used to test the factor stucture of the Adolescent MHC-SF. In addition, gender invariance of the best fitting model was also tested. Latent Profile Analyses (LPA) were conducted to reveal distinct subgroups and these profiles were then compared.ResultsResults support the bifactor model of MHC-SF: the general and specific well-being factors which were invariant across gender. LPA yielded four subgroups, three of them have been theoretically hypothesized in previous works (i.e. flourishing, moderate mental health, languishing), but an emotionally vulnerable subgroup also emerged. Compared to the languishing group, this new subgroup demonstrated higher scores on prosocial behaviour, but had comparable level of loneliness and internalizing symptoms.ConclusionsOur results suggest that the MHC-SF is a reliable and valid instrument for assessing overall well-being and its components. In addition, the identification of young people to be at risk for low mental health may help us to tailor mental health promotion programs to their special needs.

Structure and correlates of interpersonal problems and sensitivities.

Interpersonal dysfunction is an important marker of individual differences in personality and well-being. Existing research on interpersonal dysfunction focuses primarily on the problematic behaviors of individuals without considering how sensitivity to others' behavior impacts functioning. In this study, we test the structure and correlates of a model of relationship dysfunction that integrates the problems individuals bring to relationships with their sensitivities to others' behavior. We specifically examine the conjoint structure of interpersonal problems and sensitivities using a circumplex framework and associations between dimensions derived from this structure and personality, well-being, attachment, and response style variables. We evaluated competing measurement models and examined validity correlations of interpersonal problems and sensitivities in two samples (Study 1: N=955; 79.2% women; Mage = 19.43; Study 2: N=1,005; 72.1% women; Mage = 19.77). Six factors capturing general (nonspecific problems and sensitivities) and stylistic (warmth and dominance for both problems and sensitivities) variation in interpersonal dysfunction were empirically distinguishable and provided incremental information about external criteria. Results support problems and sensitivities as overlapping but distinct sources of information about interpersonal dysfunction, and they specifically suggest an integrative six-factor model with considerable potential for future research.

Testing the factor structure and measurement invariance of the PHQ-9 across racially diverse U.S. college students.

Today's college students are at increased risk for depression. Therefore, accurate and sustainable assessment of depressive symptoms among college students has become an important issue. One promising instrument for depression screening in college settings is the Patient Health Questionnaire-9 (PHQ-9), a 9-item self-report measure developed in primary care and designed to assess the presence of Diagnostic and Statistical Manual of Mental Disorders (4th ed.) symptom criteria for major depressive disorder. Although the PHQ-9 has been well validated in primary care settings, no studies have examined its factor structure for diverse college populations in the United States. This study used confirmatory factor analysis to test competing measurement models and the measurement invariance of the PHQ-9 across gender (men and women) and racial/ethnic groups (African American, Asian American, European American, Latino/a American) in a sample of 857 U.S. college students. Results supported a 1-factor model of the PHQ-9. Based on configural, metric, and scalar invariance test results, the PHQ-9 assesses depressive symptoms equivalently across gender and racial/ethnic groups. In support of validity evidence, PHQ-9 scores were positively associated with alcohol use and negatively associated with mental well-being. Implications for future research and assessment are discussed. (PsycINFO Database Record

A bifactor model of intolerance of uncertainty in undergraduate and clinical samples: Do we need to reconsider the two-factor model?

The theorized role that intolerance of uncertainty (IU) plays in the acquisition, maintenance, and treatment of multiple emotional disorders underscores the importance of valid assessment tools. Research using the Intolerance of Uncertainty Scale-Short form (IUS-12) has conceptualized IU along 2 dimensions, namely, prospective IU and inhibitory IU. However, recent research has cast doubt on the separability of these dimensions. The aim of the current study was to evaluate the fit of competing measurement models of the IUS-12 in separate undergraduate (N = 506) and clinical (N = 524) samples. Unidimensional, correlated 2-factor, and bifactor models were tested using confirmatory factor analysis. The results of both studies supported a bifactor model consisting of a strong general IU factor. The general IU factor explained the majority of unique variance in the IUS-12, and suggested that a total score is generally appropriate for assessing IU. The general IU factor was most strongly and consistently associated with symptoms of multiple disorders. The inhibitory IU group factor was more weakly associated with most symptom measures in the clinical sample, but only with social phobia symptoms in the undergraduate sample. The prospective IU group factor was only separable from the general IU factor in the undergraduate sample, and did not explain unique variance in disorder symptoms. (PsycINFO Database Record

On Commitment Toward Knowledge Templates in Global Standard Setting: The Case of the FASB‐IASB Revenue Project

ABSTRACTThis article explores commitment to knowledge templates, in this case competing measurement models, in global standard‐setting processes. In particular, I examine the positions of board members of the Financial Accounting Standards Board (FASB) and the International Accounting Standards Board (IASB) on a proposal to use fair value accounting in the measurement of revenue. The proposal to measure revenue at fair value was deliberated between 2002 and 2008 as part of the joint revenue project of the FASB and the IASB. I analyze narratives of the board proceedings on the revenue project, which reveal the positions of board members over the life of the proposal. To make sense of these positions, I use Durocher and Gendron's (2014) framework on epistemic commitment, which speaks to one's allegiance to knowledge templates. The analysis shows that individual board member commitment to different knowledge templates is fairly static despite dynamic and contentious debate on this particular proposal. While stable, board member reactions to the proposed shift toward fair value fall into recognizable patterns showing how commitment to different templates entails prioritizing of different core principles and appeals to higher authorities. Finally, the analysis shows how commitment to knowledge templates varies depending on the professional affiliations of board members. For instance, the analysis shows relatively greater consistency of commitment between board members affiliated with academia and corporate preparers than between auditors. Overall, the study indicates the importance of micro‐level features in explaining the development of macro‐level accounting policy. These features are crucial to enhancing our broader understanding of the way in which accounting standards and rules ultimately develop.

General mixture item response models with different item response structures: Exposition with an application to Likert scales

This article proposes a general mixture item response theory (IRT) framework that allows for classes of persons to differ with respect to the type of processes underlying the item responses. Through the use of mixture models, nonnested IRT models with different structures can be estimated for different classes, and class membership can be estimated for each person in the sample. If researchers are able to provide competing measurement models, this mixture IRT framework may help them deal with some violations of measurement invariance. To illustrate this approach, we consider a two-class mixture model, where a person’s responses to Likert-scale items containing a neutral middle category are either modeled using a generalized partial credit model, or through an IRTree model. In the first model, the middle category (“neither agree nor disagree”) is taken to be qualitatively similar to the other categories, and is taken to provide information about the person’s endorsement. In the second model, the middle category is taken to be qualitatively different and to reflect a nonresponse choice, which is modeled using an additional latent variable that captures a person’s willingness to respond. The mixture model is studied using simulation studies and is applied to an empirical example.

Preliminary Validation of the Teacher-Rated DESSA in a Low-Income, Kindergarten Sample

This study investigated the measurement of social emotional competence in low-income youth by assessing the validity of responses derived from the widely used, teacher-rated Devereux Student Strengths Assessment (DESSA). Based on the five-component social emotional learning model proposed by the Collaborative for Academic, Social, and Emotional Learning, the teacher-rated DESSA shows promise as an easy-to-administer, strengths-based assessment tool for teachers from low-income communities. In a sample of 313 kindergarten students from a southeastern city, three competing measurement models were tested (one-factor, correlated five-factor, and higher order five-factor) using confirmatory factor analyses. Results revealed that, relative to the one-factor model, the higher order five-factor framework had the best model-data fit, although the first-order factors were highly correlated with the second-order factor. Furthermore, zero-order correlations showed that the DESSA was associated with both direct and teacher-reported measures of school-related outcomes. Implications for practice and directions for future research are discussed.