Second-order Factor Model Research Articles

Work symbolic motive scale: development and validation of a measure of affective investment at work

The general aim of this paper is to propose a conceptualisation and an operational measure for affective investment and symbolic motives at work. The work-symbolic motive scale (Work-SMS) score provides a general measure of affective investment, conceived as an endowing process of gratifying qualities to the work context, sustained by the four symbolic motives of achievement, affiliation, power and autonomy. Two studies were conducted (N = 632) suggesting a final 12-item scale with a second-order factor model. Evidence for construct and convergent validity was collected and overall good internal consistency, test-retest reliability estimates and predictive validity after one month were verified.

A Second-Order Confirmatory Factor Analysis of the Moral Distress Scale-Revised for Nurses

Moral distress is a growing problem for healthcare professionals that may lead to dissatisfaction, resignation, or occupational burnout if left unattended, and nurses experience different levels of this phenomenon. This study aims to investigate the factor structure of the Persian version of the Moral Distress Scale-Revised in intensive care and general nurses. This methodological research was conducted with 771 nurses from eight hospitals in the Mazandaran Province of Iran in 2017. Participants completed the Moral Distress Scale-Revised, data collected, and factor structure assessed using the construct, convergent, and divergent validity methods. The reliability of the scale was assessed using internal consistency (Cronbach's alpha, Theta, and McDonald's omega coefficients) and construct reliability. This study was approved by the Ethics Committee of Mazandaran University of Medical Sciences. The exploratory factor analysis (N = 380) showed that the Moral Distress Scale-Revised has five factors: lack of professional competence at work, ignoring ethical issues and patient conditions, futile care, carrying out the physician's orders without question and unsafe care, and providing care under personal and organizational pressures, which explained 56.62% of the overall variance. The confirmatory factor analysis (N = 391) supported the five-factor solution and the second-order latent factor model. The first-order model did not show a favorable convergent and divergent validity. Ultimately, the Moral Distress Scale-Revised was found to have a favorable internal consistency and construct reliability. The Moral Distress Scale-Revised was found to be a multidimensional construct. The data obtained confirmed the hypothesis of the factor structure model with a latent second-order variable. Since the convergent and divergent validity of the scale were not confirmed in this study, further assessment is necessary in future studies.

Integrating service quality as a second-order factor in a customer satisfaction and loyalty model

Purpose The study conceptualizes service quality as a second-order factor and analyzes its influence on customer satisfaction, perceived value, image, consumption emotions and customer loyalty by testing a structural equation model. Design/methodology/approach The model is tested using data collected from 672 guests staying in accommodation establishments located in South Africa. The study follows a hierarchical approach using confirmatory factor analysis to test the second-order factor model and structural equation modeling to test the overall model. Findings The results indicate that the second-order factor model is acceptable both empirically as well as conceptually and performs better than other competing models of service quality. The findings provide support for all hypotheses and evidence of a structural model with a high explanatory power. Research limitations/implications The second-order factor model is less useful when fine-grained analyses are needed, such as when a detailed assessment of the level of quality of service offered by a hospitality organization is required. Practical implications The second-order factor model allows for an analysis of service quality at different levels of abstraction. Accommodation managers interested in customers’ evaluation of service on a cumulative basis can make use of the global measure to determine service quality evaluations. Practitioners can also use the findings to manage the different dimensions of service quality. Originality/value The study demonstrates that service quality is best represented as a second-order factor, and in doing so, it provides an improved measurement of the construct. More so, by integrating the variable in a nomological network, the research develops a more parsimonious model than the existing ones.

Depressive symptoms following natural disaster in Korea: psychometric properties of the Center for Epidemiologic Studies Depression Scale

BackgroundDepressive symptoms have been recognized as one of the most frequent complaints among natural disaster survivors. One of the most frequently used self-report measures of depressive symptoms is the Center for Epidemiologic Studies Depression Scale (CES-D). To our knowledge, no study has yet examined the factor structure, reliability, and validity of the CES-D in a sample of natural disaster survivors. Thus, the present study investigated the factor structure, reliability, and validity of a Korean language version of the CES-D (KCES-D) for natural disaster survivors.MethodsWe utilized two archived datasets collected independently for two different periods in 2008 in the same region of Korea (n = 192 for sample 1; n = 148 for sample 2). Participants were survivors of torrential rains in the mid-eastern region of the Korean peninsula. For analysis, Samples 1 and 2 were merged (N = 340). Confirmatory factor analysis was performed to evaluate the one-factor model, the four-factor model, and the bi-factor models, as well as the second-order factor model. Composite reliability was computed to examine the internal consistency of the KCES-D total and subscale scores. Finally, Pearson’s r was computed to examine the relationship between the KCES-D and the trauma-related measures.ResultsThe four-factor model provided the best fit to the data among the alternatives. The KCES-D showed adequate internal consistency, except for the ‘interpersonal difficulties’ subscale. Also regarding concurrent validity, weak to moderate positive correlations were observed between the KCES-D and the trauma-related measures.ConclusionsThe results support the four-factor model and indicate that the KCES-D has adequate psychometric properties for natural disaster survivors. If these findings are further confirmed, the KCES-D can be used as a useful, rapid, and inexpensive screening tool for assessing depressive symptoms in natural disaster survivors.

Psychometric properties of the Italian version of Colquitt’s Organizational Justice Scale (OJS)

PurposeAlthough Colquitt’s Organizational Justice Scale (COJS) is one of the most widely used organizational justice scales (OJS) worldwide, a rigorous adaptation and validation in Italy is still missing. Accordingly, the purpose of this paper is to examine the construct validity and reliability of the Italian translation of the scale.Design/methodology/approachFactorial and concurrent validity were examined to assess construct validity. A confirmatory factorial analysis through structural equation modelling was conducted on five factorial models: one-factor, two-factor, three-factor, four-factor and second-order factor model. Concurrent validity implied the examination of the relationships between organizational justice and job satisfaction (convergent validity) and between organizational justice and workplace bullying (discriminant validity).FindingsEvidence of the prevalence of the original Colquitt (2001) four-factor model was found, though also the second-order model obtained adequate goodness of fit. Findings supported both convergent and discriminant validity. Reliability analysis reported evidence of excellent internal consistency. Thus, the Italian version of the OJS can be used in Italy for research and practical purposes.Originality/valueThis is the first study properly addressing the factorial and concurrent validity of the OJS in Italy.

The Cross-Cultural Generalizability of Paradoxical Leadership

The authors test the stability and scientific utility of paradoxical leadership behavior (PLB), a leadership approach originally developed and tested in the Chinese context. Study 1 replicates the hypothesized second-order factor model of PLB in a Chinese sample. Study 2 replicates the factor structure of PLB in a Western sample. Multigroup CFA shows that the PLB measures are invariant at the configural/construct level and at the metric level across Chinese and Western samples. Regression analysis, however, fails to support the incremental validity of PLB measures beyond alternative leadership measures in the Western sample. The studies provide a point of departure for additional PLB research by showing that the structural of PLB is stable, but the leadership style may have limited predictive utility in Western countries.

The structure of schizotypal personality traits: a cross-national study.

Schizotypal traits are considered a phenotypic-indicator of schizotypy, a latent personality organization reflecting a putative liability for psychosis. To date, no previous study has examined the comparability of factorial structures across samples originating from different countries and cultures. The main goal was to evaluate the factorial structure and reliability of the Schizotypal Personality Questionnaire (SPQ) scores by amalgamating data from studies conducted in 12 countries and across 21 sites. The overall sample consisted of 27 001 participants (37.5% males, n = 4251 drawn from the general population). The mean age was 22.12 years (s.d. = 6.28, range 16-55 years). The SPQ was used. Confirmatory factor analysis (CFA) and Multilevel CFA (ML-CFA) were used to evaluate the factor structure underlying the SPQ scores. At the SPQ item level, the nine factor and second-order factor models showed adequate goodness-of-fit. At the SPQ subscale level, three- and four-factor models displayed better goodness-of-fit indices than other CFA models. ML-CFA showed that the intraclass correlation coefficients values were lower than 0.106. The three-factor model showed adequate goodness of fit indices in multilevel analysis. The ordinal α coefficients were high, ranging from 0.73 to 0.94 across individual samples, and from 0.84 to 0.91 for the combined sample. The results are consistent with the conceptual notion that schizotypal personality is a multifaceted construct and support the validity and utility of SPQ in cross-cultural research. We discuss theoretical and clinical implications of our results for diagnostic systems, psychosis models and cross-national mental health strategies.

Relationship between the factors influencing online help-seeking and self-regulated learning among Taiwanese preservice teachers

When the information that preservice teachers require to solve problems is inadequately provided by mentors, preservice teachers should seek help from personals outside the practicum school. Online help-seeking provides preservice teachers with useful information to self-regulate their follow-up behaviors for resolving problems. However, preservice teachers do not necessarily seek help. This study investigated the relationship between the psychological factors influencing the online help-seeking and subsequent self-regulated learning of preservice teachers. Valid questionnaires were collected from 462 Taiwanese preservice teachers during December 2015 and were tested by a second-order structural equation model. The evaluative results exhibited an excellent fit in a second-order factor model on online help-seeking, and established a structural equation model on the relationship between seeking help online and self-regulated learning. The analytical results suggested that perceptions of self-efficacy, epistemological belief, and perceived benefits regarding online help-seeking among preservice teachers were the factors related to the actual pursuit of online help, and affected their subsequent self-regulated learning performances. Thus, preservice teachers should be encouraged to seek external help via online communication when mentoring failed practices, especially for self-regulators with low self-efficacy and weak epistemological beliefs, as well as for those who do not perceive benefits from online help-seeking.

Development of a Dietary Habit Self-Management Skills Scale for Post-Gastrectomy Cancer Patients in Japan

Purpose: The purpose of the present study was to develop a Dietary Habit Self-Management Skill (DHSMS) scale, and to test the reliability and validity of this scale. Methods: A questionnaire survey was then conducted using a 69-item DHSMS scale (second draft) for which content validity had been confirmed. The participants were post-gastrectomy cancer patients aged from 40 to under 80 years who had undergone initial gastrectomy with an interval of from 1 month since discharge to <3 years post-operative. Results: The scale is a second-order factor model with “Dietary habit self-management skills” as a higher-order factor, four factors—”Skill to form partnerships with other important people”, “Skill to prevent or cope with post-gastrectomy disorder”, “Skill to grasp issues accompanying post-gastrectomy disorder”, and “Self-efficacy”—and 27 items. The construct validity of the scale was confirmed. Cronbach’s alpha coefficient of the DHSMS scale was 0.915. The criterion- related validity of the DHSMS scale was confirmed based on the correlations between overall DHSMS scale scores and “Number of post-gastrectomy disorder symptoms experienced”, the score for the subscale “Skill to grasp issues accompanying post-gastrectomy disorder” and “Number of post-gastrectomy disorder symptoms experienced”, and the subscale “Self-efficacy” and the SF-8. Discussion: By using patients’ self-administered DHSMS scale scores, medical professionals are able to assess the level of a patient’s self-management skills and the status of their dietary habits as a result of post-gastrectomy disorder.

Dynamic Change of Aggressive Behavior and Victimization Among Adolescents: Effectiveness of the ViSC Program

The present study reports a high-quality evaluation of the ViSC Social Competence Program, which was implemented large scale in Austria. A rigorous test of program effectiveness has been performed to investigate the dynamic change of aggressive behavior and victimization and to ensure a high level of statistical conclusion validity. A cluster randomized control study was applied to examine program effectiveness regarding aggressive behavior and victimization. In sum, 1,377 adolescents (48.5% girls, Mage = 11.7) enrolled in 13 schools participated in the program; 665 adolescents (45.2% girls, Mage = 11.6) enrolled in 5 schools were in the control group. Data were collected with Internet-based questionnaires at pre- and posttest with several validated scales to capture the full range of the two constructs. To ensure construct validity, a series of invariance tests of the second-order factor models were performed. To test program effectiveness, a multiple group bivariate latent change score model was applied. Evidence for a dynamic change of aggressive behavior and victimization was found. As predicted, the pretest levels and the change scores of aggressive behavior and victimization were associated. Moreover, higher levels of pretest values predicted more change. The program was effective in reducing victimization but not aggressive behavior. Gender did not moderate the results. Results are important for national rollout and cross-national dissemination of the program. However, further research is needed to investigate the underlying mechanisms of the intervention effects.

Distinguishing between Privacy and Security Concerns: An Empirical Examination and Scale Validation

ABSTRACTEven though privacy concerns (PC) and security concerns (SC) are acknowledged as separate constructs, many studies argue that they are related or, even worse, confused. Building upon the non-overlapping SC and PC dimensions, we propose an Internet Users Information Transmission Security Concern (IUITSC) scale. We argue that the scale when used in conjunction with the PC scale would cover the entire gamut of SCs and PCs (SC–PC). The construct is tested in a nomological network of personality and trust. The article first develops the theoretical foundation for multiple factor structures including various first-order factor models as well as the second-order factor model. The results, based on extensive statistical tests and nomological examination, suggest that the IUITSC may be represented as a second-order construct comprising of authentication, confidentiality, integrity, and non-repudiation. We argue that information assurance is the common theme that ties these constructs into a higher order IUITSC construct.

Dimensional Structure and Measurement Invariance of the Schizotypal Personality Questionnaire - Brief Revised (SPQ-BR) Scores Across American and Spanish Samples.

The main goal of the present study was to test the measurement equivalence of the Schizotypal Personality Questionnaire - Brief Revised (SPQ-BR) scores in a large sample of Spanish and American non-clinical young adults. The sample was made up of 5,625 young adults (M = 19.65 years; SD = 2.53; 38.5% males). Study of the internal structure, using confirmatory factor analysis (CFA), revealed that SPQ-BR items were grouped in a theoretical internal structure of nine first-order factors. Moreover, three or four second-order factor and bifactor models showed adequate goodness-of-fit indices. Multigroup CFA showed that the nine lower-order factor models of the SPQ-BR had configural and weak measurement invariance and partial strong measurement invariance across country. The reliability of the SPQ-BR scores, estimated with omega, ranged from 0.67 to 0.91. Using the item response theory framework, the SPQ-BR provides more accurate information at the medium and high end of the latent trait. Statistically significant differences were found in the raw scores of the SPQ-BR subscales and dimensions across samples. The American group scored higher than the Spanish group in all SPQ-BR domains except Ideas of Reference and Suspiciousness. The finding of comparable factor structure in cross-cultural samples would lend further support to the continuum model of psychosis spectrum disorders. In addition, these results provide new information about the factor structure of schizotypal traits and support the validity and utility of this measure in cross-cultural research.

Development and validation of the preparedness for Colorectal Cancer Surgery Questionnaire: PCSQ-pre 24.

The aims of the study were to develop and psychometrically evaluate a patient-reported outcome instrument for the measurement of preoperative preparedness in patients undergoing surgery for colorectal cancer. This study was conducted in two stages: a) instrument development (item generation, construction of items and domains), empirical verification and b) instrument evaluation. A questionnaire with 28 items measuring preparedness for surgery was developed covering four domains and was tested for content validity with an expert panel and with patients. Psychometric testing of the questionnaire was conducted on 240 patients undergoing elective surgery for colorectal cancer. The scale content validity index of the preparedness items was 0.97. The final version consisted of 24 items measuring 4 subscales: Searching for and making use of information, Understanding and involvement in the care process, Making sense of the recovery process and Support and access to medical care. Confirmatory factor analysis revealed good model fit with standardized factor loadings ranging from 0.58 to 0.97. A well-fitting second-order factor model provided support for a total preparedness score with second-order factor loadings ranging from 0.75 to 0.93. The ordinal alpha values of the four latent factors ranged from 0.92 to 0.96, indicating good internal consistency. The polyserial correlations with the total score were 0.64 (p<0.01) for the overall preparedness question and 0.37 (p<0.01) for overall well-being. The Swedish Preparedness for Colorectal Cancer Surgery Questionnaire for use in the preoperative phase demonstrated good psychometric properties based on a sound conceptualization of preparedness.

Initial Development and Validation of the BullyHARM: The Bullying, Harassment, and Aggression Receipt Measure.

This article describes the development and preliminary validation of the Bullying, Harassment, and Aggression Receipt Measure (BullyHARM). The development of the BullyHARM involved a number of steps and methods, including a literature review, expert review, cognitive testing, readability testing, data collection from a large sample, reliability testing, and confirmatory factor analysis. A sample of 275 middle school students was used to examine the psychometric properties and factor structure of the BullyHARM, which consists of 22 items and 6 subscales: physical bullying, verbal bullying, social/relational bullying, cyber-bullying, property bullying, and sexual bullying. First-order and second-order factor models were evaluated. Results demonstrate that the first-order factor model had superior fit. Results of reliability testing indicate that the BullyHARM scale and subscales have very good internal consistency reliability. Findings indicate that the BullyHARM has good properties regarding content validation and respondent-related validation and is a promising instrument for measuring bullying victimization in school.

Measurement invariance of second-order factor model of the Multifactor Leadership Questionnaire (MLQ) across K-12 principal gender

PurposeThe purpose of this paper is to investigate the factor structure and the measurement invariance of the Multifactor Leadership Questionnaire (MLQ) across gender of K-12 school principals (n=6,317) in the USA.Design/methodology/approachNine first-order factor models and four second-order factor models were tested using confirmatory factor analysis.FindingsThe results suggested that the nine-factor model provided the best fit for the data. Further examination revealed that most constructs lacked convergent validity and discriminant validity. Second-order factor models were tested and the hierarchical model with two higher order factors (i.e. transformational and transactional leadership) was deemed the best fit and it was then tested for measurement invariance between females and males. The measurement model was found to be invariant across gender. Findings suggested that female school principals demonstrated significantly greater transformational leadership behaviour, while male school principals demonstrated significantly greater transactional leadership behaviour.Originality/valueThis study addressed construct and factor issues previously associated with the MLQ in the measurement of transformational and transactional leadership among a variety of organizations. By using a sample of K-12 school principals across gender, this study has provided support that may ameliorate contextual doubts of transformational leadership behaviour when examining the relational aspects needed to improve schools.

Authentic Leadership Questionnaire: invariance between samples of Brazilian and Portuguese employees

The Authentic Leadership Questionnaire (ALQ) is used to assess authentic leadership (AL). Although ALQ is often used in empirical research, cross-cultural studies with this measure are scarce. Aiming to contribute to filling this gap, this study assesses the invariance of the ALQ measure between samples of Brazilian (N = 1019) and Portuguese (N = 842) employees. A multi-group confirmatory factor analysis was performed, and the results showed the invariance of the first- and second-order factor models between the Brazilian and Portuguese samples. The results are discussed considering their cultural setting, with the study’s limitations and future research directions being pointed out.

Fit for Purpose, Psychometric Assessment of the Eating Attitudes Test-26 in an Irish Adolescent Sample

The present study examined the psychometric properties of the Eating Attitudes Test-26 (EAT-26) in a sample of Irish adolescents (N=2444). Consistent with previous research, in adolescents, confirmatory factor analysis (CFA) failed to replicate the original three-factor structure of the EAT-26. Goodness-of-fit indices provided support for a recently published six-factor EAT-18 model. As the EAT-26 is typically used as a unitary measure by clinicians, a second-order factor model was investigated, which supported a general concept of eating problems. Convergent validity of the EAT-18 was assessed using the Eating Disorder Inventory-3 (EDI-3). Using the 90th percentile, a cut-off score of 13 was identified on the EAT-18 that discriminated between those indicative and non-indicative of disordered eating attitudes and behaviors. Findings suggest that the revised factor structures may be more suitable for the general adolescent population than the original three-factor EAT-26. Clinical implications of the EAT-18 and future research recommendations are addressed.

The Counseling Center Assessment of Psychological Symptoms Distress Index: A pragmatic exploration of general factors to enhance a multidimensional scale

Objective: The authors attempted to develop and validate a general distress index for a multidimensional psychological symptom/outcome measure used in over 300 college counseling centers with more than 100,000 cases annually: the Counseling Center Assessment of Psychological Symptoms (CCAPS). Method: Four models were compared for fit indices (n = 19,247): the existing first-order factor model (without a general factor), a second-order factor model, a bifactor model, and a single factor or “total score” model. In separate clinical and non-clinical samples, concurrent and divergent validity were examined using several well-established measures of psychological symptoms, as well as two-week test–retest and treatment utilization data. Results: Second-order and bifactor models which captured a single “distress” factor both exhibited good fit to the data relative to the baseline and “total score” model. Validity data indicated that factors adequately measured meaningful clinical onstructs. Conclusion: Both the bifactor and second-order models indicated the presence of a “distress index” comprised items across many of the CCAPS subscales. This distress scale has strong applicability for benchmarking the overall severity and complexity of patients at different centers, and can be used to help identify colleges and universities with areas of clinical strength, which can be studied to improve the field. Clinically, the distress index offers a parsimonious and efficient method for clinicians to monitor patients’ progress through treatment.

Psychometric properties of the Dutch WHOQOL-OLD.

BackgroundTo assess the internal consistency reliability and construct validity of the Dutch version of the World Health Organization Quality of Life Instrument-Older Adults Module (WHOQOL-OLD).MethodsThe psychometric properties of the Dutch WHOQOL-OLD were examined in a cross-sectional study using a sample of 1,340 people aged 60 years or older. Participants completed a Web-based questionnaire, the ‘Senioren Barometer’. Reliability was evaluated using Cronbach’s alpha and corrected item-total correlations. Construct validity of the Dutch WHOQOL-OLD was evaluated with confirmatory factor analyses, and correlations within and between scales, using scales WHOQOL-BREF, Short Form Health Survey (SF-12), Tilburg Frailty Indicator (TFI), and the Emotional and Social Loneliness Scale (ESLS).ResultsThe reliabilities of the six WHOQOL-OLD facets or subscales were sufficient to good (.66-.91). The convergent validity of the WHOQOL-OLD was good, whereas our findings on the divergent validity of the WHOQOL-OLD were somewhat mixed. Findings corroborating the divergent validity were that the 6-factor model fitted better than the second-order factor model, and WHOQOL-OLD facets sensory abilities, past, present and future activities, death and dying, intimacy correlated more strongly with similar than dissimilar scales. Not fully supporting divergent validity were the extremely high correlations between the factors corresponding to autonomy, past, present and future activities, and social participation.ConclusionWe offer Dutch healthcare and social workers an instrument with good psychometric properties for measuring quality of life in older people. Further research on interrelations between WHOQOL-OLD facets is recommended.

Exploration of the Factor Structure of ADHD in Adolescence through Self, Parent, and Teacher Reports of Symptomatology.

Factor analytic studies of attention-deficit/hyperactivity disorder (ADHD) in children and adults have shown that second-order and bifactor models better represent ADHD symptoms than two- or three-factor models, yet there is far less evidence for a bestfitting model of ADHD in adolescence. Thus, the current study examined the factor structure of ADHD in adolescence and further evaluated the external validity of the best fitting model. Participants were 588 adolescents (22% female; 366 with a childhood ADHD diagnosis; mean age 15.9years) from the 8-year assessment of the Multimodal Treatment Study of Children with ADHD (MTA). ADHD symptoms were assessed via adolescent self-report, parent report, and teacher report on the SNAP-IV scale. Potential factor structures for the 18 symptoms of ADHD were tested for each informant, which included traditional one-factor, two-factor, and three-factor models of ADHD, as well as second-order factor (specific factors loading onto general factor) and bifactor (items loading onto both specific and general factors) models. Unique associations between external criteria and the identified factors of each informant's best fitting model were examined. Although several of the proposed models exhibited good fit, the second-order two-factor model best accounted for ADHD in adolescence according to self-report and parent report, and the second-order three-factor model was optimal according to teacher report. Several key measurement issues emerged for the hierarchical bifactor models, such as numerous Heywood cases and out-of-bound parameter estimates, which rendered them unfit as optimal representations of ADHD in adolescence. These findings and the implications of the best fitting model of ADHD in adolescence suggest that a possible reorganization of this disorder may eventually aid clinicians in the accurate diagnosis of ADHD in adolescents.