Longitudinal Invariance Research Articles

Structure and Longitudinal Invariance of the Multicultural Awareness, Knowledge, and Skills Survey – Counselor Edition – Revised

Objective Determine the structure of the Multicultural Awareness, Knowledge, and Skills Survey-Counselor Edition-Revised (MAKSS-CE-R) and whether it is invariant across groups and over time. Method We used structural equation modeling and data from counseling students (n = 147) as well as students in an interprofessional Screening, Brief Intervention, and Referral to Treatment training (n = 248). Results MAKSS-CE-R responses reflected six factors, suggesting neither three nor a single score sufficiently summarize them. Strong partial invariance held between groups as did strict longitudinal invariance. Synchronous and longitudinal correlations, as well as temporal factor mean changes, further suggest one or a few scores may be insufficient and raise questions about the validity of the awareness subscale. Conclusions Research should further evaluate measures of multicultural counseling competence (MCC) and explore whether the use of too few scores can explain why therapist rated MCC has been uncorrelated with client outcomes. Significance Measures of MCC are key in preparing counselors and other helping professionals to serve diverse clients. Our results suggest too few scores are used to summarize responses to a popular MCC measure, thereby informing future research and providing a potential explanation of the lack of correlation between MCC and client outcomes.

Psychometric Analysis of the Hip Disability and Osteoarthritis Outcome Score (HOOS).

Hip Disability and Osteoarthritis Outcome Survey (HOOS) was developed as a region- and disease-specific outcome to assess hip disability. Despite the use of the HOOS in clinical practice and research, psychometric analyses of the scale in a large dataset of patients have not been performed. As such, the purposes of this study were to assess the structural validity of the HOOS in patients who underwent a total hip arthroplasty. Data were obtained from the Surgical Outcome System (SOS) global registry. Confirmatory factor analysis (CFA) was conducted to assess the scale structure of the 40-item HOOS and exploratory factor analysis (EFA) was conducted to identify a parsimonious scale structure. The parsimonious model identified was subjected to multi-group and longitudinal invariance testing and LGC modeling. The original five-factor, 40-item HOOS did not meet recommended model fit indices values (CFI = 0.822, TLI = 0.809, IFI = 0.822, RMSEA = 0.085). Alternate model generation identified an alternative model (i.e., HOOS-9). Sound model fit was identified for the HOOS-9 (CFI = 0.974, TLI = 0.961, RMSEA = 0.046). Invariance testing criteria were also met between groups (i.e., age and sex) and across time. Lastly, a nonlinear growth trajectory was identified in responses pertaining to hip disability. The original scale structure of the 40-item HOOS was not supported. The HOOS-9 met contemporary model fit recommendations, along with multi-group and longitudinal invariance testing. Our findings support the preliminary use of the HOOS-9 to assess hip function and disability in research and clinical practice.

Measurement Invariance Testing Works.

Psychometricians have argued that measurement invariance (MI) testing is needed to know if the same psychological constructs are measured in different groups. Data from five experiments allowed that position to be tested. In the first, participants answered questionnaires on belief in free will and either the meaning of life or the meaning of a nonsense concept called "gavagai." Since the meaning of life and the meaning of gavagai conceptually differ, MI should have been violated when groups were treated like their measurements were identical. MI was severely violated, indicating the questionnaires were interpreted differently. In the second and third experiments, participants were randomized to watch treatment videos explaining figural matrices rules or task-irrelevant control videos. Participants then took intelligence and figural matrices tests. The intervention worked and the experimental group had an additional influence on figural matrix performance in the form of knowing matrix rules, so their performance on the matrices tests violated MI and was anomalously high for their intelligence levels. In both experiments, MI was severely violated. In the fourth and fifth experiments, individuals were exposed to growth mindset interventions that a twin study revealed changed the amount of genetic variance in the target mindset measure without affecting other variables. When comparing treatment and control groups, MI was attainable before but not after treatment. Moreover, the control group showed longitudinal invariance, but the same was untrue for the treatment group. MI testing is likely able to show if the same things are measured in different groups.

Longitudinal invariance of the Patient Health Questionnaire-9 among patients receiving pharmacotherapy for major depressive disorder: A secondary analysis of clinical trial data.

Comparing self-reported symptom scores across time requires longitudinal measurement invariance (LMI), a psychometric property that means the measure is functioning identically across all time points. Despite its prominence as a measure of depression symptom severity in both research and health care, LMI has yet to be firmly established for the Patient Health Questionnaire-9 depression module (PHQ-9), particularly over the course of antidepressant pharmacotherapy. Accordingly, the objective of this study was to assess for LMI of the PHQ-9 during pharmacotherapy for major depressive disorder. This was a secondary analysis of data collected during a randomized controlled trial. A total of 1,944 veterans began antidepressant monotherapy and completed the PHQ-9 six times over 24 weeks of treatment. LMI was assessed using a series of four confirmatory factor analysis models that included all six time points, with estimated parameters increasingly constrained across models to test for different aspects of invariance. Root-mean-square error of approximation of the chi-square difference test values below 0.06 indicated the presence of LMI. Exploratory LMI analyses were also performed for separate sex, age, and race subgroups. Root-mean-square error of approximation of the chi-square difference test showed minimal change in model fits during invariance testing (≤ 0.06 for all steps), supporting full LMI for the PHQ-9. LMI was also supported for all tested veteran subgroups. As such, PHQ-9 sum scores can be compared across extended pharmacotherapy treatment durations. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Is the Epworth Sleepiness scale a valid outcome measure to evaluate the effectiveness of positive airway pressure treatments on daytime sleepiness? Psychometric insights from measurement invariance and response shifts.

Although the validity of the Epworth Sleepiness Scale (ESS) as an effectiveness measure for sleep apnea treatments such as continuous positive airway pressure (CPAP) has been supported by multiple studies, some researchers continue to challenge it. They suggest that in addition to its impact on relieving patients' daytime sleepiness, CPAP also alters the internal standards patients use to evaluate their sleepiness (i.e., response shift; RS), confounding the meaning of the difference in the ESS scores. We believe an issue yet to be addressed in this debate is that all existing evidence of RS has been obtained through the then-test approach, a retrospective method sensitive to various cognitive mechanisms. Thus, in the current study, we re-examined this issue using the structural equation modeling (SEM) approach, a method that can be directly applied to randomized clinical trial (RCT) data without retrospective measures. With the ESS data from two independent RCTs, we conducted cross-sectional and longitudinal measure invariance tests in SEM to examine whether CPAP would lead to RS. The ESS demonstrated cross-sectional and longitudinal scalar invariance against CPAP treatments. Its factorial pattern, loadings, and thresholds were invariant between the treatment and control groups and pre- and post-treatment, supporting the comparability of the observed mean ESS scores across time and groups. Our results support the validity of the average difference scores of the ESS for quantifying the effectiveness of CPAP on group-level daytime sleepiness in RCTs with relatively large sample sizes.

A longitudinal examination of the measurement properties and invariance of the Sleep Condition Indicator in Chinese healthcare students

BackgroundThe Sleep Condition Indicator (SCI), an insomnia measurement tool based on the updated Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) criteria with sound psychometric properties when applied in various populations, was evaluated here among healthcare students longitudinally, to demonstrate its measurement properties and invariance in this particularly high-risk population.MethodsHealthcare students of a Chinese university were recruited into this two-wave longitudinal study, completing the simplified Chinese version of the SCI (SCI-SC), Chinese Regularity, Satisfaction, Alertness, Timing, Efficiency, Duration (RU_SATED-C) scale, Chinese Patient Health Questionnaire-4 (PHQ-4-C), and sociodemographic variables questionnaire (Q-SV) between September and November 2022. Structural validity, measurement invariance (MI), convergent and discriminant validity, internal consistency, and test–retest reliability of the SCI-SC were examined. Subgroups of gender, age, home location, part-time job, physical exercise, and stress-coping strategy were surveyed twice to test cross-sectional and longitudinal MI.ResultsWe identified 343 valid responses (62.9% female, mean age = 19.650 ± 1.414 years) with a time interval of seven days. The two-factor structure was considered satisfactory (comparative fit index = 0.953–0.989, Tucker–Lewis index = 0.931–0.984, root means square error of approximation = 0.040–0.092, standardized root mean square residual = 0.039–0.054), which mostly endorsed strict invariance except for part-time job subgroups, hence establishing longitudinal invariance. The SCI-SC presented acceptable convergent validity with the RU_SATED-C scale (r ≥ 0.500), discriminant validity with the PHQ-4-C (0.300 ≤ r < 0.500), internal consistency (Cronbach’s alpha = 0.811–0.835, McDonald’s omega = 0.805–0.832), and test–retest reliability (intraclass correlation coefficient = 0.829).ConclusionThe SCI-SC is an appropriate screening instrument available for assessing insomnia symptoms among healthcare students, and the promising measurement properties provide additional evidence about validity and reliability for detecting insomnia in healthcare students.

Psychological readiness for injury recovery: evaluating psychometric properties of the IPRRS and assessing group differences in injured physically active individuals

ObjectivesThe primary purpose of the study was to assess the one-factor and two-factor structure of the Injury Psychological Readiness to Return to Sport Scale (IPRRS) in an injured physically active...

Psychometric properties and invariance of the Police Stress Questionnaire in the Romanian context

This research evaluates the psychometric properties of the Romanian version of the Police Stress Questionnaire (PSQ), featuring operational and organizational stress scales for police officers. We conducted three studies to test the reliability and validity of this questionnaire. The first study (N = 744) aimed at adapting and validating the Romanian version on the specific population. Confirmatory factor analysis of our two-factor model, each with 20 items grouped in a second-order factor, showed the good value of the fit indices: χ²(738) = 1420.11, p < .001; CFI = 0.992; TLI = 0.992; RMSEA = 0.035 [90% CI 0.033, 0.038]; SRMR = 0.059. Subsequently, we tested measurement invariance, demonstrating that the Romanian version of this questionnaire measures workplace stress (including operational and organizational stress factors) independently of the work environment (police officers vs. correctional officers). The second study (N = 394) confirmed PSQ’s convergent validity through positive correlations with stress perception, burnout, mental health complaints, and psychological distress and its discriminant validity through negative correlations with job satisfaction and work engagement. The third study tested the longitudinal invariance of the stress questionnaire for police (N = 317). The findings suggest that the PSQ is a reliable and valid tool, highlighting its significant impact on the well-being of Romanian police officers by facilitating stress management interventions through baseline and ongoing stress assessment. Future research should longitudinally assess police stress, incorporating multi-source data and diverse units, as well as exploring the impact of socio-demographic aspects for broader insights.

Longitudinal Analysis and Latent Growth Modeling of the Modified Hip Dysfunction and Osteoarthritis Outcome Score for Joint Replacement (HOOS-JR).

The Hip Dysfunction and Osteoarthritis Outcome Score for Joint Replacement (HOOS-JR) was developed as a short-form survey to measure progress after total hip arthroplasty (THA). However, the longitudinal validity of the scale structure pertaining to the modified five-item HOOS-JR has not been assessed. Therefore, the purpose of this study was to evaluate the structural validity, longitudinal invariance properties, and latent growth curve (LGC) modeling of the modified five-item HOOS-JR in a large multi-site sample of patients who underwent a THA. A longitudinal study was conducted using data from the Surgical Outcome System (SOS) database. Confirmatory factor analyses (CFAs) were conducted to assess the structural validity and longitudinal invariance across five time points. Additionally, LGC modeling was performed to assess the heterogeneity of the recovery patterns for different subgroups of patients. The resulting CFAs met most of the goodness-of-fit indices (CFI = 0.964-0.982; IFI = 0.965-0.986; SRMR = 0.021-0.035). Longitudinal analysis did not meet full invariance, exceeding the scalar invariance model (CFIDIFF = 0.012; χ2DIFF test = 702.67). Partial invariance requirements were met upon release of the intercept constraint associated with item five (CFIDIFF test = 0.010; χ2DIFF = 1073.83). The equal means model did not pass the recommended goodness-of-fit indices (CFIDIFF = 0.133; χ2DIFF = 3962.49). Scores significantly changed over time, with the highest scores identified preoperatively and the lowest scores identified at 2- and 3-years postoperatively. Upon conclusion, partial scalar invariance was identified within our model. We identified that patients self-report most improvements in their scores within 6 months postoperatively. Females reported more hip disability at preoperative time points and had faster improvement as measured by the scores of the modified five-item HOOS-JR.

Longitudinal associations between critical consciousness, school racial climate, and belonging in school

The dual pandemics (i.e. COVID-19 and racial injustice) in the United States offer a unique socio-historical context to explore adolescents’ belonging, perceptions of school racial climate, and critical reflection (i.e. awareness of social inequality). Longitudinal data were collected at four points from 906 students attending a public high school in the Southeastern United States. Students completed questionnaires regarding their belonging, critical reflection, and perceptions of equal status at school. Longitudinal invariance for these three constructs was documented for White students but not students of color. Therefore, the cross-lagged panel analysis involving White students only revealed considerably different patterns of associations by learning environment/school year (i.e. virtual/2020–2021, in-person/2021–2022). White students’ critical reflection negatively predicted their belonging and perceptions of equal status in school but only during virtual schooling. Further, during in-person schooling, perceptions of equal status predicted belonging. Implications for educational practice and policy are discussed.

Measurement of adolescent psychological wellbeing: A test of factor structure and measurement invariance.

Gains in holistic approaches to adult mental health have been associated with increasing interest in understanding psychological wellbeing (PWB) among adolescents. Empirical examination of measurement models for PWB in adolescence is lacking. Thus, the current study examined PWB in a longitudinal, diverse sample of 433 adolescents (non-Latinx Black: 37.6%; non-Latinx White: 25.9%; Latinx: 36.5%; Male adolescents: 50.1%). A one-factor, correlated six-factor and hierarchical models were examined across racial/ethnic (White, Black, and Hispanic) and gender (female, male) identities, after which the best fitting model was selected to undergo invariance testing. A one-factor structure was superior, and exhibited strict invariance across racial/ethnic and gender identities at each wave of the study, as well as longitudinal invariance within the entire sample.

Examining the longitudinal associations between activity limitations, instrumental supports and social participation in osteoarthritis: A CLSA population-based study.

In osteoarthritis (OA) research, disability is largely studied within the context of activities of daily living. Broader consequences for social participation are often overlooked. In prior work, instrumental supports received and their perceived availability were shown to play a role in the maintenance of social participation. Two indicators of social participation were identified, diversity and intensity. The current study extends the findings from this prior cross-sectional work by examining these relationships longitudinally. Data are from the baseline and 3-year follow-up questionnaires of the Canadian Longitudinal Study on Aging, a population-based study of people ages 45-85 years at baseline. The sample was restricted to those who at baseline reported a doctor diagnosis of OA (n = 4104). Using structural equation modeling, latent variables were derived at each time point for activity limitations, instrumental supports perceived and received, and social participation diversity and intensity. Longitudinal factorial invariance was assessed. Model covariates included age, sex, education, income, marital status, smoking status, obesity, and number of chronic conditions. For all latent variables, strong factorial longitudinal invariance was found. Activity limitations increased over time. Greater baseline social participation intensity was associated with increases in later intensity and diversity. Increasing activity limitations were associated with decreases in social participation and with increasing receipt of instrumental supports; they were not associated with changes in perceived availability of supports. However, increasing perceived availability was positively associated with social participation intensity. With a goal of increasing social participation, findings suggest a focus on interventions to reduce activity limitations in OA is necessary. Findings additionally highlight an important role for perceived availability of instrumental supports in maintaining or improving social participation in OA, in addition to current social participation, particularly intensity, for future social participation status.

Factor structure and longitudinal invariance for the Chinese Mainland version of the Edinburgh postnatal depression scale during pregnancy

BackgroundThere are inconsistent results on the Edinburgh Postnatal Depression Scale's (EPDS) factor structure and longitudinal invariance among different cultures. Furthermore, limited relevant studies in Chinese pregnant women exist. PurposeTo test the factor structure of the Chinese Mainland EPDS during pregnancy and conduct longitudinal invariance analyses. MethodsA national multi-centre cohort study was conducted among 1207 pregnant women selected consecutively by convenience sampling from five hospitals in Zhuhai, Taiyuan, Haidian, Changchun, and Shenzhen in China between August 2015 and October 2016. Depression was measured by the EPDS during gestational weeks 10–13, 15–18, 23–25, 30–32 and 36–37, respectively.s ResultsThree factors with eigenvalues nearly larger than 1.0 were optimal for the Chinese Mainland EPDS, labelled “anxiety,” “anhedonia,” and “depression,” and contained items 3–5, 1–2, and 6–10, respectively. The confirmatory factor analysis results of standardized root mean square residual (SRMR) = 0.034, root mean square error of approximation (RMSEA) = 0.049, comparative fit index (CFI) = 0.968, Tucker-Lewis index (TLI) = 0.954, and χ2, p < 0.05 indicated good fit. For the longitudinal invariance tests, the configural invariance was met, with the CFI and TLI both higher than 0.90 and the RMSEA lower than 0.08 (CFI = 0.919, TLI = 0.908, and RMSEA = 0.034). The metric-, scalar-, and strict invariances were met. ConclusionsThe three-factor model of the Chinese Mainland EPDS is invariant in pregnancy, suggesting stability and comparability in identifying the women screened positive at different points during pregnancy and making the scale feasible to screen prenatal depression and anxiety simultaneously.

Examining the validity of the addictions neuroclinical assessment domains in a crowdsourced sample of adults with current alcohol use.

Several dimensional frameworks for characterizing heterogeneity in alcohol use disorder (AUD) have been proposed, including the Addictions Neuroclinical Assessment (ANA). The ANA is a framework for assessing individual variability within AUD across three domains corresponding to the proposed stages of the addiction cycle: reward (binge-intoxication stage), negative emotionality (withdrawal-negative affect stage), and cognitive control (preoccupation-anticipation stage). Recent work has evaluated the ANA's three-factor structure and construct validity, primarily in treatment-seekers with AUD. We extended this research by examining the factor structure, bias across alcohol use severity, longitudinal invariance, and concurrent and predictive validity of a novel assessment of the ANA domains in adults with past 12-month regular (10 + alcohol units/week) alcohol use. Participants recruited from Prolific (N = 732), a crowdsourced data collection platform, completed various self-report measures. A test-retest subsample (n = 234) completed these measures 30 days later. Split-half exploratory factor analysis and confirmatory factor analysis supported the three-factor structure of the ANA. The overall factor structure was invariant across 30 days. Concurrently and prospectively, ANA domains demonstrated convergent validity concerning theoretically aligned alcohol-related, psychological, and personality measures. However, there was evidence of poor discriminant validity, and several cognitive control and reward items demonstrated bias across alcohol use severity. Future research is needed to improve the measurement of ANA domains using multimodal indicators, examine longitudinal changes in domains and their relationship with alcohol use severity, characterize phenotypic subgroups based on relative levels of domains, and compare the utility of the ANA with other proposed frameworks for measuring AUD heterogeneity. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Assessing psychometric properties and measurement invariance of the Sleep Quality Questionnaire among healthcare students

ObjectiveThe sleep of healthcare students is worth discovering. Mental health and self-rated health are thought to be associated with sleep quality. As such, valid instruments to assess sleep quality in healthcare students are crucial and irreplaceable. This study aimed to investigate the measurement properties of the Sleep Quality Questionnaire (SQQ) for Chinese healthcare students.MethodsTwo longitudinal assessments were undertaken among healthcare students, with a total of 595, between December 2020 and January 2021. Measures include the Chinese version of the SQQ, Patient Health Questionnaire-4 (PHQ-4), Self-Rated Health Questionnaire (SRHQ), and sociodemographic questionnaire. Structural validity through confirmatory factor analysis (CFA) was conducted to examine factor structure of the SQQ. T-tests and ANOVAs were used to examine sociodemographic differences in sleep quality scores. Multi Group CFA and longitudinal CFA were respectively used to assess cross-sectional invariance and longitudinal invariance across two-time interval, i.e., cross-cultural validity. Construct validity, internal consistency, and test–retest reliability were correspondingly examined via Spearman correlation, Cronbach’s alpha and McDonald’s omega, and intraclass correlation coefficient. Multiple linear regression analysis was performed to examine incremental validity of the SQQ based on the PHQ-4 and SRHQ as indicators of the criterion variables.ResultsCFA results suggested that the two-factor model of the SQQ-9 (item 2 excluded) had the best fit. The SQQ-9 scores differed significantly by age, grade, academic stage, hobby, stress coping strategy, anxiety, depression, and self-rated health subgroups. Measurement invariance was supported in terms of aforesaid subgroups and across two time intervals. In correlation and regression analyses, anxiety, depression, and self-rated health were moderately strong predictors of sleep quality. The SQQ-9 had good internal consistency and test–retest reliability.ConclusionGood measurement properties suggest that the SQQ is a promising and practical measurement instrument for assessing sleep quality of Chinese healthcare students.

Factor Structure and Longitudinal Invariance of the CES-D across Diverse Residential Backgrounds in Chinese Adolescents

Factor Structure and Longitudinal Invariance of the CES-D across Diverse Residential Backgrounds in Chinese Adolescents

Validation of the Spanish version of the five-item General Self-Efficacy (GSE) scale in a sample of nursing students: Evidence of validity, reliability, longitudinal invariance and changes in general self-efficacy and resilience in a two-wave cross-lagged panel model

AimThe aim of this study is to validate the Spanish version of the five-item General Self-Efficacy scale in a sample of nursing students, by: 1) offering evidence of validity and reliability; 2) studying the longitudinal measurement invariance of the scale; 3) providing evidence on the changes in the levels of self-efficacy that occur after one year of nursing education; and 4) offering longitudinal evidence on the relationship between nursing students’ self-efficacy and resilience levels. BackgroundNurses' general self-efficacy has been related to both personal and organizational outcomes. In Spain, some competencies the students must acquire during the Degree in Nursing implicitly refer to self-efficacy. For the measurement of general self-efficacy, the General Self-Efficacy Scale is one of the most widely used in Europe. DesignA longitudinal design was used. Research took place at the University of Valencia and the University of the Balearic Islands (Spain). Participants were 324 nursing students, in the first year of the Nursing Degree. MethodsThe five-item General Self-Efficacy scale and the Brief Resilience Coping Scale were used. Analyses included descriptive statistics, reliability estimates, confirmatory factor analysis, a longitudinal measurement invariance routine and several competing cross-lagged models. ResultsEvidence of reliability shown by the scale was adequate and a one-factor solution for the structure was found. Additionally, the five-item GSE showed evidence of invariance over time. A causal effect of self-efficacy on nursing students’ levels of resilience was found. ConclusionsThe Spanish version of the five-item General Self-Efficacy scale is a brief instrument that can contribute to the assessment of some of the basic competencies of the Degree in Nursing, which improve during their education and how these changes are related to other skills important for the nursing profession, such as resilience.

Longitudinal measurement invariance of constructs derived from the addiction cycle.

The Alcohol Addiction Research Domain Criteria (AARDoC) is an organizational framework for assessing heterogeneity in addictive disorders organized across the addiction cycle domains of incentive salience, negative emotionality, and executive functioning and may have benefits for precision medicine. Recent work found pretreatment self-report items mapped onto the addiction cycle domains and predicted 1- and 3-year alcohol use disorder treatment outcomes. Given the potential utility of the addiction cycle domains for predicting relevant treatment outcomes, this study sought to evaluate the longitudinal measurement invariance of the domains. We conducted a secondary analysis of individuals with alcohol use disorder (n = 1,383, 30.9% female, 76.8% non-Hispanic White, 11.2% Hispanic) who participated in the COMBINE study. Eleven items assessed at pre- and posttreatment were included in exploratory structural equation modeling (ESEM) and longitudinal invariance analyses. The pre- and posttreatment ESEM models had factor loadings consistent with the three addiction cycle domains and fit the data well. The ESEM factor structure was invariant from pre- to posttreatment (representing configural invariance) and metric invariance (factor loadings) was largely supported, but analyses failed to support scalar invariance (item-level thresholds) of the addiction cycle domains. A three-factor structure representing addiction cycle domains can be modeled using brief self-report measures pre- and posttreatment. Individuals demonstrated a downward shift in the level of item endorsement, indicating improvement with treatment. Although this 11-item measure might be useful at baseline for informing treatment decisions, results indicate the need to exercise caution in comparing the addiction cycle domains pre- to posttreatment within persons. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The ephemeral nature of wording effects.

This article explores the analysis and interpretation of wording effects associated with using direct and reverse items in psychological assessment. Previous research using bifactor models has suggested a substantive nature of this effect. The present study uses mixture modeling to systematically examine an alternative hypothesis and surpass recognized limitations in the bifactor modeling approach. In preliminary supplemental Studies S1 and S2, we examined the presence of participants who exhibited wording effects and evaluated their impact on the dimensionality of Rosenberg's Self-Esteem and the Revised Life Orientation Test, confirming the ubiquity of wording effects in scales containing direct and reverse items. Then, after analyzing the data for both scales (n = 5,953), we found that, despite a significant association between wording factors (Study 1), a low proportion of participants simultaneously exhibited asymmetric responses in both scales (Study 2). Similarly, despite finding both longitudinal invariance and temporal stability of this effect in three waves (n = 3,712, Study 3), a small proportion of participants was identified with asymmetric responses over time (Study 4), reflected in lower transition parameters compared to the other patterns of profiles examined. In both cases, we illustrate how bifactor models capitalize on the responses of individuals who do not even exhibit wording effects, yielding spurious correlations suggesting a substantive nature of the wording effect. These findings support the notion of an ephemeral nature underlying wording effects. The discussion focuses on alternative hypotheses to understand these findings and emphasizes the utility of including reverse items in psychological assessment. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Psychometric properties of the Brief Version of Pittsburgh Sleep Quality Index (B-PSQI) among Chinese male sailors on 18-hr rotating shift schedule.

Sleep problems among shift workers have emerged as a public health concern in recent years. However, few validation studies of self-reported sleep quality questionnaires were performed among shift workers. The present study aimed to examine the psychometric properties of the Brief Version of Pittsburgh Sleep Quality Index (B-PSQI) in a shift workers sample. In total, 443 Chinese male sailors were recruited, of whom 46.95% (n = 208) were watchstanding sailors on 18-hr working schedule at sea. All participants completed the B-PSQI, the Insomnia Severity Index (ISI), the Self-Rating Depression Scale, and Self-Rating Anxiety Scale before and after a 30-day saling. Forty watchstanding sailors were selected to wear wrist actigraphy throughout the sailing. The results showed that the B-PSQI had acceptable internal consistency reliability in different sailor groups. Confirmatory factor analysis showed optimal fit of the single-factor model of the B-PSQI in different sailor groups. Furthermore, scalar invariance between watchstanding and day-working sailors was supported, as well as longitudinal scalar invariance across time. In addition, receiver operating characteristic analysis showed that the B-PSQI yields high discrimination power to detect poor sleep quality using ISI ≥ 8 criterion. However, a lack of intermethod agreement across the B-PSQI and actigraphy was found in this study. Moreover, the total scores of B-PSQI were positively related to depression and anxiety symptoms in the present sample. The B-PSQI is a reliable and valid sleep quality measure and a useful screening tool for sleep disorders among Chinese male sailors. (PsycInfo Database Record (c) 2023 APA, all rights reserved).