Longitudinal Invariance Research Articles

Longitudinal assessment of the temporal stability and predictive validity of the Revised Paranormal Belief Scale.

The Revised Paranormal Belief Scale (RPBS) is the prevailing measure of supernatural credence. However, there exists only limited evidence to support the temporal stability and predictive validity of the instrument over time. Acknowledging this, the present study assessed the test-retest reliability of the RPBS using a large, heterogeneous sample across multiple trials. In addition, predictive validity was tested using a longitudinal statistical model, which focused on allied health outcomes (Perceived Stress and Somatic Complaints). A sample of 1,665 (M age = 54.40, 853 females, 804 males, five non-binary and three not disclosing of gender) completed study measures at three time points separated by 2 month intervals. Prior to assessing temporal stability, assessment of structural validity and longitudinal invariance occurred. Test-retest reliability of the RPBS was in the moderate to high range across time intervals, and good internal consistency was observed. Furthermore, satisfactory stability coefficients existed for RPBS subfactors. Data-model fit for the predictive model was acceptable. Belief in the paranormal explained low variance over time in Perceived Stress and Somatic Complaints (between 2.4 and 4.2%). Findings supported the stability and reliability of the RPBS. In addition, they aligned with the notion that paranormal belief in the absence of high scores on cognitive-perceptual factors (e.g. transliminality and schizotypy), has a benign influence on perceived health.

Longitudinal Measurement Invariance of the Depression Anxiety Stress Scale (DASS-21) in Filipino Adolescents

The Depression Anxiety and Stress Scale-21 (DASS-21) is a commonly used screener of mental health symptoms, and researchers continue to study the scale’s psychometric properties in different cultures and age groups. We tested the longitudinal measurement invariance of the DASS-21 across two time points on a sample of 312 Filipino adolescents. The confirmatory factor analysis indicated adequate fit between the hypothesized three-factor solution and the data from the adolescent sample. The DASS-21 also exhibited strict longitudinal invariance, and the subscales also displayed adequate reliability in the two time points. The results are the first demonstration of longitudinal invariance with a Filipino sample and provide evidence that DASS-21 can be useful in both screening and in monitoring severity of different categories of symptoms over time, particularly among school-based Filipino youth.

Supplemental Material for Confirmatory Measurement Modeling and Longitudinal Invariance of the CompACT-15: A Short-Form Assessment of Psychological Flexibility

Supplemental Material for Confirmatory Measurement Modeling and Longitudinal Invariance of the CompACT-15: A Short-Form Assessment of Psychological Flexibility

Longitudinal measurement invariance of the meaning in life questionnaire in Chinese college students.

The Meaning in Life Questionnaire (MLQ) is a popular tool to measure the presence of and one's search for meaning in life. Although the validity of the MLQ has been verified in previous studies, the evidence from longitudinal measurement invariance (LMI) of the MLQ is still lacking. The current study aimed to examine the LMI of the MLQ in a sample of Chinese college students (N = 328) at a 1-year interval. Multigroup confirmatory factor analysis (MCFA) was used to examine the LMI of the MLQ over four time points (over the course of 1 year). Results indicate that the MLQ has strict longitudinal invariance across 1-year in Chinese college students, and the latent means difference of MLQ-P is not significant differences across time, while the latent means difference of MLQ-S show significant differences between Time 1 and the other time points. Moreover, the internal consistency reliabilities (e.g., alpha and omega) of the MLQ scores were acceptable at all four time points, and the stability coefficients across time were moderate. These findings provide preliminary evidence that the MLQ has satisfactory longitudinal properties in Chinese college students.

Longitudinal Invariance of the Strengths and Difficulties Questionnaire Across Ages 4 to 16 in the ALSPAC Sample.

The Strengths and Difficulties Questionnaire (SDQ) has been widely used to study children's psychosocial development longitudinally; however, such analyses assume longitudinal measurement invariance, that is, they presuppose that symptom manifestations are measured comparably across different ages. Violations of this assumption could bias longitudinal analyses and should therefore be empirically tested. This study tested longitudinal measurement invariance within a confirmatory factor analysis framework in the U.K.-based Avon Longitudinal Study of Parents and Children (N = 13,988). Results indicated that SDQ scores showed configural, metric, scalar, and residual invariance across ages 7, 8, 9, 11, 13, and 16, supporting its use for comparing variances, covariances, and means over time within a latent variable model as well as using observed scores. At age 4, configural invariance was not supported, indicating that mental health symptoms as measured by the SDQ manifest differently at this age, thus necessitating caution when comparing symptoms as measured by SDQ scores at this age to later ages.

Factor structure and measurement invariance of the Chinese version of the COVID-19 Phobia Scale in depressive symptoms sample during COVID-19 closure: An exploratory structural equation modeling approach.

The COVID-19 Phobia Scale is an instrument for measuring the phobia of coronavirus. It has a stable four-factor structure and good reliability and validity in other countries and regions. In order to expand related research, this study aims to test the reliability and validity of the COVID-19 Phobia Scale in Chinese adolescents with depressive symptoms. The C19P-SC was translated into Chinese by the method of forward and back translation and tested in 1933 Chinese adolescents with depressive symptoms. Confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) were used to test and compare the four-factor model of the C19P-SC. Then we tested the measurement invariance of the C19P-SC across gender and time. Finally, the reliability was measured with the McDonald's omega coefficients. Consistent with previous studies, the C19P-SC showed a stable four-factor structure. The results showed that ESEM was better than CFA and more reasonable. In addition, the results of multi-group ESEM showed that the C19P-SC met the strict invariance at male and female and partial longitudinal strict invariance. The Mcdonald's omega coefficients of the C19P-SC total scale and each subscale reached the expected acceptable level. In short, the reliability and validity index of C19P-SC has reached an acceptable level, and the measurement invariance of different genders and different time points was established, but the cross-factor phenomenon of individual items was abnormal, and a further revision and testing are still needed.

Testing gender and longitudinal measurement invariance of the SF-36 in American Indian older adults: The strong heart study.

Information about the equality of psychometric properties of the medical outcomes study (MOS) Short Form-36 (SF-36), a health status measure, across gender and across the lifespan for American Indian adults is lacking. We tested measurement invariance (configural, metric, scalar invariance) of the physical and mental components between gender and over time in a sample of 2,709 (1,054 men, 1,654 women) American Indian older adults at three time points, and across a 6-year time frame. Measurement invariance of a 2-factor higher-order model was demonstrated between gender at each time point. Tests of longitudinal invariance indicated longitudinal measurement invariance over time. Multiple-group latent means analysis indicated men had significantly higher physical and mental component latent means compared to women at each time point, and longitudinal latent means analysis found physical and mental component latent means decreased over time. The 2-factor higher-order model SF-36 is valid for American Indian older adults over a 6-year time frame. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Psychometric Validity of the Minnesota Tobacco Withdrawal Scale in Smokers Attempting to Quit: Longitudinal Invariance across Smokers and Abstainers

ABSTRACT Tobacco withdrawal symptoms vary during smoking cessation increasing relapse risk; therefore, a longitudinal invariant measure seems necessary to validly assess withdrawal changes. This study aimed to examine the psychometric properties of the 7-item Minnesota Tobacco Withdrawal Scale (MTWS) during cessation, and to analyze longitudinal invariance across smokers and abstainers. We conducted a longitudinal study with 309 Spanish smokers (56.2 ± 9.9 years; 52.4% women). We assessed withdrawal at three occasions: pre-treatment (T1), week-12 (T2), and week-24 (T3). Reliability, validity, and invariance analyses were performed. MTWS reliability remained adequate over time (ωT1 = 0.78; ωT2 = 0.68; ωT3 = 0.80) in both smokers and abstainers, with satisfactory temporal stability (ICC = 0.73). MTWS correlations with anxiety, depression, and nicotine dependence (rs > 0.3) supported convergent and concurrent validity. MTWS showed no correlation with craving at T2 (rs < 0.24), suggesting discriminant validity. Unifactorial structure proved partial scalar invariance across time (χ2 = 246.009; CFI = 0.91; IFI = 0.91; SRMR = 0.09), yet longitudinal invariance between abstainers and smokers was not supported. Across groups, partial scalar invariance was only achieved at T2. Noninvariance at T3 was mainly due to item irritability (d MACS = 0.93). The MTWS is reliable and valid measure to assess withdrawal changes during cessation. Long-term MTWS comparisons between smokers and abstainers should be taken with caution since different withdrawal patterns may exist.

The North Italian Longitudinal Study Assessing the Mental Health Effects of SARS-CoV-2 Pandemic Health Care Workers-Part II: Structural Validity of Scales Assessing Mental Health.

It is unclear if the factor structure of the questionnaires that were employed by studies addressing the impact of COVID-19 on the mental health of Healthcare Workers (HCW) did not change due to the pandemic. The aim of this study is to assess the factor structure and longitudinal measurement invariance of the Maslach Burnout Inventory (MBI) and the factor structure of the General Health Questionnare-12 (GHQ-12), PTSD Checklist for DSM-5-Short Form (PCL-5-SF), Connor-Davidson Resilience Scale-10 (CD-RISC-10) and Post-Traumatic Growth Inventory-Short Form (PTGI-SF). Out of n = 805 HCWs from a University hospital who responded to a pre-COVID-19 survey, n = 431 were re-assessed after the COVID-19 outbreak. A Confirmatory Factor Analysis (CFA) on the MBI showed adequate fit and good internal consistency only after removal of items 2, 6, 12 and 16. The assumptions of configural and metric longitudinal invariance were met, whereas scalar longitudinal invariance did not hold. CFAs and exploratory bifactor analyses performed using data from the second wave confirmed that the GHQ-12, the PCL-5-SF, the PTGI-SF and the CD-RISC-10 were unidimensional. In conclusion, we found support for a refined version of the MBI. The comparison of mean MBI values in HCWs before and after the pandemic should be interpreted with caution.

Longitudinal invariance and validity of the Impact of Event Scale-Revised under COVID-19 pandemic in a Brazilian sample.

Although the Impact Event Scale-Revised is widely used, its factor structure is still controversial. In addition, its longitudinal measurement invariance (LMI) remains uninvestigated. In this sense, we carried out three studies to investigate its psychometric properties. In Study 1, we evaluated the factorial structure of the scale comparing the different models existing in the literature in Brazilian samples who responded to the instrument during the COVID-19 pandemic. In Study 2, we provide support for a five-factor model throughout convergent validity with psychological distress and sleep problems, and criterion validity between people with diagnostic of mental disorders. Finally, we evaluated the LMI over a 6-month interval. The results indicated that the five-factor model has excellent goodness of fit and holds strict longitudinal invariance. Additionally, internal consistency and stability coefficients indicate that the scale is appropriate to measure posttraumatic stress symptomatology) in nonclinical samples across multiple assessments. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Longitudinal Measurement Invariance of the Korean Version of the CES-D-11 Scale

The present study examined the longitudinal measurement invariance of the Korean version of the Center for Epidemiological Studies-Depression (CES-D) scale. For this purpose, two datasets from the Korean Welfare Panel Study were analyzed. Study 1 examined the data from the first four waves to determine the scale’s short-term longitudinal invariance. Study 2 extracted data every 3 years up to the 10th year, beginning with the first wave (waves 1, 4, 7, and 10) to examine the scale’s long-term longitudinal invariance. We analyzed 10,098 cases in Study 1 and 7,077 cases in Study 2. The results of Study 1 revealed that the scale had strict or residual measurement invariance, whereas the results of Study 2 indicated that the scale had strong or scalar measurement invariance. Overall, the Korean version of the CES-D-11 scale was shown to be a valid measure of depression that can be used to evaluate symptom changes over time.

A longitudinal assessment of the stability of the three-dimensional moral self-concept during early childhood

ABSTRACT Moral self-concept (MSC) is an important aspect of human morality and emerges in early childhood. It indicates how early children view themselves as moral agents. Yet, its structure and developmental patterns are unclear and require more research. This study addresses if the multidimensional structure of MSC is stable during early childhood and if the dimensions are differentiating over early to middle childhood. We explored the structure of MSC by testing a three-dimensional CFA model, its longitudinal invariance, reliability and correlational structure. Using a three-wave longitudinal sample (N = 133) of children aged between four to six years at T1, we found evidence for a stable three-dimensional MSC model, including the dimensions helping, sharing and comforting.

Sense of personal agency in adolescence and young adulthood: A preliminary assessment model

Although there is a growing interest in the concept of sense of personal agency in adolescence and young adulthood, its operationalization and assessment have been inconsistent. We propose and test a preliminary assessment model of sense of agency combining four of the most relevant indicators suggested by the literature for its assessment (setting goals, optimism, decision-making, and self-efficacy). We conducted three independent studies with young adults [study 1 = 692; study 2 = 410] and adolescents [study 3 = 481] to analyze its psychometric properties. The CFA results revealed a good fit to the data in all three studies. The results of studies 1 and 2 indicate that even though the four dimensions share a significant proportion of variance, they do not assess the overlapping aspects of sense of agency. The findings of study 1 clarified that the proposed measurement model is invariant across sex and different levels of psychosocial risk. The results of study 2 suggest that, as expected, the latent construct of sense of agency is linked to different dimensions of psycho-emotional adjustment of young adults. Lastly, the findings of study 3 revealed that our preliminary model is invariant across three assessment points establishing the measurement longitudinal invariance.

The General Academic Self-Efficacy Scale: Psychometric Properties, Longitudinal Invariance, and Criterion Validity

Academic self-efficacy (ASE) refers to a student’s global belief in his/her ability to master the various academic challenges at university and is an essential antecedent of wellbeing and performance. The five-item General Academic Self-Efficacy Scale (GASE) showed promise as a short and concise measure for overall ASE. However, of its validity and reliability outside of Scandinavia is limited. Therefore, this paper aimed to investigate the psychometric properties, longitudinal invariance, and criterion validity of the GASE within a sample of university students (Time 1: n = 1056 &amp; Time 2: n = 592) in the USA and Western Europe. The results showed that a unidimensional factorial model of overall ASE fitted the data well was reliable and invariant across time. Further, criterion validity was established by finding a positive relationship with task performance at different time stamps. Therefore, the GASE can be used as a valid and reliable measure for general ASE.

Psychometric Properties and Measurement Invariance of the Childhood Trauma Questionnaire (Short Form) Across Genders, Time Points and Presence of Major Depressive Disorder Among Chinese Adolescents.

PurposeThe Childhood Trauma Questionnaire-Short Form (CTQ-SF) is a widely used self-report tool designed to assess juveniles’ experiences of abuse and neglect. The current study examined the psychometric properties, particularly measurement invariance of the CTQ-SF in Chinese non-clinical adolescents and adolescents with major depressive disorder (MDD).MethodsParticipants included 1,507 high school students (non-clinical sample) from Hunan Province and 281 adolescent patients with major depressive disorder (MDD sample) from The Second Xiangya Hospital. We examined the reliability and validity of CTQ-SF, confirm the five-factor model of the CTQ-SF. Multiple-group confirmatory factor analysis (CFA) was used to examine the measurement invariance across genders, presence of depression, and over time.ResultsThe CTQ-SF had good internal consistency in a non-clinical sample (Cronbach’s α = 0.85) and MDD sample (Cronbach’s α = 0.86). Good test–retest reliability (ICC = 0.72) and Adequate validity were also observed. Good fit of the five-factor CTQ-SF model was confirmed in both samples. Multiple-group CFA confirmed that the CTQ-SF had the scalar invariance across genders and the presence of MDD, as well as over time.ConclusionThe CTQ-SF is an effective and reliable tool for assessing child maltreatment in Chinese adolescents (non-clinical sample and MDD sample). The results suggest that the horizontal and longitudinal invariance of CTQ-SF are strongly established, which means CTQ-SF can be meaningfully used to compare outcomes among Chinese adolescents (non-clinical sample and MDD sample). The experience of child maltreatment, especially neglect (emotional and physical), was found to be common in Chinese adolescents.

Weight stigma in patients with overweight and obesity: validation of the Italian Weight Self-Stigma Questionnaire (WSSQ)

PurposeThis study aimed to explore the factorial structure of the Italian Weight Self-Stigma Questionnaire (WSSQ) (Study1); and to test structural validity, internal consistency, test–retest reliability, and measurement invariance of the questionnaire across gender, Body Mass Index (BMI), age and occurrence of previous hospitalization for obesity (Study2).MethodsAt admission into a hospital-based program for weight reduction and rehabilitation, 150 inpatients with overweight/obesity (68% females) completed the WSSQ (Study1). In Study2, in addition to the WSSQ, 446 inpatients (61.9% females) completed the Weight Bias Internalization Scale (WBIS), the Body Uneasiness Test (BUT), and the Center for Epidemiologic Studies Depression Scale (CES-D). A subsample of 40 patients also re-completed the WSSQ at discharge from the hospital.ResultsThe Italian WSSQ showed good overlap with the original factorial structure (Study1) and results were confirmed in Study2. Test–retest reliability and convergent validity showed adequate values. Measurement invariance revealed that WSSQ was perfectly invariant across both BMI and the occurrence of previous hospitalizations for obesity. In both studies, the internal consistency of the questionnaire was deemed acceptable.ConclusionsThe Italian WSSQ is a valid, reliable, and invariant tool for the assessment of weight-related self-stigma among patients with overweight/obesity. Future studies should assess its longitudinal invariance as well as its responsiveness to weight reduction treatments.Level of evidenceV, descriptive study.

Longitudinal bifactor modeling of anxiety, depression and schizotypy - The role of rumination as a shared mechanism

A bifactor model with a general (p) factor reflecting shared variance and specific factors reflecting additional variance in individual symptoms has been introduced to explain common co-occurrence among anxiety, depression and schizotypy. However, longitudinal evidence is lacking and the validity of bifactor modeling is debatable. The current study aimed to examine the presence of the p factor together with specific factors in accounting for relationships between anxiety, depression and schizotypy both cross-sectionally and longitudinally, and to investigate the relationship between these factors and rumination. A validated sample of university students were surveyed on levels of anxiety, depression, schizotypy and rumination at baseline (N = 2291), one year (N = 1833) and two years (N = 1656). Models were estimated using exploratory structural equation modeling (ESEM) and compared at each time point. Longitudinal invariance of the best-fitting model was examined and all potential within- and between-factor stability pathways were tested in an SEM framework. A bifactor model with a p factor and four specific factors (representing residual information of composite anxiety and depression, cognitive-perceptual, interpersonal and disorganized schizotypy respectively) consistently outperformed a correlated-factors model. The bifactor structure appeared longitudinally stable. Within-factor stabilities were moderate, and between-factor pathways reflected a few significant interactions, mostly involving the p factor. Rumination was independently associated with p and four specific factors at each time point. Therefore, there is a p factor accounting for concurrent and sequential co-occurrence of anxiety, depression and schizotypy. Rumination explained partly the p and specific factors. Transdiagnostic interventions should target rumination.

Longitudinal measurement invariance of the Behavioral Health Measure in a clinical sample.

The practice of routine outcome monitoring (ROM) has grown in popularity and become a fixture in feedback-supported clinical practice and research. However, if the interpretation of an ROM measure changes over time, treatment outcome scores may be inaccurate and produce erroneous or misguided interpretations of client progress and therapist efficacy. The current study examined whether factorial invariance held when using the Behavioral Health Measure (BHM-20) longitudinally in a clinical sample (n = 12,467). Using multidimensional item response theory-based models for the investigation of the BHM-20 factor structure, at a single time point and then longitudinally. Based on the original factor structure of the BHM-20 a unidimensional model, a three-factor orthogonal model, and a three-factor correlated model were fit to the data, indicating poor model fit with the proposed three-factor or unidimensional models. Next, using exploratory factor analysis and subsequent multidimensional item response theory procedures, a new 4-factor (General Distress, Life Functioning, Anxiety, and Alcohol/Drug Use) model was proposed with improved model-fit statistics. Finally, when testing the longitudinal invariance of the BHM-17 over 10 sessions of treatment, it was found to be fully consistent. The current study proposes the use of a 17-item, 4-factor model for a new understanding of the BHM-17. Implications for use in ROM and limitations are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Longitudinal Factorial Invariance of a Brief Measure of Affect and Calm Focus.

Mindfulness-based practices for school-aged children are increasingly common in the United States. Positive and negative affect are theoretically and empirically associated with school outcomes, and these constructs are likely to be impacted by school-based mindfulness practices. Furthermore, mindful states, such as being calm and focused, targeted by mindfulness-based practices are a potential causal mechanism to improve learning and behavior. This study describes a test of longitudinal factorial invariance for a brief measure of affect states plus a state of calm focus that is appropriate for use in mindfulness intervention studies with elementary school-aged children. Data were collected from 97 fourth-grade students in an urban elementary school that was about 46% Hispanic and 44% White. Students listened to one of six different conditions each day for 24 school days: There were four individual mindfulness modules (cross-connect, pause buttons, belly breathing, and mindful minute), one condition that included all four of the modules together, and one condition that was a control activity (a grade-appropriate story presented via audiorecording). Students provided self-report of positive and negative emotions plus calm focus immediately before and after the presentation of the audio. Results showed high levels of internal consistency for the scales, low correlations between scales, and factorial invariance in the pre- and post-test design for five of the six conditions. These findings support the use of this measure in studies with older elementary school students. Future studies should further document construct validity through external validation of the scales.

The validity of the higher-order structure of effortful control as defined by inhibitory control, attention shifting, and focusing: A longitudinal and multi-informant study.

Effortful control (EC) has been conceptualized as a higher-order construct defined by a class of self-regulatory mechanisms. However, the developmental higher-order structure of EC has seldom been investigated with a thorough psychometric analysis. To begin to fill this gap in the literature, data were obtained from parents and teachers of 185 children (age at T1: M=9.43 y/o, SD=1.17) every 2years for 8years. We used a structural equation modeling approach for assessing if EC develops as a higher-order factor superordinate to three commonly studied self-regulatory mechanisms, namely inhibitory control (IC), attention focusing (AF), and attention shifting (AS). Results showed that (a) IC, AF, and AS followed a similar pattern of growth, (b) EC displayed an acceptable degree of scalar longitudinal invariance when operationalized as a latent variable indicated by IC, AF, and AS, (c) a higher-order structure explained the co-development of IC, AF, and AS, and (d) stability and change in EC negatively predicted externalizing symptoms, much better than the stability and change of IC, AF, and AS, but only for parents' reports. Overall, the higher-order structure of EC was supported, but our results also indicated that there is a certain degree of uniqueness in its facets.