Single Latent Dimension Research Articles

A cross-national investigation of psychosis-like experiences in five European countries included in the E-CLECTIC study: Psychometric challenges in studying their measurement

BackgroundPsychotic-like experiences (PLEs) are subtle, subclinical perturbations of perceptions and thoughts and are common in the general population. Their characterisation and unidimensionality are still debated. MethodsThis study was conducted by the Electronic–halluCinations-Like Experiences Cross-culTural International Consortium (E-CLECTIC) and aimed at measuring the Community Assessment of Psychic Experiences (CAPE) factorial structure across five European countries (Belgium; Czech Republic, Germany; Greece, and Spain) and testing the adequacy of the unidimensional polytomous Rasch model of the tool via Partial Credit Model (PCM) of the CAPE to detect people with a high risk for developing psychosis. ResultsThe sample included 1461 participants from the general population. The factorial analysis confirmed the best fit for the bifactor implementation of the three-factor model, including the positive, negative and depressive dimensions and a general factor. Moreover, the unidimensional polytomous Rasch analysis confirmed that CAPE responses reflected one underlying psychosis proneness. ConclusionsThe study proved that the CAPE measures a single latent dimension of psychosis-proneness. The CAPE might help locate and estimate psychosis risk and can be used as a screening tool in primary care settings/education settings.

Interpretable Latent Space for Meteorological Out-of-Distribution Detection via Weak Supervision

Deep neural networks (DNNs) are effective tools for learning-enabled cyber-physical systems (CPSs) that handle high-dimensional image data. However, DNNs may make incorrect decisions when presented with inputs outside the distribution of their training data. These inputs can compromise the safety of CPSs. So, it becomes crucial to detect inputs as out-of-distribution (OOD) and interpret the reasons for their classification as OOD. In this study, we propose an interpretable learning method to detect OOD caused by meteorological features like darkness, lightness, and rain. To achieve this, we employ a variational autoencoder (VAE) to map high-dimensional image data to a lower-dimensional latent space. We then focus on a specific latent dimension and encourage it to classify different intensities of a particular meteorological feature in a monotonically increasing manner. This is accomplished by incorporating two additional terms into the VAE’s loss function: a classification loss and a positional loss. During training, we optimize the utilization of label information for classification. Remarkably, our results demonstrate that using only 25% of the training data labels is sufficient to train a single pre-selected latent dimension to classify different intensities of a specific meteorological feature. We evaluate the proposed method on two distinct datasets, CARLA and Duckietown, employing two different rain-generation methods. We show that our approach outperforms existing approaches by at least 15 in the F1 score and precision when trained and tested on CARLA dataset.

Identification of a Composite Latent Dimension of Reward and Impulsivity Across Clinical, Behavioral, and Neurobiological Domains Among Youth

BackgroundIndividual differences in reward processing are central to heightened risk-taking behaviors during adolescence, but there is inconsistent evidence for the relationship between risk-taking phenotypes and the neural substrates of these behaviors. MethodsHere, we identify latent features of reward in an attempt to provide a unifying framework linking together aspects of the brain and behavior during early adolescence using a multivariate pattern learning approach. Data (N = 8295; n male = 4190; n female = 4105) were acquired as part of the Adolescent Brain Cognitive Development (ABCD) Study and included neuroimaging (regional neural activity responses during reward anticipation) and behavioral (e.g., impulsivity measures, delay discounting) variables. ResultsWe revealed a single latent dimension of reward driven by shared covariation between striatal, thalamic, and anterior cingulate responses during reward anticipation, negative urgency, and delay discounting behaviors. Expression of these latent features differed among adolescents with attention-deficit/hyperactivity disorder and disruptive behavior disorder, compared with those without, and higher expression of these latent features was negatively associated with multiple dimensions of executive function and cognition. ConclusionsThese results suggest that cross-domain patterns of anticipatory reward processing linked to negative features of impulsivity exist in both the brain and in behavior during early adolescence and that these are representative of 2 commonly diagnosed reward-related psychiatric disorders, attention-deficit/hyperactivity disorder and disruptive behavior disorder. Furthermore, they provide an explicit baseline from which multivariate developmental trajectories of reward processes may be tracked in later waves of the ABCD Study and other developmental cohorts.

Design and Validation of a New Tennis-Specific Reactive Agility Test-A Pilot Study.

Agility is an important ability for tennis players, but there is an evident lack of studies focusing on the applicability of tennis-specific agility tests that capture a combination of the physical and cognitive agility performance. Therefore, the main aim of this study was to design and test measurement properties of the tennis-specific reactive agility test that would be feasible and practical for regular implementation. A total of 32 youth tennis players (21 males and 11 females; 10.85 ± 1.50 years) participated in this study. The measurement characteristics of the newly designed reactive agility tennis-specific (TS-RAN) test have been established by comparing it with two generic agility tests and with two tennis-specific pre-planned agility tests. The overall reliability of the new TS-RAN test can only be considered “moderate to good”, as although the results of participants showed good internal consistency, the within-subject reliability of the test proved to be unsatisfactory, since the participants showed a lack of performance consistency. This is not unexpected considering the very young age of the participants who performed the test for the very first time. The new TS-RAN test was highly projected (0.91) on the same single latent dimension, with the variance predominately explained by the tennis-specific agility tests. The test’s greatest strength is its high feasibility, since the test does not require any special set-up nor technical equipment, and that makes it practical for regular implementation in a practical setting. Further research studies are needed in order to confirm the test’s potential to be widely accepted and used.

Revising Substance-Related Disorders in the DSM-5: A History

This article narrates a history of several important changes to the substance-related disorders chapter in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5), based on interviews with people involved in the pre-planning and the development of the revisions. These changes include collapsing substance abuse and substance dependence into a single substance use disorder, adding craving as a diagnostic criterion, and incorporating a behavioral addiction--gambling disorder--into the substance-related disorders chapter. Studies using Item Response Theory (IRT) supported the new substance use disorder diagnosis. The IRT analyses demonstrated that the abuse and dependence items can be ordered on a single latent dimension and that some of the presumably milder abuse items indexed a greater level of severity than the presumably more pathological dependence items. Those who opposed collapsing abuse and dependence emphasized the validity and clinical utility of the dependence syndrome on which much important treatment research was based. Both those who favored and those who opposed adding craving agreed that it was redundant with the other diagnostic criteria and did not improve the performance of the criterion set. Nevertheless, some clinicians supported adding craving because of its importance in the conceptualization of substance use disorders, and some researchers supported it because of its potential to be validated as a diagnostically useful biomarker. Those who opposed adding craving argued that considering the validity of an individual criterion alone rather than its contribution to the incremental validity of the criterion set represented a major shift in diagnostic philosophy that had potentially far-reaching implications for future revisions of the DSM. We conclude by observing that, unlike what occurred in the broader DSM-5 process, despite differences of opinion the work group reached consensus. In part, this may be explained by some shared standards within the work group versus the disagreement about standards across the broader DSM-5 process.

Alcohol and Drug Use Screening among Justice-Involved Persons

ABSTRACT (a) Objective: This study examined the reliability and validity of the Texas Risk Assessment System (TRAS) alcohol and drug use screeners. (b) Method: We examined internal consistency, inter-item correlations, and used confirmatory factor analysis (CFA), and item response theory (IRT) to assess item-specific information regarding a single latent dimension of substance use severity. (c) Results: Results supported the TRAS alcohol and drug screeners to measure a single dimension of alcohol and drug use severity. More specifically, the instruments appear to be effective screeners of moderate to severe alcohol use problems, and thus effective screeners for referral for further assessment and possible treatment. (d) Conclusions: Treatment can only be provided for problems that are well defined and diagnosed. Continuing evaluation of substance abuse screeners and assessment is important, especially for justice-involved persons. Effective screeners can lead to more people getting needed assessment and treatment. Recommendations were to drop one item on each screener due to redundancy.

A Critical Evaluation of the Reflective Functioning Questionnaire (RFQ)

The Reflective Functioning Questionnaire (RFQ) is an 8-item self-report measure of reflective functioning that is presumed to capture individual differences in hypo- and hypermentalizing. Despite its broad acceptance by the field, we argue that the validity of the measure is not well-established. The current research elaborates on problems of the RFQ related to its item content, scoring procedure, dimensionality, and associations with psychopathology. We tested these considerations across three large clinical and non-clinical samples from Germany and the US (total N = 2289). In a first study, we found that the RFQ may assess a single latent dimension related to hypomentalizing but is rather unlikely to capture maladaptive forms of hypermentalizing. Moreover, the RFQ exhibited very strong associations with measures of personality pathology, while associations with measures of symptom distress were less strong. In a second preregistered study focused on convergent and discriminant validity, however, a commonality analysis indicated that associations with indicators of personality pathology are inflated because some of the RFQ items tap into emotional lability and impulsivity rather than mentalizing. Our findings demonstrate limitations of the RFQ. We discuss key challenges in assessing mentalizing via self-report.

The bright side of personality

The article addresses the question, which personality dimensions mostly contribute to the positive human functioning, especially to wellbeing and prosocial values. As we predicted, the three dimensions from the Big Five factors are mostly opposed to the negative personality characteristics known as Dark Triad (narcissism, Machiavellianism and psychopathy), namely emotional stability (low neuroticism), agreeableness and conscientiousness. The results demonstrated negative relationship between these personality dimensions (labeled Bright Triad) and Dark Triad. Both Dark and Bright Triad dimensions are substantially loaded with one single bipolar latent dimension, the Dark versus Bright Personality. The results also confirmed the substantial connections of the Bright Triad dimensions to the wellbeing and the values. The Bright Triad dimensions are positively associated with general life satisfaction and traditional, social, cognitive and democratic values and tend to be negatively associated with status or power values. On the other side, Dark Triad dimensions are positively related to the status values and tend to be negatively related to the prosocial values.

The p Factor Consistently Predicts Long-Term Psychiatric and Functional Outcomes in Anxiety-Disordered Youth

Pediatric anxiety disorders can have a chronic course and are considered gateway disorders to adult psychopathology, but no consistent predictors of long-term outcome have been identified. A single latent symptom dimension that reflects features shared by all mental health disorders, the p factor, is thought to reflect mechanisms that cut across mental disorders. Whether p predicts outcome in youth with psychiatric disorders has not been examined. We tested whether the p factor predicted long-term psychiatric and functional outcomes in a large, naturalistically followed-up cohort of anxiety-disordered youth. Children and adolescents enrolled in a randomized controlled treatment trial of pediatric anxiety were followed-up on average 6 years posttreatment and then annually for 4 years. Structural equation modeling was used to estimate p at baseline. Both p and previously established predictors were modeled as predictors of long-term outcome. Higher levels of p at baseline were related to more mental health disorders, poorer functioning, and greater impairment across all measures at all follow-up time points. p Predicted outcome above and beyond previously identified predictors, including diagnostic comorbidity at baseline. Post hoc analyses showed that p predicted long-term anxiety outcome, but not acute treatment outcome, suggesting that p may be uniquely associated with long-term outcome. Children and adolescents with anxiety disorders who present with a liability toward broad mental health problems may be at a higher risk for poor long-term outcome across mental health and functional domains. Efforts to assess and to address this broad liability may enhance long-term outcome.

Why is logic so likeable? A single-process account of argument evaluation with logic and liking judgments.

Four experiments examined the claims that people can intuitively assess the logical validity of arguments, and that qualitatively different reasoning processes drive intuitive and explicit validity assessments. In each study participants evaluated arguments varying in validity and believability using either deductive criteria (logic task) or via an intuitive, affective response (liking task). Experiment 1 found that people are sensitive to argument validity on both tasks, with valid arguments receiving higher liking as well as higher deductive ratings than invalid arguments. However, the claim that this effect is driven by logical intuitions was challenged by the finding that sensitivity to validity in both liking and logic tasks was affected in similar ways by manipulations of concurrent memory load (Experiments 1 and 2) and variations in individual working memory capacity (Experiments 3 and 4). In both tasks better discrimination between valid and invalid arguments was found when more working memory resources were available. Formal signal detection models of reasoning were tested against the experimental data using signed difference analysis (Stephens, Dunn, & Hayes, 2018b). A single-process reasoning model which assumes that argument evaluation in both logic and liking tasks involves a single latent dimension for assessing argument strength but different response criteria for each task, was found to be consistent with the data from each experiment (as were some dual-process models). The experimental and modeling results confirm that people are sensitive to argument validity in both explicit logic and affect rating tasks, but that these results can be explained by a single underlying reasoning process. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Validation of a Measure of STEM Interest for Adolescents

Students’ declining performance in science and mathematics is an issue of great international concern. Recently, educators and researchers have begun to focus on affective factors such as interest to better understand STEM learning and persistence. Therefore, there is a need for effective measures of STEM interest that allow it to be tracked over time and to provide opportunities for early interventions by educators. One such instrument was recently developed to measure youth interest in STEM as a general construct and in four domains associated with STEM: earth and space science, life science, technology and engineering, and mathematics. In this paper, we explore the psychometric properties of the measure scales by administering the instrument to a large sample of youth from both a traditional and STEM-focused school and examining theorized relationships using confirmatory factor analysis as part of a larger structural equation model. Results provided support for a single latent dimension of STEM interest, confirmed the existence of the four individual STEM interest dimensions, and provided evidence of structural and generalizability validity. We conclude that the instrument provides a sufficient means to measure STEM interest for adolescent youth within a variety of populations and educational contexts.

Changes in General and Specific Psychopathology Factors Over a Psychosocial Intervention.

Recent research suggests that comorbidity in child and adolescent psychiatric symptoms can be summarized by a single latent dimension known as the p factor and more specific factors summarizing clusters of symptoms. This study investigated within- and between-person changes in general and specific psychopathology factors over a psychosocial intervention. A secondary analysis was conducted of the Systemic Therapy for At-Risk Teens study, a pragmatic randomized controlled trial that compared the effects of multisystemic therapy with those of management as usual for decreasing antisocial behavior in 684 adolescents (82% boys; 11-18 years old at baseline) over an 18-month period. The general p factor and specific antisocial, attention, anxiety, and mood factors were estimated from a symptom-level analysis of a set of narrowband symptom scales measured repeatedly during the study. General and specific psychopathology factors were assessed for reliability, validity, and within- and between-person change using a parallel process multilevel growth model. A revised bi-factor model that included a general p factor and specific anxiety, mood, antisocial, and attention factors with cross-loadings fit the data best. Although the factor structure was multidimensional, the p factor accounted for most of the variance in total scores. The p factor, anxiety, and antisocial factors predicted within-person variation in external outcomes. Furthermore, the p factor and antisocial factors showed within-person declines, whereas anxiety showed within-person increases, over time. Despite individual variation in baseline factor scores, adolescents showed similar rates of change. The bi-factor model is useful for teasing apart general and specific therapeutic changes that are conflated in standard analyses of symptom scores. START (Systemic Therapy for At Risk Teens): A National Randomised Controlled Trial to Evaluate Multisystemic Therapy in the UK Context; http://www.isrctn.com; ISRCTN77132214.

Reading Ability and Quality of Life in Stargardt Disease.

To study the reading performance of patients with Stargardt disease (STGD) and the relationship between clinical vision measurements and vision-related quality of life (VRQOL). We studied both eyes of 16 patients with STGD. Each patient was examined for best-corrected visual acuity (Early Treatment Diabetic Retinopathy Study [ETDRS]), reading ability (MNREAD and REX charts), contrast sensitivity (Pelli-Robson charts), fixation study (MP1 microperimeter), and VRQOL (25-item National Eye Institute Visual Function Questionnaire [NEI VFQ-25]). The correlation pattern among these variables was examined and an exploratory factor analysis was used to investigate dimensionality of both visual function and VRQOL. Mean ETDRS visual acuity was about 20/160 (0.9 logMAR). All studied psychophysical measures were highly or moderately correlated with MNREAD reading speed (p<0.05 level). A similar correlation was found between psychophysical measures and VRQOL, which was higher for MNREAD measures of acuity (r = -0.75) and speed (r = 0.74). Accordingly, exploratory factor analysis suggested that a single latent dimension explained most of the variance of vision psychophysical measures as well as of VRQOL. We propose that reading ability should be assessed in patients with STGD, since we found that both MNREAD reading speed and visual acuity are strong determinants of quality of life. The observed relation between reading ability and VRQOL in STGD suggests that in these patients appropriate low vision rehabilitation can improve both reading performance and consequently VRQOL. Finally, our data support the use of reading speed and visual acuity as important outcome measures for monitoring STGD progression.

The recovery index: A novel approach to measuring recovery and predicting remission in major depressive disorder

BackgroundClinicians view “recovery” as the reduction in severity of symptoms over time, whereas patients view it as the restoration of premorbid functioning level and quality of life (QOL). The main purpose of this study is to incorporate patient-reported measures of functioning and QOL into the assessment of patient outcomes in MDD and to use this data to define recovery. MethodUsing the STAR*D study of patients diagnosed with MDD, this present analysis grades patients' MDD severity, functioning level, and QOL at exit from each level of the study, as well as at follow-up. Using Item Response Theory, we combined patient data from functioning and QOL measures (WSAS, Q-LES-Q) in order to form a single latent dimension named the Recovery Index. ResultsRecovery Index – a latent measure assessing impact of illness on functioning and QOL – is able to predict remission of MDD in patients who participated in the STAR*D study. ConclusionsBy incorporating functioning and quality of life, the Recovery index creates a new dimension towards measuring restoration of health, in order to move beyond basic symptom measurement.

Assessing Conflict Management in the Couple

Weak management of interpersonal conflicts can lead to dysfunctional relationships with relevant consequences for couple and family well-being. Our purpose was to devise a single dimension scale to assess conflict management in romantic relationships. We focused on five relevant conflict aspects: competition, collaboration, avoidance, accommodating attitude, and compromise. Study 1 ( N = 405) confirmed the existence of a single latent dimension, which was defined as the Conflict Management Scale (CMS), and consists of 8 items unbiased by gender. In Study 2 ( N = 205), the CMS convergent validity with attachment, empathic self-efficacy, satisfaction, and decision-making in the couple was analyzed. In Study 3 ( N = 120), the CMS was administered to 60 heterosexual couples in order to further examine the validity of the newly developed single dimension scale. Results showed that the CMS might be considered a valid and handy tool for planning couple and family therapies.

The utility of set-loss error scores in the general population.

Although the measurement of cognitive performance usually relies on achievement sum scores, a growing body of research suggests that the analysis of errors made may have a predictive validity beyond that provided by the number of items correct. This study examined the validity related to one such kind of error scores--the set-loss errors--in the general population of 8- to 11-year-old children. Set-loss errors (also called rule violations) can be conceptualized as a breakdown in the adherence to task-specific rules, and in clinical populations, the propensity to make these errors has shown some specificity for identifying disorders connected with frontal lobes dysfunction. The results, however, indicate that set-loss errors derived from distinct tests could not be effectively explained by a single latent dimension; hence, they do not tap a single construct that could be called set loss or the ability to maintain set. At the same time, there were only few weak associations between various kinds of error scores as well as between the set-loss error scores and relevant constructs such as the ability to learn, attentional control, working memory, fluid and crystallized intelligence, and executive functions-related real-world behaviors, indicating an overrepresentation of construct-irrelevant variance in these kinds of scores. These indications were further accentuated by the analysis of sensitivity and specificity where any elevated number of set-loss error scores was unable to classify individuals on theoretically relevant constructs beyond chance levels. The evidence thus speaks against the use of set-loss error scores in the general population of 8- to 11-year-old children.

The Children's Treatment of Animals Questionnaire: A Rasch Analysis

ABSTRACTThe study of human–animal interactions is limited by a paucity of empirically validated measures of humane treatment of companion animals. The current study reports findings from a psychometric analysis of the Children's treatment of animals Questionnaire (CTAQ; thompson and Gullone 2003), an instrument that assesses children's humane interactions with nonhuman animals. Specifically, the current study extends what is known about the psychometric properties of the CTAQ by using traditional and item response theory analyses. The CTAQ was administered to a sample of 217 school-age children whose mothers were currently receiving residential or non-residential domestic violence services. Item-analysis, exploratory factor analysis, and parallel analysis were conducted to replicate previous psychometric evaluations of the CTAQ. Rasch analysis of the CTAQ was also conducted to provide a stringent test of unidimensionality and to identify potential invariance in item functioning across various demographic variables. The CTAQ showed adequate fit to the Rasch model; one modification, removal of item 5, was required. A Rasch principal components analysis of residuals indicated a single latent dimension among the remaining 12 items. Scale use was appropriate; Rasch-andrich thresholds increased with category values and no disordering of categories was evident. Examination of item-person maps indicated the sample was also well-targeted. Notably, evidence of differential item function was found across Spanish and English translations. Overall, findings indicate that the CTAQ is an appropriate unidimensional measure of children's humane treatment of animals. The measure is particularly well-suited for children ages 7 to 12 years who are at risk for exposure to and perpetration of animal cruelty. We recommend use of a 12-item version of the CTAQ to enhance the utility of the total score as a latent measure of children's humane treatment of companion animals.

The best of times and the worst of times are interchangeable.

We commonly determine the most preferred (best) and least preferred (worst) of a set of options, yet it is unclear whether the 2 choices are based on the same or different information. We examined best and worst choices using discrete choice tasks, in which participants selected either the best option from a set, the worst option, or selected both the best and the worst options. One experiment used perceptual judgments of area, and another used consumer preferences for various attributes of mobile phones. In both domains, we found that the task (best, worst, or best and worst) does not alter the preferences expressed for the best (respectively, the worst) option. We also observed that the choice probabilities were consistent with a single latent dimension—options that were frequently selected as best were infrequently selected as worst, and vice versa—both within and between respondents. A quantitative model of choice and response time provided convergent evidence on those relations, with model variants that assumed an inverse relationship between the estimated parameters for best and worst choices accounting well for the data. We conclude that the diverse types of best and worst choices that we studied can be conceived as opposing ends of a single continuous dimension rather than distinct latent entities. We discuss these results in the light of rather different results for accepting (e.g., purchasing) and rejecting (e.g., not purchasing) options from a set.

Personality disorders as maladaptive, extreme variants of normal personality: borderline personality disorder and neuroticism in a substance using sample.

Although the current diagnostic manual conceptualizes personality disorders (PDs) as categorical entities, an alternative perspective is that PDs represent maladaptive extreme versions of the same traits that describe normal personality. Existing evidence indicates that normal personality traits, such as those assessed by the five-factor model (FFM), share a common structure and obtain reasonably predictable correlations with the PDs. However, very little research has investigated whether PDs are more extreme than normal personality traits. Utilizing item-response theory analyses, the authors of the current study extend previous research to demonstrate that the diagnostic criterion for borderline personality disorder and FFM neuroticism could be fit along a single latent dimension. Furthermore, the authors' findings indicate that the borderline criteria assessed the shared latent trait at a level that was more extreme (d = 1.11) than FFM neuroticism. This finding provides further evidence for dimensional understanding of personality pathology and suggests that a trait model in DSM-5 should span normal and abnormal personality functioning, but focus on the extremes of these common traits.

Gender differences in the mean level, variability, and profile shape of student achievement: Results from 41 countries

A domain-specific hierarchical conceptualization of mathematics achievement can be represented by the standard psychometric model in which a single latent dimension accounts for observed individual differences in scores on the respective subdomains (e.g., quantity). Alternatively, a fully hierarchical conceptualization of achievement can be represented by a nested-factor model in which individual differences in subdomain-specific scores are explained by both general student achievement and specific mathematics achievement. The authors applied both models to study the gender similarity hypothesis, the greater male variability hypothesis, and the masking hypothesis, which predicts that gender differences in general student achievement mask gender differences in both the means and the variability of specific mathematics achievement. Representative data were obtained from 275,369 15-year-old students in 41 countries. The results supported these hypotheses in most countries, demonstrating that a fully hierarchical conceptualization of achievement in terms of the nested-factor model significantly contributes to a better understanding of gender differences in the mean level, variability, and shape of students' achievement profiles.