Additional Construct Validity Research Articles

Cross‐cultural adaptation and validation of the Chinese version of Skills and Needs Inventories in Functional Behavior Assessments and Interventions (SNI‐FBAI‐CN)

AbstractCross‐cultural adaptation and validation of measures are necessary to provide evidence‐based educational intervention services among children with autism spectrum disorder (ASD) across countries. Language plays an integral role in the cross‐cultural adaptation and validation process of measures. Currently, there are limited validated tools in Chinese available to assess special education teachers' skills in functional behavior assessments and interventions in Mainland China to effectively support students with ASD. This study aimed to validate a Chinese version of the Skills and Needs Inventories in Functional Behavior Assessments and Interventions (SNI‐FBAI‐CN) in mainland China. The SNI‐FBAI, originally developed and validated in Singapore, in the English language, was translated, culturally adapted, and then administered to 239 special education teachers in two schools for children with ASD in China. Results show that the SNI‐FBAI‐CN has a three‐factor structure (i.e., skills in behavioral assessment, skills in behavioral interventions, and needs for training) that fits the data well, with good reliability for the overall scale, as well as the three subscales. Partial measurement invariance was established between the Chinese and the original Singapore samples, providing additional construct validity evidence for this tool. Limitations of this study and directions for future research are discussed.

Living while fat: Development and validation of the Fat Microaggressions Scale.

Fat microaggressions are microlevel social practices in the form of commonplace everyday indignities that insult fat people and have been documented anecdotally and qualitatively. However, no psychometrically validated scale exists for measuring fat microaggressions, despite decades of microaggression research demonstrating their negative health associations. This research describes the development and construct validation of the Fat Microaggressions Scale across four studies. Study 1 focused on item development through a systematic review, qualitative analysis of Tweets using #fatmicroaggressions, and a Delphi review. Study 2 (N = 343) determined that a four-factor structure was appropriate in an online community sample of fat adults. Study 3 (N = 410) confirmed the factor structure in a new online sample of fat adults and provided initial evidence of construct validity. Study 4 (N = 197) found evidence of test-retest reliability and demonstrated additional construct validity. Our findings offer a newly validated quantitative measure of fat microaggressions and an initial framework for naming and categorizing these experiences, which may be used to advance the study of fat microaggressions. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Recognition of Emotion from Verbal and Nonverbal Expressions and Its Relation to Effective Communication: A Preliminary Evidence of a Positive Link.

Previous work has shown that emotion recognition is positively related to effective social interactions, but the mechanism underlying this relationship has remained largely unclear. Here, we examined the possibility that people who understand others' emotions also talk to them using similar language. In the current study participants (N = 106) listened to emotional stories people shared from their own lives. They were later asked to recognize the storytellers' feelings and finally provide written support messages. Perceivers' ability to accurately recognize others' feelings was assessed using the Emotional Accuracy Test (EAT), which uses naturalistic verbal and nonverbal emotional cues, and using two standard tests of nonverbal emotion recognition (GERT, RMET). The language of the expressor (target) was compared to the language of the supporter (participant) to quantify Language Style Matching, a proxy for effective communication. People who perform better in emotion recognition with verbal cues (EAT) also communicate their understanding and support using language similar to the expresser (r = .22, p = .02). This relation was insignificant for tests without verbal information (RMET, GERT). The result provides additional construct validation for the EAT and supports the view that understanding the emotions of others and communicating with them are two manifestations of a broader interpersonal skill.

Construct Validity of the Dutch, English, French, and Spanish LPFS-BF 2.0: Measurement Invariance Across Language and Gender and Criterion Validity.

With the introduction of the Alternative Model of Personality Disorders in the DSM-5, the need for short measures of the level of personality functioning has emerged, both for screening purposes and for assessing change during treatment. The Level of Personality Functioning Scale-Brief Form 2.0 (LPFS-BF 2.0) was constructed for this and has received support for its two-factor structure and criterion validity. The authors aimed to provide additional construct validity evidence for the LPFS-BF 2.0 by examining its factor structure and measurement invariance across the Dutch, English, French, and Spanish versions and across gender, and its criterion validity. Results showed that the two-factor model had a good fit to the data in the four linguistic versions. Configural and metric invariance were supported across linguistic versions and gender, while scalar invariance was partially supported. Reporting a mental health disorder and having consulted with a mental health professional were associated with higher LPFS-BF 2.0 scores.

A Short Measure of the Big Five Aspects: Development and Validation of the BFAS-40

We present psychometric evidence for the BFAS-40, an abbreviated measure of the Big Five Aspects Scale (DeYoung et al., 2007). In Study 1, we developed the BFAS-40 using metaheuristic algorithms and cross-validated the factor structure of the shortened measure. In Study 2, we demonstrated that the BFAS and BFAS-40 correlate with external criteria in similar ways. In Studies 3 and 4, we provide convergent validity evidence by examining correlations between the BFAS-40 and other measures of typical and clinically relevant personality. Finally, in Study 5, we provide evidence of test-retest reliability as well as additional construct validity evidence. Across these five studies, we demonstrate that the BFAS-40 is a short, reliable, and valid measure of the Big Five Aspects.

A measure of adaptive performance and the DLOQ

PurposeThis study aims to introduce adaptive performance as an organizational performance dimension and examine the possible dynamics between the dimensions of a learning organization and adaptive performance.Design/methodology/approachThis study used a survey and applied factor analysis and structural equation modeling analysis.FindingsThe results supported adaptive performance as an organizational performance dimension. Also, the findings of this study empirically proved that perceived knowledge and adaptive performance mediate the positive relationship between a learning organization and perceived financial performance.Research limitations/implicationsIn addition to the current Dimensions of a Learning Organization Questionnaire (DLOQ) studies, this study revealed that adaptive performance, one of the nonfinancial outcomes improved by learning, had a significant effect on financial performance. Also, this study provided evidence of the additional construct validity of the DLOQ, particularly its performance measures.Practical implicationsThis study advises practitioners to take a close look at how learning and organization development activities improve organizational performance overall.Originality/valueThis study supported a claim that learning and organization development activities in organizations have a strong potential to induce variance in intangible performance.

The Validity of Connecting Conversations: A Narrative Method to Assess Experienced Quality of Care in Nursing Homes from the Resident's Perspective.

It is important to assess experienced quality of care in nursing homes, as this portrays what is important to residents and helps identify what quality improvements should focus on. Connecting Conversations is a narrative method that assesses experienced quality of care from the resident’s perspective in nursing homes by having separate conversations with residents, family, and professional caregivers (triads) within a learning network. This study assessed the validity of performing the narrative method, Connecting Conversations. Trained nursing home staff (interviewers) performed the conversations in another nursing home than where they were employed. In total, 149 conversations were performed in 10 nursing homes. Findings show that experts deemed the narrative assessment method appropriate and complete to assess experienced quality of care (face validity). The questions asked appeared to capture the full construct of experienced quality of care (content validity). Additionally, there was a range in how positive conversations were and first results indicated that a nursing home scoring higher on satisfaction had more positive conversations (construct validity). More data are needed to perform additional construct validity analyses. In conclusion, Connecting Conversations shows promising results for its use as a valid narrative method to assess experienced quality of care.

RESILIENCE, RESOURCEFULNESS, AND MINDFULNESS: DISTINCT BUT COMPLEMENTARY INTERVENTIONS

Stress and coping theory guides our interest in three related concepts: resilience (the capacity to bounce back and cope with stress), resourcefulness (cognitive and behavioral strategies to manage stress and adversity), and mindfulness (strategies of present moment awareness to reduce stress). These are theoretically distinct but related concepts relevant to improving health and social outcomes in older adults. Our aim was to evaluate the theoretical distinctions among these concepts in 236 grandmother caregivers. Measures of resilience (Connor-Davidson Scale), mindfulness (Decentering Scale) and resourcefulness (Resourcefulness Scale) were collected from a longitudinal, online study of 236 grandmother caregivers. To evaluate construct validity, we examined criterion validity and conducted exploratory factor analysis using Principal Axis Factoring with direct oblimin rotation in SPSS. Factor Analyses were conducted on each scale separately and with all items combined. Inter-correlations ranged from r= .28 (resourcefulness and resilience) to r= .75 (resilience and mindfulness). Factor analyses and scree plots indicated unidimensional factors for resilience and for mindfulness, and three factors for resourcefulness (personal resourcefulness aimed at either emotion regulation or planful problem solving, and social resourcefulness by external help seeking). When items from all measures were analyzed together, the five distinct factors remained. Additional construct validation with the CES-D and Duke Social Support scales supported convergent and discriminant validity of resilience, resourcefulness and mindfulness. Our results confirm the theoretical distinctions among resilience, resourcefulness, and mindfulness, providing support for the use of these concepts collectively or individually in interventions to improve health outcomes.

Measuring racial essentialism in the genomic era: The genetic essentialism scale for race (GESR)

Racial essentialism is the belief that races are biologically distinct groups with defining core “essences,” a notion associated with increased social distance and racial bias. While there are different kinds of racial essentialism, understanding and measuring genetic essentialism – the belief that racial groups and their defining core essences are determined by genes – is increasingly important in the wake of the Human Genome Project and the genomic revolution that it spurred. Many have questioned whether such genomic advances will reinforce genetic essentialist beliefs about race, but scholarly research is limited by measures that do not specify the role of genes in these beliefs or allow for distinct theoretical sub-components. In this paper, we develop and validate the Genetic Essentialism Scale for Race (GESR) using a sequential transformative mixed methods approach. Data for analysis come from an original survey-based study with a sample of 1069 White native-born Americans. We employ both exploratory factor analysis and confirmatory analysis to derive and confirm a three-factor model of genetic essentialism (category determinism, core determinism, and polygenism). Due to the high correlation between these factors, we also test for a second-order measurement model with three first-order factors. After conducting additional reliability, validity, and construct validity testing, we propose the GESR— a second-order construct with three first-order dimensions— as a reliable measure of genetic essentialism. The GESR will allow researchers to determine the impact of new genetic developments like race-based medicines and genetic ancestry testing on genetic essentialist beliefs about race.

The relations of gratitude to religiosity, well-being, and personality

ABSTRACTThe relations of gratitude toward God and dispositional gratitude with well-being and personality were investigated, in an Iranian sample. As expected, gratitude was associated with higher scores on happiness, life satisfaction, psychological well-being, and the Big Five factors of personality. Dispositional gratitude out-predicted religious gratitude in relation with well-being. A second study confirmed the results in a second sample of Iranian Muslims, and in a sample of Polish Christians, providing cross-cultural evidence that the dispositional gratitude is a unique predictor of well-being. Positive links between gratitude and Honesty–Humility provided additional construct validity for these variables, as personality dimensions representing the bases of reciprocal altruism.

The Construct Validity of the German Academic Self-regulation Questionnaire (SRQ-A) within Primary and Secondary School Children.

The assessment of students' motivation can be a powerful tool in enhancing and understanding students' learning. One valid and often applied self-report measure is the Academic Self-Regulation Questionnaire (SRQ-A) which is grounded in the self-determination theory. However, to date, there is still no German equivalent to the English version of this questionnaire. Therefore, the aim of the present study was to adapt and validate the SRQ-A on a representative German student sample, consisting of 672 children (327 girls), ages 8–14 from one primary and two secondary German schools. First, the translation-back-translation method was used to ensure the linguistic equivalence of the German questionnaire. Second, item analysis of the generated scores of the German SRQ-A were conducted. Third, the multidimensional factorial structure of the original measure was tested with confirmatory factor analysis (CFA) using maximum likelihood estimation. Last, additional construct validity of the German SRQ-A was tested using correlational analyses with convergent and divergent measures. After conducting CFA, four items were excluded from the original questionnaire, due to loadings lower than 0.40, resulting in 28 items. The German SRQ-A showed good internal consistency for all subscales, with Chronbach's α ranging between 0.75 and 0.88. The simplex-structure of the original measurement could also be confirmed, however, the four-factorial model could not be replicated. The measurement showed good convergent and discriminant validity with other related questionnaires. In summary, the German SRQ-A is a reliable and valid self-report instrument for the assessment of self-determined motivational styles within the school context.

Developing a measure to assess identity reconstruction in patients with multiple sclerosis.

To develop and test initial validation of a theory-driven quantitative measure of identity reconstruction in patients with multiple sclerosis (MS) based upon previous qualitative research. Research Method/Design: This study uses a cross-sectional survey design, in which 137 patients living with MS were recruited from an outpatient MS Center in the Southeastern U.S. Participants completed demographic items, Identity Reconstruction Assessment Scales (IRAS), Patient Determined Disease Steps, Medical Outcomes Study Measures of Patient Adherence, Chronic Disease Self-Efficacy Scale, Hospital Anxiety and Depression Scale, Leeds MS Quality of Life Questionnaire, MS-Related Stigma Scale, and Posttraumatic Growth Inventory-Short Form. The IRAS conformed to a 3-factor solution consisting of 23 items accounting for 42.6% of the variance. The 3 factors, labeled as "sustained identity" (α = .84), "reactionary identity" (α = .74), and "integrated identity" (α = .65), were not significantly correlated with each other, necessitating and allowing for independent scoring of the scales. Higher scores on "sustained identity" scale were associated with less anxiety, depression, perceived disability, and MS-related stigma, as well as with increased self-efficacy, treatment adherence, and quality of life. "Reactionary identity" scale was positively correlated with anxiety and MS-related stigma. "Integrated identity" was significantly associated with age and perceived disability. Identity reconstruction provides needed context for understanding adjustment to and living with MS. Examination of the IRAS within a larger sample and in other disease groups can provide additional construct validity evidence. (PsycINFO Database Record

Construct Validity of the MMPI–2–RF Triarchic Psychopathy Scales in Correctional and Collegiate Samples

ABSTRACTThis study examined the MMPI–2–RF (Ben-Porath & Tellegen, 2008/2011) Triarchic Psychopathy scales recently developed by Sellbom et al. (2016) in 3 separate groups of male correctional inmates and 2 college samples. Participants were administered a diverse battery of psychopathy specific measures (e.g., Psychopathy Checklist–Revised [Hare, 2003], Psychopathic Personality Inventory–Revised [Lilienfeld & Widows, 2005], Triarchic Psychopathy Measure [Patrick, 2010]), omnibus personality and psychopathology measures such as the Personality Assessment Inventory (Morey, 2007) and Personality Inventory for DSM–5 (Krueger, Derringer, Markon, Watson, & Skodol, 2012), and narrow-band measures that capture conceptually relevant constructs. Our results generally evidenced strong support for the convergent and discriminant validity for the MMPI–2–RF Triarchic scales. Boldness was largely associated with measures of fearless dominance, social potency, and stress immunity. Meanness showed strong relationships with measures of callousness, aggression, externalizing tendencies, and poor interpersonal functioning. Disinhibition exhibited strong associations with poor impulse control, stimulus seeking, and general externalizing proclivities. Our results provide additional construct validation to both the triarchic model and MMPI–2–RF Triarchic scales. Given the widespread use of the MMPI–2–RF in correctional and forensic settings, our results have important implications for clinical assessment in these 2 areas, where psychopathy is a highly relevant construct.

Validation of the Injustice Experiences Questionnaire in a heterogeneous trauma sample.

A recent study by Trost et al. (2015) investigated the influence of perceived injustice-reflecting appraisals of the severity and irreparability of loss following injury, blame, and unfairness-on physical and psychological outcomes in a sample of patients 12 months after sustaining a traumatic injury. This brief report examines the psychometric properties of the Injustice Experiences Questionnaire (IEQ) using the previous sample from Trost et al. (2015) with added trauma patients (total N = 206). Primary analyses included confirmatory and exploratory factor analyses to validate the measurement model of the IEQ in patients 12 months after traumatic injury. Reliability analyses were conducted and construct validity was assessed by examining associations between the IEQ and other pain-related, psychological, and health-related outcome variables of interest. Results replicated both one- and two-factor structures from past research, with a high factor correlation in confirmatory factor analyses and cross-loadings in exploratory factor analysis. Item characteristics analysis demonstrated overall strong internal consistency (α = .95). In addition, significant associations with psychosocial variables provide additional construct validity in regards to related outcomes. The IEQ shows strong psychometric properties and is suitable for use in a sample of diverse traumatic injury. However, results suggest the use of a one-factor model for the IEQ in this sample. Future trauma and rehabilitation research can use the IEQ to explore how injustice perceptions related to traumatic injury can prospectively influence physical and psychological outcomes. (PsycINFO Database Record

Examining a Self-Report Measure of Parent–Teacher Cocaring Relationships and Associations With Parental Involvement

ABSTRACTBy adapting a self-administered assessment of coparenting, we sought to provide a new tool, the Cocaring Relationship Questionnaire, to measure parent-teacher, or cocaring relationships, and provide additional construct validity for the multidimensional concept of cocaring. Next, recognizing the importance of parental involvement for young children’s development, we examined the associations between dimensions of cocaring and aspects of parental involvement. We investigated the parent-teacher relationships of 90 families utilizing full-time, center-based childcare for their 12–36 month old children. Parents and teachers completed a set of questionnaires. Research findings: exploratory factor analysis revealed a four factor structure for the cocaring relationship: Support, Undermining, Endorsement, and Agreement. After controlling for a number of child- and parent-level covariates, parents’ perceptions of different dimensions within the cocaring relationship were associated with different aspects of their self-reported and teacher-reported involvement. Most notably, parents’ perception of cocaring support was positively associated with three different forms of parental involvement. Practice or Policy: the Cocaring Relationship Questionnaire offers researchers and practitioners a means to assess multiple dimensions within parent-teacher relationships. Understanding that parent-teacher relationships are multifaceted can help practitioners consider their interactions with families in new ways, which may influence, or be influenced by, parental involvement.

Investigating Construct Validity of the Cyber-Peer Experiences Questionnaire

Abstract. Cyberaggression and cybervictimization have gained momentum as a research focus given associated mental health sequelae. To date, however, there remains little consensus on the conceptualization and measurement of these constructs. The purpose of this study was to explore construct validity evidence for the Cyber-Peer Experiences Questionnaire (C-PEQ), a novel measure that assesses experiences of cyberaggression and cybervictimization. Undergraduate participants ( n = 735) completed an online survey including the C-PEQ and other theoretically related instruments. Confirmatory factor analysis did not provide support for the hypothesized two-factor model [MLM χ2(125) = 293.58, RMSEA = .06, CFI = .87, SRMR = .06]. The C-PEQ displayed evidence for internal consistency reliability. Evidence for convergent validity with theoretically similar constructs was mixed. Specific areas of model misspecification included items 1 and 2 on both subscales (altering social media friend lists). Future research may explore additional construct validity evidence of the C-PEQ in novel samples with these items removed.

Assessing quality of life in severe obesity: development and psychometric properties of the ORWELL-R.

Several health-related quality-of-life (HRQoL) dimensions are affected by obesity. Our goal was to characterize the psychometric properties of the ORWELL-R, a new obesity-related quality-of-life instrument for assessing the "individual experience of overweightness". This psychometric assessment included two different samples: one multicenter clinical sample, used for assessing internal consistency, construct validity and temporal reliability; and a community sample (collected through a cross-sectional mailing survey design), used for additional construct validity assessment and model fit confirmation. Overall, 946 persons participated (188 from the clinical sample; 758 from community sample). An alpha coefficient of 0.925 (clinical sample) and 0.934 (community sample) was found. Three subscales were identified (53.2% of variance): Body environment experience (alpha=0.875), Illness perception and distress (alpha=0.864), Physical symptoms (alpha=0.674). Adequate test-retest reliability has been confirmed (ICC: 0.78 for the overall score). ORWELL-R scores were worse in the clinical sample. Worst HRQoL, as measured by higher ORWELL-R scores, was associated with BMI increases. ORWELL-R scores were associated with IWQOL-Lite and lower scores in happiness. ORWELL-R shows good internal consistency and adequate test-retest reliability. Good construct validity was also observed (for convergent and discriminant validity) and confirmed through confirmatory factor analysis (in both clinical and community samples). Presented data sustain ORWELL-R as a reliable and useful instrument to assess obesity-related QoL, in both research and clinical contexts.

Psychosocial aspects of exercise and physical activity in childhood.

Purpose:A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program.Method:In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the life skills transfer survey (LSTS), a measure of perceived life skills transfer.Results:Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS.Conclusion:Results from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

Assessing Impact of Physical Activity-Based Youth Development Programs: Validation of the Life Skills Transfer Survey (LSTS)

Purpose: A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program. Method: In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the Life Skills Transfer Survey (LSTS), a measure of perceived life skills transfer. Results: Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS.Conclusion: Results from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

Observational Measure of Elder Self-Neglect

The purpose of this study was to improve measurement of elder self-neglect by testing the psychometric properties of the Elder Self-Neglect Assessment (ESNA). Social workers, case managers, and adult protective services providers from 13 Illinois agencies completed a 77-item assessment for 215 clients suffering from self neglect. Analyses used Rasch item response theory and traditional validation approaches to test for dimensionality, model fit, and additional construct validation, resulting in a 62-item assessment. The ESNA met Rasch fit criteria with good internal consistency, item reliability, and construct validity. A 25-item short form also met Rasch criteria. A hierarchy of items associated with severity of abuse was produced by frequency of occurrence. ESNA indicators of self-neglect align into two broad categories: behavioral characteristics and environmental factors, which must be accounted for in a comprehensive evaluation. Theoretical refinements developed using the empirically generated item hierarchy may help to improve assessment and intervention.