Discriminant Validity Of Scores Research Articles

Development and Validation of the Disclosure Expectancy Scale.

Although the disclosure of traumatic experiences is believed to influence trajectories of post-trauma recovery, less is known about individual differences that affect survivors' motivation to share. The current project describes the development and evaluation of the Disclosure Expectancy Scale (DExS), a novel instrument intended to assess survivors' expectations about the potential risks and benefits of disclosure. Items targeting both positive and negative expectancies were generated based on existing research and the authors' clinical experience with various survivor populations. Preliminary analyses in trauma-exposed undergraduates (N = 359) offer support for hypothesized positive and negative expectancy dimensions with evidence for the convergent and discriminant validity of scores. Subsequent evaluation in active-duty, help-seeking military personnel (N = 35) provides further evidence of validity based on correlations with relevant clinical measures. A final regression demonstrating unique effects of initial disclosure expectancies on post-traumatic stress disorder (PTSD) severity following trauma-focused treatment highlights the predictive validity of DExS scores.

The Strengths and Difficulties Questionnaire: An examination of factorial, convergent, and discriminant validity using multitrait-multirater data.

This study examined the factorial, convergent, and discriminant validity of scores on the Strengths and Difficulties Questionnaire (SDQ), a tool for screening children's psychological adjustment. Data were collected from a community sample of 346 children (46% girls, M age = 54.07 months), using teacher, mother, and father reports. Results from confirmatory factor analyses indicated that the SDQ's hypothesized 5-factor structure fit the data well and partial strict measurement invariance was established across raters. Using teachers' reports as reference method, a correlated trait-correlated method minus 1 model (Eid et al., 2008) was fitted to investigate convergent and discriminant validity. The convergent validity of parents' ratings relative to teachers' ratings was modest. Mothers and fathers had a unique perspective on children's behavior above and beyond their partial overlap with teacher reports. Results indicated good discriminant validity between most of the traits measured by the SDQ. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Discriminant Validity and Reliability of Scores of Multiple Choice and Short Essay Questions

<p><strong>Background and Objective:</strong> Assessment of learning plays a vital role in curriculum allowing faculty to evaluate the achievement of student and educational process. Quality assurance of the assessments is done to assess the quality of teaching and learning. A study is therefore conducted to find the discriminant validity and reliability of scores of Multiple Choices and Short Answer Questions.<br /><strong>Methods:</strong> A correlation study was conducted on 272 second year MBBS students of Fatima Memorial College of Medicine and Dentistry, Lahore from 2016 – 2017. Students were assessed in end of year examination with multiple choice questions (MCQs) and short essay questions and (SEQs) in the subjects of Physiology and Biochemistry. A total of 149 second-year MBBS students took thePhysiologyand143 studentstook the end of year Biochemistry examination with 50% minimum passing level. The mean and standard deviation of the scores were calculated and the scores of MCQs and SEQs were correlated by applying Pearson’s correlation. Reliability was determined by Cronbach’s alpha. Discriminant validity of scores (MCQS and SEQS) was analyzed by Pearson’s correlation.<br /><strong>Results:</strong> Students scored significantly higher in MCQsthan SEQsin end of year examination of Biochemistry and Physiology. Positive significant correlation of scores (MCQs and SEQs) was obtained in Biochemistry while correlation was positive but non-significant in Physiology. The reliability assessed by Cronbach’s alpha was moderate in Biochemistry and Physiology assessments. Discriminant validity was determined in both subjects by determining the correlation between the scores of the MCQs and SEQs, constructed  according to the same module.<br /><strong>Conclusion:</strong> The internal assessment of students based on end of year examinations in the subjects of Physiology and Biochemistry scored moderate in terms of reliability and discriminant validity was found between scores of MCQs and SEQs in each module.</p>

Development and validation of a medication regimen complexity scoring tool for critically ill patients.

The purpose of this study was to develop and validate a novel medication regimen complexity-intensive care unit (MRC-ICU) scoring tool in critically ill patients and to correlate MRC with illness severity and patient outcomes. This study was a single-center, retrospective observational chart review of adults admitted to the medical ICU (MICU) between November 2016 and June 2017. The primary aim was the development and internal validation of the MRC-ICU scoring tool. Secondary aims included external validation of the MRC-ICU and exploration of relationships between medication regimen complexity and patient outcomes. Exclusion criteria included a length of stay of less than 24 hours in the MICU, active transfer, or hospice orders at 24 hours. A total of 130 patient medication regimens were used to test, modify, and validate the MRC-ICU tool. The 39-line item medication regimen complexity scoring tool was validated both internally and externally. Convergent validity was confirmed with total medications (p < 0.0001). Score discriminant validity was confirmed by lack of association with age (p = 0.1039) or sex (p = 0.7829). The MRC-ICU score was significantly associated with ICU length of stay (p = 0.0166), ICU mortality (p = 0.0193), and patient acuity (p < 0.0001). The MRC-ICU scoring tool was validated and found to correlate with length of stay, inpatient mortality, and patient acuity.

On the Validity of Forced Choice Scores Derived From the Thurstonian Item Response Theory Model.

Forced choice (FC) measures may be a desirable alternative to single stimulus (SS) Likert items, which are easier to fake and can have associated response biases. However, classical methods of scoring FC measures lead to ipsative data, which have a number of psychometric problems. A Thurstonian item response theory (TIRT) model has been introduced as a way to overcome these issues, but few empirical validity studies have been conducted to ensure its effectiveness. This was the goal of the current three studies, which used FC measures of domains from popular personality frameworks including the Big Five and HEXACO, and both statement and adjective item stems. We computed TIRT and ipsative scores and compared their validity estimates. Convergent and discriminant validity of the scores were evaluated by correlating them with SS scores, and test-criterion validity evidence was evaluated by examining their relationships with meaningful outcomes. In all three studies, there was evidence for the convergent and test-criterion validity of the TIRT scores, though at times this was on par with the validity of the ipsative scores. The discriminant validity of the TIRT scores was problematic and was often worse than the ipsative scores.

The Anxiety Depression Distress Inventory–27 (ADDI–27): New Evidence of Factor Structure, Item-Level Measurement Invariance, and Validity

ABSTRACTThree studies examining the factor structure and psychometric properties of the Anxiety Depression Distress Inventory–27 (ADDI–27) extended the initial instrument development studies for this recently introduced inventory. The ADDI–27 is an empirically derived short form of the Mood and Anxiety Questionaire–90 (MASQ–90) comprising three scales: Positive Affect, Somatic Anxiety, and General Distress. The main objectives of Study 1 (N = 700) were to examine the factor structure of the ADDI–27 and its measurement invariance across gender at the item level. The objective of Study 2 (N = 538) was to examine evidence for the convergent and discriminant validity of scores on the ADDI–27. The objective of Study 3 (N = 240) was to assess further evidence for the nomological network and convergent and discriminant validity of the ADDI–27 scores. Results of exploratory structural equation modeling yielded strong support for a 3-factor model, with approximate fit indexes meeting or exceeding the conventional cutoffs. With p ≤ .001 as the criterion for detecting noninvariance, results of measurement invariance analysis suggested that all of the ADDI–27 items were invariant across gender. Results of multivariate validity analyses across 2 studies provided support for the convergent and discriminant validity of scores on the ADDI–27 scales.

Exploratory Factor Analysis and Psychometric Properties of the Sexual Coercion Inventory

The purpose of the present study was to examine the psychometric properties of the Sexual Coercion Inventory (SCI; Waldner, Vaden-Goad, & Sikka, 1999), revised by the authors (SCI-R). Overall, 514 high school and college students from a Midwestern state completed the SCI-R. To complete the SCI-R, high school participants completed paper-pencil surveys with those younger than 18 obtaining parental consent; college students older than 18 completed computer-based and paper-pencil surveys. Exploratory factor analysis and reliability analyses were conducted to examine the validity of score interpretation and reliability of scores for the measure. Results suggested that a 13-item multidimensional measure consisting of two factors, Manipulation and Substance Use and Aggression, provided the best parsimony and theoretical fit. Examination of convergent and discriminant validity of scores provided additional psychometric support for the revised SCI-R, specifically pertaining to other measures of sexual victimization. The SCI-R may be a useful tool for researchers to explore manipulation tactics in more depth while also assessing and differentiating between victimization that meets legal definitions of rape and non-criminal sexual victimization.

The Revised Identity Style Inventory: Factor Structure and Validity in Italian Speaking Students.

The purpose of this study was to evaluate the factor structure and convergent and discriminant validity of scores on an Italian translation of the Revised Identity Style Inventory (ISI-5) with samples of 237 adolescents (50 males, Mage = 18.04, SD = .86) and 268 university students (42 males, Mage = 22.71, SD = 3.70). Confirmatory Factor Analysis indicated that a three-factor solution provided a good fit, which was invariant across age and sex groups. The theoretically relationships between scores on the ISI and scores on measures of reasoning and identity processes, identity commitment, and social desirability were partially consistent, thus further studies are needed to give more evidence to the convergent and discriminant validity.

Construct validation of self-reported stress scales.

The recently developed Perceived Stress Reactivity Scale (PSRS; Schlotz, Yim, Zoccola, Jansen, & Schulz, 2011) examines perceived stress reactivity with 6 different subscales. The authors of the current study build on initial validation work with this scale by evaluating patterns of the convergent and discriminant validity of scores on its 6 substantially correlated subscales. Examination of the relationships between the 6 PSRS subscales and other variables (personality, depressive affect, eudaimonic well-being, environmental demands, and aspects of work) indicated some differentiation between the different facets of stress reactivity. The PSRS scales also correlated highly with the Perceived Stress Scale (PSS). To account for all of these relationships, a structural regression model specifying a hierarchical factor model for the PSRS scales showed that some relationships (e.g., with neuroticism) were best modeled at the general stress factor level using a latent variable also defined by both the PSS and the PSRS subscales. The model also demonstrated lower level specific relationships that generated better fit than when all predictors were forced to relate to the PSRS only through the general stress factor. Results indicate that domain-specific aspects of stress can be differentiated, which ultimately could prove useful in research on mental health consequences of stress originating from different life domains.

Psychometric properties of the Therapeutic Alliance Scale for Caregivers and Parents.

This study examined the psychometric properties of the Therapeutic Alliance Scale for Caregivers and Parents (TASCP) in a sample of 209 caregivers whose children (4-13 years of age) presented with disruptive behavior problems to a publicly funded outpatient mental health clinic in San Diego County. Information about therapeutic alliance was collected from caregivers, children, and their therapists across the course of therapy (up to 16 months). Results support the reliability, temporal stability, convergent validity, and discriminant validity of scores on the TASCP. The multilevel factor structure of this new measure was consistent with the parallel child-report version, with 2 within-level factors and 1 between-level factor. Furthermore, predictive validity was strong, with stronger caregiver-reported alliance associated with less treatment dropout, more sessions attended, and greater satisfaction with perceived improvement.

Evidence of convergent and discriminant validity of child, teacher, and peer reports of teacher-student support.

This study investigated the construct validity of measures of teacher-student support in a sample of 709 ethnically diverse 2nd- and 3rd-grade academically at-risk students. Confirmatory factor analysis investigated the convergent and discriminant validities of teacher, child, and peer reports of teacher-student support and child conduct problems. Results supported the convergent and discriminant validity of scores on the measures. Peer reports accounted for the largest proportion of trait variance and nonsignificant method variance. Child reports accounted for the smallest proportion of trait variance and the largest method variance. A model with 2 latent factors provided a better fit to the data than a model with 1 factor, providing further evidence of the discriminant validity of measures of teacher-student support. Implications for research, policy, and practice are discussed.

Psychometric Properties of the Minnesota Multiphasic Personality Inventory–Adolescent (MMPI–A) Clinical, Content, and Supplementary Scales in a Forensic Sample

In this study, we evaluated the internal psychometric properties and external correlates of scores on the Clinical, Content, and Supplementary scales in a forensic sample of 496 adolescents (315 boys and 181 girls) who were court-ordered to receive psychological evaluations. We examined Cronbach's alpha coefficients, scale intercorrelation matrices, and frequencies of scale elevations. Further, we found varying degrees of support for the convergent and discriminant validity of scores on the MMPI–A (Butcher et al., 1992) Clinical, Content, and Supplementary scales. This study adds to the body of literature establishing the utility of the MMPI–A in forensic evaluations.

Correlates of the MMPI-2-RF in a college setting.

The current study examined empirical correlates of scores on Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF; A. Tellegen & Y. S. Ben-Porath, 2008; Y. S. Ben-Porath & A. Tellegen, 2008) scales in a college setting. The MMPI-2-RF and six criterion measures (assessing anger, assertiveness, sex roles, cognitive failures, social avoidance, and social fear) were administered to 846 college students (nmen = 264, nwomen = 582) to examine the convergent and discriminant validity of scores on the MMPI-2-RF Specific Problems and Interest scales. Results demonstrated evidence of generally good convergent score validity for the selected MMPI-2-RF scales, reflected in large effect size correlations with criterion measure scores. Further, MMPI-2-RF scale scores demonstrated adequate discriminant validity, reflected in relatively low comparative median correlations between scores on MMPI-2-RF substantive scale sets and criterion measures. Limitations and future directions are discussed.

Multitrait-Multimethod Analyses of Scores on a Chinese Version of the Dimensions of Self-Concept Scale

The purpose of this study was to examine the construct validity of scores on a Chinese version of an academic self-concept scale as measured by self-, peer, and parent ratings. The multitrait-multimethod approach, general confirmatory factor analysis models, and correlated uniqueness models were utilized. Overall, the results from three analyses supported the convergent validity as well as discriminant validity of scores and the presence of a method effect. However, the evidence for convergent validity, discriminant validity, and method effect associated with scores was somewhat inconsistent. Alternative analysis procedures are recommended to provide safeguards to construct validation.

Multiplicative Covariance Structure Models in the Analysis of Scores on a Chinese Version of an Academic Self-Concept Scale

The purpose of this study was to examine the construct validity of scores on a Chinese version of an academic self-concept measure entitled Dimensions of Self-Concept (DOSC) using composite direct product (CDP) models. Measures of five traits-Level of Aspiration, Anxiety, Academic Interest and Satisfaction, Leadership and Initiative, and Identification vs. Alienation-were obtained from a convenience sample of 769 junior high school students by using self ratings, peer ratings, and parent ratings. The degree of convergent and discriminant validity was moderate to low based on the evaluation in terms of both Campbell and Fiske (1959) guidelines and the comparison of nested multitrait-multimethod CDP models. In particular, concern about the discriminant validity of scores on traits of Level of Aspiration, Academic Interest and Satisfaction, and Identification vs. Alienation was raised. Implications for the use of CDP models in the assessment of construct validity of scores on an academic self-concept measure were discussed.

A Confirmatory Factor Analysis of Scores on a Chinese Version of an Academic Self-Concept Scale and its Invariance across Groups

The purposes of this inquiry were twofold: (a) to examine the factor structure, convergent validity, and discriminant validity of scores on a Chinese version of an academic self-concept scale titled Dimensions of Self-Concept (DOSC), which provides an assessment of standing in five factor subscales: Level of Aspiration, Anxiety, Academic Interest and Satisfaction, Leadership and Initiative, and Identification Versus Alienation; and (b) to examine factorial invariance of scores across gender and age groups. A convenience sample of 877 seventh-, eighth-, and ninth-grade students participated in a suburban area of Changhua, Taiwan. The research findings provided promising support for the convergent and discriminant validity of scores on the subscales corresponding to five hypothesized constructs. From a practical standpoint, the findings reported in this investigation indicated that the factor coefficients, the factor variance/covariance, and various errors across age and gender groups were invariant across groups.

Psychological Empowerment as a Multidimensional Construct: A Test of Construct Validity

The construct validity of scores on Spreitzer’s Psychological Empowerment scale was examined. Confirmatory factor analysis (CFA) of data from a sample of 160 nurses showed substantial support for Spreitzer’s four empowerment dimensions: meaning, competence, self-determination, and impact. In contrast to Spreitzer’s findings, the results of this study indicated that self-determination is a precursor of impact. This finding was cross-validated with data from a subset of the same sample 1 year later, after implementation of a job redesign program. In addition, results from structural equation modeling (SEM) demonstrated job characteristics to relate differentially to the empowerment dimensions, providing evidence for both convergent and discriminant validity of scores on the four empowerment dimensions. Finally, this study found that the four empowerment dimensions differentially related to organizational commitment and career intentions, providing evidence for the predictive validity of the Empowerment scale scores.

The Adolescent Behavior Checklist: Validation Using Structured Diagnostic Interviews

The purpose of this study was to evaluate the discriminant validity of scores from the Adolescent Behavior Checklist (ABC), a self-report measure of ADHD symptomatology for adolescents ages 11–17 years. Validity was assessed through correlational, univariate, and discriminant function analyses using three groups: (1) adolescents diagnosed with ADHD, (2) adolescents currently experiencing a mood and/or anxiety disorder, and (3) adolescents with no major psychological disorder. Convergent and divergent validity of the ABC factor scores was demonstrated through correlational results with (1) parent and adolescent report of ADHD symptoms during structured psychiatric interviews and (2) scores on questionnaires measuring related and nonrelated constructs. Univariate analyses indicated that the ADHD group obtained significantly higher scores than did the nonclinical adolescents across all ABC factors. Additionally, the ADHD group scored significantly higher than did the psychiatric controls on the following ABC factors: Conduct Problems, Impulsivity/Hyperactivity, and Social Problems. Results from discriminant analyses supported the reliability of ABC scores in correctly classifying participants into groups. Compared to the Youth Self-Report, the ABC was found to be somewhat better at classifying when used in a multiinformant discriminant analysis. Therefore, overall results from the current study suggest that the ABC is a valid and useful self-report screening measure for ADHD symptoms and related difficulties.