Valid Self-report Measure Research Articles

A brief measure of the triarchic model of psychopathy among community youths: psychometrics and measurement invariance

ABSTRACTThe development and validation of empirically sound measures that operationalize the Triarchic model of psychopathy among youth is currently in the nascent stage. The present study aimed to examine the psychometric properties of a brief refined measure of the Triarchic model of psychopathy based on the Youth Psychopathic Traits Inventory (YPI-Tri-S) among a mixed-gender school sample of 782 youth (M = 15.87 years, SD = 1.72) from Portugal. Confirmatory factor analysis offered support for the theoretically expected three-factor structure. Cross-gender measurement invariance using the present sample and cross-sample measurement invariance of the YPI-Tri-S using a previously collected forensic sample of institutionalized males was established. The YPI-Tri-S showed adequate psychometric properties in terms of discriminant validity, convergent validity, concurrent criterion-related validity, known-groups validity, and internal consistency. Findings indicate that YPI-Tri-S is a valuable brief and psychometrically reliable and valid self-report measure of the Triarchic model of psychopathy for use in diverse samples of youth.

PROMIS® Adult Health Profiles: Efficient Short-Form Measures of Seven Health Domains

BackgroundThere is a need for valid self-report measures of core health-related quality of life (HRQoL) domains. ObjectiveTo derive brief, reliable and valid health profile measures from the Patient Reported Outcomes Measurement Information System® (PROMIS®) item banks. MethodsLiterature review, investigator consensus process, item response theory (IRT) analysis, and expert review of scaling results from multiple PROMIS data sets. We developed 3 profile measures ranging in length from 29 to 57 questions. These profiles assess important HRQoL domains with highly informative subsets of items from respective item banks and yield reliable information across mild-to-severe levels of HRQoL experiences. Each instrument assesses the domains of pain interference, fatigue, depression, anxiety, sleep disturbance, physical function, and social function using 4-, 6-, and 8-item short forms for each domain, and an average pain intensity domain score, using a 0-10 numeric rating scale. ResultsWith few exceptions, all domain short forms within the profile measures were highly reliable across at least 3 standard deviation (30 T-score) units and were strongly correlated with the full bank scores. Construct validity with ratings of general health and quality of life was demonstrated. Information to inform statistical power for clinical and general population samples is also provided. ConclusionsAlthough these profile measures have been used widely, with summary scoring routines published, description of their development, reliability, and initial validity has not been published until this article. Further evaluation of these measures and clinical applications are encouraged.

The Academic Anxiety Inventory: Evidence for Dissociable Patterns of Anxiety Related to Math and Other Sources of Academic Stress.

Anxiety about mathematics can have detrimental effects on performance and understanding, yet little research has investigated how math anxiety is related to other types of anxiety. Here we develop the Academic Anxiety Inventory (AAI), an efficient and valid self-report measure designed to test math anxiety, as well as differentiate anxiety associated with mathematics from other contributions of anxiety across various academic domains. In Study 1, we isolated items that independently measure each domain of anxiety, reducing the overlapping variance between math anxiety and other constructs, and determining which components can or cannot be differentiated. Studies 2 and 3 demonstrate that the AAI is consistent and reliable for undergraduate and adolescent populations. In Study 3, anxiety-related performance deficits in a high school math class were associated with scores the AAI-Math subscale. In Study 4, the AAI-Math subscale was associated with perceptions of increased mathematical complexity, decreased estimations of accuracy, and increased negative emotion when participants viewed mathematical expressions. Across four studies, we demonstrate the AAI is a reliable and valid measure of math anxiety and other domains of academic anxiety, providing an efficient questionnaire to determine areas in which students may require extra support in order to reach their full potential.

A Psychometric Evaluation of the Social Anxiety Scale for Adolescents in an Educational Setting

Social anxiety in adolescents oftentimes goes undetected because of the internalized nature of the disorder as well as adolescents’ reluctance to discuss their mental health. A reliable and valid self-report measure for assessing symptoms of social anxiety in adolescents for use in an educational setting is particularly important because of the burden that social anxiety can have in educational settings. This study aimed to test the previously proposed two-factor structure of the Social Anxiety Scale for Adolescents (SASA), Apprehension and Fear of Negative Evaluation and Tension and Inhibition in Social Contact, in an adolescent sample ( n = 215; 12-18 years; 90 female) in Ireland using confirmatory factor analysis (CFA). CFA validated the two-factor structure of the SASA previously found in Slovenian- and Spanish-speaking samples. Correlations with other measures of social anxiety also showed good validity for the SASA.

Factor Structure and Psychometric Properties of the Peritraumatic and Posttraumatic Emotions Questionnaires Among Active Duty Military Personnel With Posttraumatic Stress Disorder.

The Peritraumatic Emotions Questionnaire (Peri-TEQ) and Posttraumatic Emotions Questionnaire (Post-TEQ) are self-report measures of emotions experienced during and after a traumatic event, respectively. The factor structure and psychometric properties of the Peri- and Post-TEQ were investigated among 474 military personnel with posttraumatic stress disorder (PTSD) following deployment. Exploratory factor analysis and confirmatory factor analysis were conducted to test the factor structure of the scales. Internal consistency, composite reliability, convergent validity, and discriminant validity were also assessed. Four factors were identified for the Peri-TEQ (Fear, Humiliation, Anger, and Sadness), and three factors were identified for the Post-TEQ (Fear, Anger-Hurt, and Humiliation). The full scales and all subscales demonstrated adequate-to-good internal consistency, Cronbach's αs = .722-.893. The subscales demonstrated adequate-to-good composite reliability, Cronbach's αs = .763-.861. The Peri- and Post-TEQ demonstrated good convergent validity with measures of PTSD symptoms, rs = .229-.601, ps < .001, and depressive symptoms, rs = .284-.470, ps < .001, and good discriminate validity with measures of resilience, ps = .116-.940, and unit cohesion, Peri-TEQ, p = .304 and Post-TEQ, r = -.123, p = .008. The Humiliation subscales demonstrated good convergent validity with guilt cognitions, rs = .315-.341, ps < .001, and the Anger subscales demonstrated good convergent validity with state anger, rs = .260-.347, ps < .001. The Peri- and Post-TEQ are reliable, valid self-report measures of emotions during and in response to remembering a trauma. The results support the use of these measures in research investigating trauma-related emotions.

Assessing subtypes of restricted and repetitive behaviour using the Adult Repetitive Behaviour Questionnaire-2 in autistic adults

BackgroundThe majority of previous research into restricted and repetitive behaviours (RRBs) has focussed on children, partly due to a lack of suitable measures for RRBs in adults. This study aimed to explore the psychometric properties of the Adult Repetitive Behaviour Questionnaire-2 (RBQ-2A) in a large sample of autistic adults using a self-report questionnaire method.MethodsThe RBQ-2A and Autism-Spectrum Quotient (AQ) were administered online. Data from 275 autistic adults aged 18–66 (M = 36.56, SD = 12.24; 100 men and 171 women) were analysed using polychoric principal components analysis (PCA). Reliability and validity were assessed using Cronbach’s alpha and correlation analyses.ResultsPCA resulted in two components of the RBQ-2A, interpretable as repetitive sensory and motor behaviours (RSMB) and insistence on sameness (IS). Both components showed acceptable internal consistency (α = .70 and .81 respectively) and were significantly moderately correlated with scores on the AQ (rs = .25 and .42). Participants’ scores on IS were higher than their scores on RSMB. RSMB, but not IS, was negatively associated with age, particularly in older adults (≥ 50 years). There were no gender differences.ConclusionsThe RBQ-2A is a reliable and valid self-report measure of RRBs in the present sample of autistic adults. As one of the few measures of RRBs aimed at adults, it is suitable for adults with the ability to read and complete a self-report questionnaire. Results build on previous work with children using the Repetitive Behaviour Questionnaire-2 (RBQ-2).

Development and Validation of the Occupational Self-Assessment–Short Form

Abstract Date Presented 4/19/2018 To support instrument utility in hospital settings, the Occupational Self-Assessment–Short Form (OSA–SF) was developed and validated. Findings indicate that the OSA–SF is a valid and reliable patient-centered self-report measure of perceived occupational competence and value in inpatient rehabilitation. Primary Author and Speaker: Rikki Ostrowski Additional Authors and Speakers: Jennifer Wescott Contributing Authors: Renee R. Taylor

Self-assessment of negative symptoms – Critical appraisal of the motivation and pleasure – Self-report's (MAP-SR) validity and reliability

ObjectiveThe negative symptom domain remains a major challenge concerning treatment. A valid self-report measure could assist clinicians and researchers in identifying patients with a relevant subjective burden. The Motivation and Pleasure - Self Report (MAP-SR) derives from the CAINS and is supposed to reflect the “amotivation” factor of negative symptoms. We evaluated different aspects of the scale's reliability and validity. This is the first factorial analysis as well as the first analysis of test-retest reliability. MethodsWe assessed three samples of subjects with schizophrenia or schizoaffective disorder (n = 93) and a broad spectrum of related domains. ResultsWe explored a 3-, 2- and 1-factor solution (explaining 50.93, 44.85 and 36.18% of variance, respectively). The factor “pleasure and hedonic activity” consists of eight items and was most robust; the factors “social motivation” and “motivation for work” were problematic. Test-retest reliability of the scale was adequate (rS = 0.63, p = .005). Neither the MAP-SR nor the “pleasure and hedonic activities” factor are associated with the PANSS negative symptom scale. There are significant associations with the observer-rated CAINS-MAP scale, experiences of pleasure, and social cognition but none with functional outcome. Discriminant validity could not be established with regards to depression and extrapyramidal symptoms. ConclusionsWe found that the MAP-SR is adequate to assess anhedonia but is less suitable when assessing motivation. Therefore, we propose using the “pleasure and hedonic activity scale” to cover the “anhedonia” subdomain. We think the “motivation” part of the instrument requires reconstruction.

Epistemic Orientation Short Scale: Development and Validity Evidence in a Sample of Psychotherapists

Abstract Epistemic orientation refers to the preferred mode of accessing and using knowledge and is a construct of growing interest in psychotherapy research. In this context, the main objective of this study was to develop and provide initial validity evidence for a brief measure of epistemic orientation in a sample of Brazilian psychotherapists. Participants were 674 Brazilian psychotherapists (78.5% female), aged between 22 and 78 years. Exploratory and confirmatory factor analyses were conducted on different subsamples to establish the structure of the measure. Results revealed an instrument consisting of three factors (Rationalism, Intuitionism, and Empiricism) with good psychometric properties and fit indices (X 2 = 1.92, GFI = 0.94, CFI = 0.95 and RMSEA = 0.06). Factors exhibited good internal consistency and convergent and discriminant validity. Criterion validity was evaluated by examining the scale’s ability to detect differences in the epistemic orientation dimensions as a function of therapist’s theoretical approach. Overall, the scale proved to be a valid self-report measure for investigating personal epistemology.

Psychometric properties of the Polish version of the Self-Concept Clarity Scale (SCCS)

BackgroundSelf-concept clarity is one of the features describing the structural aspect of the self. It refers to the extent to which the contents of an individual’s self-concept are clearly and confidently defined, internally consistent, and temporally stable. The aim of the study was to translate and evaluate the psychometric properties of the Polish version of the Self-Concept Clarity Scale (SCCS).Participants and procedureA total of 2507 graduates and undergraduates participated in the study. Their ages ranged from 18 to 70 years (M = 24.74, SD = 23.00); 66% of them were female. The Polish version of the SCCS was developed using the back-translation method. The SCCS was administered along with measures of sense of self (Sense of Self Scale), self-esteem (Rosenberg Self-Esteem Scale), psychological distress (Goldberg General Health Questionnaire), personality (NEO-Five Factor Inventory), and social desirability (Marlowe-Crowne Social Desirability Scale).ResultsThe factor structure, reliability, and validity of the scale was investigated. Results from exploratory and confirmatory factor analysis showed a one-factor solution. Internal reliability and test–retest reliability was high. Significant relations between SCCS and weak sense of self, self-esteem, psychological distress, personality, and social desirability supported its convergent validity.ConclusionsThis study demonstrated that the Polish version of the SCCS is a reliable and valid self-report measure for the self-concept clarity.

The Psychometric Properties of the German Language Reinforcement Sensitivity Theory-Personality Questionnaire (RST-PQ)

Abstract. The aim of this study was to assess the psychometric properties of a German translation of the Reinforcement Sensitivity Theory of Personality Questionnaire (RST-PQ; Corr &amp; Cooper, 2016 ). Five hundred twenty-seven participants completed the German version of the RST-PQ, in addition to a battery of related self-report personality questionnaires. A six-factor structure, with two unitary defensive factors, fight-flight-freeze system (FFFS; related to fear) and the behavioral inhibition system (BIS; related to anxiety), and four behavioral approach system (BAS) factors (Reward Interest, Goal-Drive Persistence, Reward Reactivity, and Impulsivity), was supported by confirmatory factor analysis, confirming the English language version of the RST-PQ. Convergent and discriminant validity for the six-factor structure was demonstrated in relation to existing personality scales. Results showed that the German version of the RST-PQ is a reliable and valid self-report measure of the revised Reinforcement Sensitivity Theory (rRST) of personality. This version of the RST-PQ is offered to facilitate work on approach-avoidance theories of personality using German language samples.

Assessing hearing and cognition challenges in consumer processing of televised risk information: Validation of self-reported measures using performance indicators

Public health researchers face important challenges if they wish to include measures of hearing or cognitive ability in risk communication studies. We sought validity evidence for self-report measures of hearing and cognitive ability by comparing those measures to performance-based measures and risk information recall. We measured hearing ability (with audiologist-assisted assessment and self report), cognitive ability (with an established performance task and self report), and reactions to direct-to-consumer prescription drug promotion with adults 18 and older (n = 1064) in North Carolina, USA, in 2017. We found moderate correspondence between self-reported hearing loss and audiologist-assessed hearing loss. Both measures also showed a small negative association with recall of presented risk information. Cognitive ability results suggested less substantial correspondence between self report and performance task and the measures differed in predicting risk recall. Our results suggested a moderately efficient measure for hearing ability for research on risk information exposure and retention, and yet also suggested the need for caution regarding future use of self-reported cognitive ability as a substitute for a performance-based measure.

The Reliability and Validity of a Self-Report Measure of Cognitive Abilities in Older Adults: More Personality than Cognitive Function.

The development of brief, reliable and valid self-report measures of cognitive abilities would facilitate research in areas including cognitive ageing. This is due to both practical and economic limitations of formal cognitive testing procedures. This study examined the reliability and validity of the newly developed Self-Report Measure of Cognitive Abilities (SRMCA; Jacobs & Roodenburg, 2014); a multi-item self-report tool designed to assess cognitive function in the ability areas of fluid reasoning (Gf), comprehension-knowledge (Gc) and visual processing (Gv). Participants were (n = 93) cognitively healthy older adults aged between 52 and 82 years who completed the SRMCA, the Big Five Inventory and a battery of cognitive tasks. Results revealed adequate reliability for the SRMCA and convergent validity for the Gc domain but not for Gf or Gv. Moreover, significant personality bias was evident with Extraversion (positively), Openness to Experience (positively) and Neuroticism (negatively) predicting SRMCA responses independently of actual cognitive performance. Thus, although the SRMCA appears to be reliable in older adults, personality was a stronger predictor of self-estimated cognitive abilities than actual cognitive performance, questioning the utility of this tool as a subjective measure of cognitive ability.

Validation of the Farsi version of the revised Adolescent Sleep Hygiene Scale (ASHSr): a cross-sectional study

BackgroundRestoring sleep is associated with a broad variety of favorable cognitive, emotional, social and behavioral benefits during the day. This holds particularly true for adolescents, as maturational, social, cognitive, emotional and behavioral changes might unfavorably impact on adolescents’ sleep. Among adolescents, poor sleep hygiene practices are a potentially modifiable risk factor that can be addressed via appropriate interventions. Accordingly, having reliable and valid self-report measures to assess sleep hygiene practices is essential to gauge individual responses to behavioral interventions and evaluate sleep hygiene recommendations. The aim of the present study therefore was to translate and to test the psychometric properties (internal consistency, test-retest reliability, factorial and concurrent validity) of the Farsi/Persian version of the revised version of the Adolescent Sleep Hygiene Scale (ASHSr).MethodA total of 1013 adolescents (mean age: M = 15.4 years; SD = 1.2; range: 12–19 years; 42.9% females) completed the ASHSr and the Pittsburgh Sleep Quality Index (PSQI) in their classroom during an official school lesson. Further, 20% completed the ASHSr 6 weeks later to evaluate the test-retest reliability. Cronbach’s alpha coefficients were calculated to examine internal consistency, confirmatory factor analysis (CFA) was used to test factorial validity, whereas concurrent validity and test-retest reliability were examined via correlation analyses.ResultsA first-order confirmatory factor analysis (CFA) corroborated the six-factor structure of the ASHSr, including a physiological, behavioral arousal, cognitive/emotional, daytime sleep, sleep environment, and sleep stability factor. A second-order CFA showed that a higher-order sleep hygiene construct explained sufficient variance in each factor. Cronbach’s alpha values ranged between .71 and .75, correlations for test-retest reliability between .82 and .87. Significant correlations were found between most ASHSr scales and the PSQI indices. However, the magnitude of these correlations was weak.ConclusionsThe Farsi/Persian version of the Adolescent Sleep Hygiene Scale can be used as a reliable and valid tool for evaluation of sleep hygiene practices among Farsi/Persian-speaking adolescents.

Modeling of quality of life in older adults with advanced cancer: Data from a URCC NCORP multisite trial.

218 Background: While the importance of symptom assessment is well recognized in Palliative Care (PC), limited evidence is available on the growing population of older adults with advanced cancer. Increasingly geriatric assessment (GA), which incorporates validated tools to assess health status, is advocated as a component of the care for older patients with cancer, but is not routinely incorporated into PC evaluations. We tested the hypothesis that variability in QoL for older adults with advanced cancer would be predicted by both symptoms and GA. Methods: Data from an ongoing cluster RCT conducted at 68 oncology practices were analyzed. Inclusion criteria were: &gt; 70 years old, advanced solid tumor diagnosis, impairment in at least 1 GA domain (e.g., function). Multiple reliable and valid objective assessments and self-report measures for each GA domain were completed. Symptoms were assessed by MD Anderson Symptom Inventory (MDASI). Hierarchical regression modeling was conducted. The dependent variable was FACT score at Time 2 (4-6 weeks). The independent (Time 1) variables were entered in 3 steps: 1) gender, race, educational level( &lt; or &gt; high school), cancer type ( GI / Lung or other), receiving chemotherapy; 2) MDASI, 3) GA measures: Polypharmacy, Blessed Orientation and Memory Concentration Test, % weight loss, Short Physical Performance Battery, Instrumental Activities of Daily Living (IADL), Older Adult Resource Survey (OARS) Comorbidity, OARS Medical Social Support, and Generalized Anxiety Disorder-7. Results: N = 342 at time 1 (Mean age 77 years, 43% female, 90% white, 51% high school graduates, 49% GI or Lung cancer, 68% on chemotherapy). N = 303 at time 2(11% attrition due to death or withdrawal). Overall, 46% of variance in QoL was explained (demographic and disease characteristics: 4% [p = .05], symptoms: 32% [p &lt; .0001], GA measures: 10% [p &lt; .0001]). Significant individual GA predictors of worse QoL were lower social support, higher anxiety, impairment in IADLs, and poorer physical performance. Conclusions: Findings suggest that GA explains variance in quality of life scores for older adults with advanced cancer and reinforce the importance of symptom assessment and management in this population. Clinical trial information: NCT02107443.

The Validity of Self-Report Measures in Assessing Historical Knowledge: The Case of Canada’s Residential Schools

The Truth and Reconciliation Commission of Canada (TRC) strives to increase public education regarding residential schools. A baseline measure of the public’s residential school knowledge could be useful to evaluate the progress of the TRC. The National Benchmark Survey, Urban Aboriginal Peoples Study, and Canadian Public Opinion on Aboriginal Peoples Report are three existing surveys that provide such a baseline, though each use only self-report measures. We measured residential school knowledge of 2,250 non-Indigenous Canadian undergraduate students through self-report (subjective) and multiple-choice (objective) measures. Analyses revealed a statistically significant correlation between self-reported and objective knowledge of residential schools.

Individual and environmental correlates of objectively measured physical activity and sedentary time in adults from Curitiba, Brazil

ObjectivesThis study assessed the association of individual and neighborhood environment characteristics and objectively measured physical activity (PA) and sedentary time (ST) in adults from Curitiba, Brazil.MethodsA population-based cross-sectional study was conducted through face-to-face household interviews in 2010. The analytic sample included 305 adults aged 20–65 years recruited from 32 census tracts selected according to neighborhood walkability and socioeconomic status. Individual and environmental PA correlates were evaluated through standardized and valid self-reported measures, including the Neighborhood Environment Walkability Scale. Minutes per week of PA and ST were assessed through accelerometry. Multi-level regression models were used in the analyses.ResultsAfter adjusting for confounders the strongest individual and environmental correlates associated with ST was residential density (B = 0.14; p = 0.008), light-intensity PA was being a father/mother (B = 35.71; p = 0.025) and moderate-to-vigorous PA was sex (B = 0.91; p < 0.001) and number of cars (one car, B = −1.05; two cars, B = −1.14; p < 0.001).ConclusionsThe associations found with individual and environmental correlates varied accordingly across all outcomes. Future changes in policies and infrastructure should consider the social context of the community and improvements to promote a safer environment in the neighborhood.

Development of a youth-report measure of DPN symptoms: Conceptualization and content validation

AimsTo develop a content valid youth-report measure of diabetic peripheral neuropathy (DPN) symptoms. MethodsSemi-structured interviews with 5 clinicians and 15 youth aged 8–17 with diabetes were conducted to elicit and clarify youth’s DPN experiences. A systematic review of existing adult-report DPN symptom measures was conducted to identify item concepts representative of each experience. The concepts were transformed into items that were iteratively revised based on cognitive interviews (n=13 youth aged 8–17) and readability analyses. ResultsClinician and youth interviews supported a tripartite conceptual framework of youth DPN symptoms: paresthesia, pain, and anesthesia. Forty-eight youth-report items were generated to represent DPN symptoms identified through the semi-structured interviews and a systematic review of 13 symptom questionnaires for adults. Of these, 23 were eliminated and 3 were revised based on cognitive interviews conducted with youth. The remaining 25 items were on average, written at a 3rd grade reading level. ConclusionsThis study is the first to generate a content valid self-report measure of youth’s lived experiences with DPN that uses developmentally appropriate terminology. With further psychometric testing, the measure could be used to advance research on pediatric DPN and enhance clinicians’ capacity to identify the condition in childhood.

Just Ask Me: Convergent Validity of Self-Reported Measures of Music Participation

The purpose of this study was to determine the convergent validity of self-reported and objective measures of school music ensemble participation. Self-reported survey responses to a question about high school music ensemble participation and administrative data in the form of high school transcript-indicated ensemble enrollments were compared across N = 62,110 observations. Cohen’s kappa (κ) showed substantial agreement between self-reports and the administrative data. Evidence from the study suggests that self-reports are a valid measure of music ensemble participation, suitable for use in social scientific music education research.

A brief measure to predict exercise behavior: the Archer-Garcia Ratio.

BackgroundDifferent forms of conscious and planned physical exercise and activity that individuals perform improve not only physical but also psychological health, well-being, and both physical and intellectual performance. Here we put forward and test the predictive validity of the Archer-Garcia Ratio, a brief measure for exercise frequency computed using participants’ responses to two questions.MethodThe participants (N = 158) were recruited from a training facility in the south of Sweden. The Archer-Garcia Ratio was constructed by standardizing (i.e., z-scores) and then summarizing individuals’ responses to two questions: “How often do you exercise?” (1 = never, 5 = 5 times/week or more) and “Estimate the level of effort when you exercise” (1 = none or very low, 10 = very high). Participants responded also to the Godin Leisure-Time Exercise Questionnaire and allowed the collection of electronic data to track the number of times they had trained six months before and both six and twelve months after the survey.ResultsThe Archer-Garcia Ratio predicted, moderately, how often individuals had trained during the six months before and both six months and twelve months after the survey.ConclusionThe Archer-Garcia Ratio is a brief and valid self-report measure that can be used to predict actual retrospective and prospective exercise behavior. It offers a simple and straightforward form to estimate adherence, compliance and propensities of peoples’ exercise habits.