Initial Evidence Of Construct Validity Research Articles

Development of the Experiences of Humility Scale

In three studies, we developed the Experiences of Humility Scale (EHS). In Study 1, we used exploratory factor analysis to determine the factor structure and to reduce items in a sample of undergraduates (N = 200). The EHS had four subscales: Other-orientation, Transcendence, Awareness of Selfishness, and Awareness of Egotism. Study 2 involved an experiment with a second sample of college students (N = 106) that provided initial evidence of construct validity. Participants assigned to a Meaning Condition (i.e., writing about a most meaningful event) reported lower levels of awareness of egotism and selfishness than did participants assigned to a Neutral Condition. In Study 3, with a third sample of college students (N = 155), we replicated the factor structure of the EHS using confirmatory factor analysis and evaluated additional evidence of construct validity. As predicted, the EHS subscales predicted constructs associated with spiritual connection and meaning. Likewise, providing evidence of discriminant validity, the EHS subscales were only moderately related to traits of humility, agreeableness, and neuroticism.

Vascular function assessed by passive leg movement and flow-mediated dilation: initial evidence of construct validity

The vasodilatory response to passive leg movement (PLM) appears to provide a novel, noninvasive assessment of vascular function. However, PLM has yet to be compared with the established noninvasive assessment of vascular health, flow-mediated dilation (FMD). Therefore, as an initial evaluation of the construct validity of PLM and upright seated and supine PLM as well as brachial (BA) and superficial femoral (SFA) artery FMDs were performed in 10 young (22 ± 1) and 30 old (73 ± 2) subjects. During upright seated PLM, the peak change in leg blood flow (ΔLBF) and leg vascular conductance (ΔLVC) was significantly correlated with BA (r = 0.57 and r = 0.66) and SFA (r = 0.44 and r = 0.41, ΔLBF and ΔLVC, respectively) FMD. Furthermore, although the relationships were not as strong, the supine PLM response was also significantly correlated with BA (r = 0.38 and r = 0.35) and SFA (r = 0.39 and r = 0.35, ΔLBF and ΔLVC, respectively) FMD. Examination of the young and old separately, however, revealed that significant relationships persisted in both groups only for the upright seated PLM response and BA FMD (young: r = 0.73 and r = 0.77; old: r = 0.35 and r = 0.45, ΔLBF and ΔLVC, respectively). Normalizing FMD for shear rate during PLM abrogated all significant relationships between the PLM and FMD response, suggesting a role for nitric oxide (NO) in these associations. Collectively, these data indicate that PLM, particularly upright seated PLM, likely provides an index of vascular health analogous to the traditional FMD test. Given the relative ease of PLM implementation, these data have important positive implications for PLM as a clinical vascular health assessment.

Tripartite Employee Loyalty (TEL): Validation, Measurement and Selected Outcomes of a New Concept

In this research, the new Tripartite Employee Loyalty (TEL) construct is developed and defined. The three crucial reference objects for employee loyalty, supervisor, working group, and organization, have never before been investigated simultaneously. This shortcoming is addressed with a 9-item measure derived from an intensive literature review. Initial construct validity evidence for the TEL construct is provided by an empirical study of 148 employees of a German service company. Applying factor analysis, TEL is shown to be distinct from organizational commitment. With regards to content validity, the present study highlights the importance of differentiating between reference objects when investigating employee loyalty and its outcomes. The selected loyalty outcomes, openness to leave, openness to reapply, and openness to change, differ within the subscales of loyalty to supervisor, loyalty to working group, and loyalty to organization. Correlation and multiple regression results strongly suggest that incomplete or inaccurate conceptualizations of employee loyalty lead the way to incorrect results and misleading interpretations. The resulting theoretical and practical implications are discussed in this paper, along with limitations of the study and recommendations for future research.

The Factor Structure, Internal Consistency, and Convergent Validity of Two Suicide Assessment Competency Measures in Vocational Rehabilitation Counselors

We analyzed the psychometric properties of two published self-report suicide assessment competency rating scales—the Suicide Competency Inventory (SCI) and the Suicide Competency Assessment Form (SCAF)—in a multistate sample of 223 public-sector vocational rehabilitation counselors. Both measures demonstrated very good to excellent internal consistency in our sample. Exploratory factor analysis indicated the SCI loads on a three-factor model whereas the SCAF loads on a single factor; these are consistent with the theoretical scale structures proposed by the original authors of the scales. In addition, both scales were highly correlated with each other, providing strong initial evidence of construct validity. In sum, our results support the use of these measures as a reliable and valid means of assessing perceived suicide assessment competency in rehabilitation counselors.

Development and validation of the Zurich Meeting Questionnaire (ZMQ)

Introduction and objectivesResearch highlights the importance of identifying and examining crucial meeting characteristics and procedures. Thus, the aim of the present research is to develop and validate the Zurich Meeting Questionnaire (ZMQ), an instrument that assesses meeting attendees’ perceptions of meeting design characteristics and task- and relational-oriented procedures during the meeting. MethodThree independent samples (n1=474, n2=464, n3=311) were used to test the psychometric properties, factorial structure, criterion validity, and construct validity of the ZMQ. ResultsResults of confirmatory factor analyses confirmed the assumed two-dimensional structure of meeting procedures. Furthermore, the results provided criterion validity evidence regarding meeting satisfaction and perceived meeting effectiveness. Finally, the pattern of correlations with external variables (team climate inventory, psychological safety, and social desirability) provided initial evidence of construct validity. ConclusionThe ZMQ is a short and psychometrically sound measure of meeting design characteristics and procedures during meetings and is suitable for use in organizational research and the evaluation of meetings in practice.

Measuring Environmental Factors: Unique and Overlapping International Classification of Functioning, Disability and Health Coverage of 5 Instruments

ObjectivesTo describe the unique and overlapping content of the newly developed Environmental Factors Item Banks (EFIB) and 7 legacy environmental factor instruments, and to evaluate the EFIB's construct validity by examining associations with legacy instruments. DesignCross-sectional, observational cohort. SettingCommunity. ParticipantsA sample of community-dwelling adults with stroke, spinal cord injury, and traumatic brain injury (N=568). InterventionsNone. Main Outcome MeasuresEFIB covering domains of the built and natural environment; systems, services, and policies; social environment; and access to information and technology; the Craig Hospital Inventory of Environmental Factors (CHIEF) short form; the Facilitators and Barriers Survey/Mobility (FABS/M) short form; the Home and Community Environment Instrument (HACE); the Measure of the Quality of the Environment (MQE) short form; and 3 of the Patient Reported Outcomes Measurement Information System's (PROMIS) Quality of Social Support measures. ResultsThe EFIB and legacy instruments assess most of the International Classification of Functioning, Disability and Health (ICF) environmental factors chapters, including chapter 1 (products and technology; 75 items corresponding to 11 codes), chapter 2 (natural environment and human-made changes; 31 items corresponding to 7 codes), chapter 3 (support and relationships; 74 items corresponding to 7 codes), chapter 4 (attitudes; 83 items corresponding to 8 codes), and chapter 5 (services, systems, and policies; 72 items corresponding to 16 codes). Construct validity is provided by moderate correlations between EFIB measures and the CHIEF, MQE barriers, HACE technology mobility, FABS/M community built features, and PROMIS item banks and by small correlations with other legacy instruments. Only 5 of the 66 legacy instrument correlation coefficients are moderate, suggesting they measure unique aspects of the environment, whereas all intra-EFIB correlations were at least moderate. ConclusionsThe EFIB measures provide a brief and focused assessment of ICF environmental factor chapters. The pattern of correlations with legacy instruments provides initial evidence of construct validity.

Validation of the Mayo Hip Score: construct validity, reliability and responsiveness to change.

BackgroundPrevious studies have provided the initial evidence for construct validity and test-retest reliability of the Mayo Hip Score. Instruments used for Total Hip Arthroplasty (THA) outcomes assessment should be valid, reliable and responsive to change. Our main objective was to examine the responsiveness to change, association with subsequent revision and the construct validity of the Mayo hip score.MethodsDiscriminant ability was assessed by calculating effect size (ES), standardized response mean (SRM) and Guyatt’s responsiveness index (GRI). Minimal clinically important difference (MCII) and moderate improvement thresholds were calculated. We assessed construct validity by examining association of scores with preoperative patient characteristics and correlation with Harris hip score, and assessed association of scores with the risk of subsequent revision.ResultsFive thousand three hundred seven provided baseline data; of those with baseline data, 2,278 and 2,089 (39 %) provided 2- and 5-year data, respectively. Large ES, SRM and GRI ranging 2.66–2.78, 2.42–2.61 and 1.67–1.88 were noted for Mayo hip scores with THA, respectively. The MCII and moderate improvement thresholds were 22.4–22.7 and 39.4–40.5 respectively. Hazard ratios of revision surgery were higher with lower final score or less improvement in Mayo hip score at 2-years and borderline significant/non-significant at 5-years, respectively: (1) score ≤55 with hazard ratios of 2.24 (95 % CI, 1.45, 3.46; p = 0.0003) and 1.70 (95 % CI, 1.00, 2.92; p = 0.05) of implant revision subsequently, compared to 72-80 points; (2) no improvement or worsening score with hazard ratios 3.94 (95 % CI, 1.50, 10.30; p = 0.005) and 2.72 (95 % CI, 0.85,8.70; p = 0.09), compared to improvement >50-points. Mayo hip score had significant positive correlation with younger age, male gender, lower BMI, lower ASA class and lower Deyo-Charlson index (p ≤ 0.003 for each) and with Harris hip scores (p < 0.001).ConclusionsMayo Hip Score is valid, sensitive to change and associated with future risk of revision surgery in patients with primary THA.Electronic supplementary materialThe online version of this article (doi:10.1186/s12891-016-0868-3) contains supplementary material, which is available to authorized users.

Construct validity evidence for a measure of peer athletic reputation (PAthR) in high school physical education

Grounded in the work that has been conducted on peer academic reputation in educational settings, our aim was to develop and provide initial construct validity evidence for a modified instrument designed to assess peer athletic reputation (PAthR). In phase 1, we devised a series of items to assess PAthR. In phase 2 (n = 399), and approximately one month later in phase 3 (n = 374), female high school physical education (PE) students completed a series of questionnaires that included the PAthR instrument. Analyses indicated that PAthR was (a) represented as a unitary construct, (b) positively associated across time points, (c) positively associated with indicators of desirable peer interactions (e.g., peer relatedness support, peer relatedness need satisfaction) and PE experiences (e.g., intrinsic motivation, perceived competence), and (d) negatively associated with indices considered to be less adaptive in nature (i.e., anxiety, amotivation). These findings provide preliminary support for a novel approach to the measurement of peer reputation in PE, and demonstrate evidence of the nomological net with which this concept may be associated.

Development of the Work Intention Inventory Short–Form

The Work Intention Inventory (WII: Zigarmi, Nimon, Houson, Witt, &amp; Diehl, 2012) was designed to assess five measures of work intention. Measuring employee intentions is important to consider when evaluating outcomes associated with employee engagement or work passion as research indicates intentions are strong predictors of behavior. Following scale reduction procedures developed by Stanton, Sinar, Balzer, and Smith (2002), we used inter–item covariance matrices from Zigarmi et al. (2012) and data resulting from the field test of the WII–Short Form (WII–SF) in a manufacturing company to develop a short form of the WII and provide initial evidence of construct validity. There is preliminary evidence to indicate that the WII–SF may offer practitioners and researchers an efficient way to reliably and validly assess employee work intentions

Parental Academic Support: A Validity Report

This study offers validity evidence for the Parental Academic Support Scale, a 16-item multidimensional measure that assesses support related to a child's academic performance, classroom behavior, preparation, hostile peer interactions, and health. Confirmatory factor analysis of the Parental Academic Support Scale (PASS) revealed a close model fit and replicated prior confirmatory factor analysis tests, and ultimately provided additional evidence for content validity. Correlations between parental academic support and the Teacher–Parent Contact Scale provided concurrent validity evidence. More importantly, associations between parental academic support and a child's success in school suggest that the PASS construct is related to other theoretically similar constructs, providing initial evidence for construct validity. Implications and recommendations for future research are discussed.

Critical Consciousness and Vocational Development Among Latina/o High School Youth

Critical consciousness of inequity and racism may be a significant asset for Latina/Latino youth’s educational persistence and vocational development. This study describes the development and testing of a new measure of critical consciousness in two samples of Latina/Latino adolescents. Study 1 presents an exploratory factor analysis of the critical consciousness items in a sample of 476 Latina/Latino students from 65 high schools. Study 2 presents confirmatory factor analyses of the items in a separate sample of Latina/Latino students from 74 high schools for the English ( n = 680) and Spanish ( n = 190) versions of the measure. A two-factor structure (Critical Agency and Critical Behavior) provided a good fit to the data. Relationships between Critical Agency, Critical Behavior, and variables such as postsecondary education plans, vocational outcome expectations, engagement (in school, extracurricular activities, Spanish language, and helping others), and thoughts of dropping out provide initial evidence of construct validity. Strengths, limitations, and future directions are discussed.

Validation of the Polish version of the Collective Self-Esteem Scale

&lt;b&gt;Background&lt;/b&gt;&lt;br /&gt; The aim of this article is to present research on the validity and reliability of the Collective Self-Esteem Scale (CSES) for the Polish population. The CSES is a measure of individual differences in collective self-esteem, understood as the global evaluation of one’s own social (collective) identity.&lt;br /&gt; &lt;br /&gt; &lt;b&gt;Participants and procedure&lt;/b&gt;&lt;br /&gt; Participants from two samples (n = 466 and n = 1,009) completed a paper-pencil set of questionnaires which contained the CSES and the Rosenberg Self-Esteem Scale (RSES), and subsets of participants completed scales related to a sense of belonging, well-being and psychological distress (anxiety and depression).&lt;br /&gt; &lt;br /&gt; &lt;b&gt;Results&lt;/b&gt;&lt;br /&gt; Like the original version, the Polish version of the CSES comprises 16 items which form the four dimensions of collective self-esteem: Public collective self-esteem, Private collective self-esteem, Membership esteem and Importance of Identity. The results confirm the four-factor structure of the Polish version of the CSES, support the whole Polish version of the CSES as well as its subscales, which represent satisfactory reliability and stability, and provide initial evidence of construct validity.&lt;br /&gt; &lt;br /&gt; &lt;b&gt;Conclusions&lt;/b&gt;&lt;br /&gt; As the results of the study indicate, the Polish version of the CSES is a valid and reliable self-report measure for assessing the global self-esteem derived from membership of a group and has proved to be useful in the Polish context.

Construct validity evidence for the individual Authenticity Measure at Work in Brazilian samples

Authenticity at work is characterized as the extent to which individuals feel and act coherently with themselves. The objective in this study was to adapt and obtain initial construct validity evidence of the Individual Authenticity Measure at Work in the Brazilian context. The sample consisted of 477 employees, who answered an initial version of the scale, consisting of 12 items. To correlate the measure with other variables, tools were used to measure positive and negative constructs associated with work and life. The results of exploratory and confirmatory factor analyses permitted the complete reproduction of the three-factor structure of the original version. The authentic experience was positively correlated with positive and significant aspects of work and life and negatively with negative aspects of work and life, while the opposite happened with self-alienation. It was concluded that the scale demonstrated initial construct validity evidences, which recommends its use for future research situations.

A new measure of multimorbid illness and treatment representations: The example of diabetes and depression

BackgroundDepression is two to three times more common in people with diabetes than in the general population. Although multimorbid diabetes and depression is associated with poor health outcome, existing research has focused on patients׳ understanding and management of each condition in isolation. This study describes the development and validation of the Diabetes and Depression Representation and Management Questionnaire (DDRMQ), a measure of understanding, management and medication beliefs in people with diabetes and depression. MethodsIn Study 1, DDRMQ items were developed through further analysis of an earlier qualitative study and refined through 18 cognitive interviews. In Study 2, 334 adults with diabetes and depression from general practices, diabetes clinics and support groups completed the DDRMQ, demographic questions and validating measures. ResultsFactor analysis of the DDRMQ using principal axis factoring resulted in a 35 item scale organised into ten subscales. The modified measure had adequate internal and test–retest reliability. Initial evidence of construct validity was also demonstrated. LimitationsLow participant response rates and the high percentage of well-educated white participants limit the generalisability of results. As Study 2 was cross-sectional, future research is needed to establish if different ways of thinking about and managing diabetes and depression can predict patient outcome. ConclusionsThe DDRMQ is the first measure of patient understanding, management and medication beliefs in people with established diagnoses of both diabetes and depression. The DDRMQ will facilitate an increased awareness of the patient experience of diabetes and depression and help inform patient centred care and intervention development for people with multiple conditions.

Spanish adaptation of the Creative Potential and Practised Creativity scale (CPPC-17) in the workplace and inside the organization

This study follows the theoretical framework put forward by Hinton on creative potential and practised creativity. The objective was to adapt the 17-item Creative Potential and Practised Creativity scale into Spanish and examine its psychometric properties. The study sample was made up of 975 Spanish employees (48.5% men and 51.5% women). After performing a confirmatory factor analysis, the findings revealed a three-factor structure: Creative potential, Practised creativity and Perception of organizational support. Furthermore, appropriate reliability was found for all three factors as well as initial evidence of construct validity in relation to certain external correlates and a series of scales measuring workaholism, irritation, burnout and personality. The present scale may prove ideal for adequately identifying Creative potential, Practised creativity and Perceived organizational support.

Assessing the Key to Effective Coaching in Parent-Child Interaction Therapy: The Therapist-Parent Interaction Coding System.

This paper describes the initial evaluation of the Therapist-Parent Interaction Coding System (TPICS), a measure of in vivo therapist coaching for the evidence-based behavioral parent training intervention, parent-child interaction therapy (PCIT). Sixty-one video-recorded treatment sessions were coded with the TPICS to investigate (1) the variety of coaching techniques PCIT therapists use in the early stage of treatment, (2) whether parent skill-level guides a therapist's coaching style and frequency, and (3) whether coaching mediates changes in parents' skill levels from one session to the next. Results found that the TPICS captured a range of coaching techniques, and that parent skill-level prior to coaching did relate to therapists' use of in vivo feedback. Therapists' responsive coaching (e.g., praise to parents) was a partial mediator of change in parenting behavior from one session to the next for specific child-centered parenting skills; whereas directive coaching (e.g., modeling) did not relate to change. The TPICS demonstrates promise as a measure of coaching during PCIT with good reliability scores and initial evidence of construct validity.

Validity of the Student Interest and Engagement Scales: Associations with Student Learning Outcomes

This study builds validity evidence for the Student Interest Scale and Student Engagement Scale. Confirmatory factor analysis indicates that the factor structures of the new measures are stable, reliable, and valid. The results indicate a positive association between student emotional and cognitive interest and engagement, providing initial evidence for construct validity. Results reveal positive relationships between student interest, learner empowerment, motivation, and affective learning, offering evidence of convergent validity. Analyses reveal that the Student Interest Scale is distinct from Weber, Martin, and Cayanus' (2005) Learner Empowerment Scale, McCroskey's (1994) Affective Learning Scale, and Christophel's (1990) Motivation Scale, while the Student Engagement Scale is distinct from Frymier and Houser's (1999) Learning Indicators Scale, providing discriminant validity evidence.

Scale Development: Heterosexist Attitudes in Women's Collegiate Athletics

Homophobia and heterosexism in women's athletics have been studied extensively using a qualitative approach. Limited research from a quantitative approach has been conducted in the area and none with a sport-specific instrument. The purpose of the current study was to develop a valid and reliable questionnaire to measure heterosexist attitudes in women's collegiate athletics based on the tripartite model of attitudes (Zanna & Rempel, 1988). A panel of experts analyzed a pool of 40 items for item-content related validity. Two samples of collegiate female athletes completed the second and third versions of the Heterosexist Attitudes in Sport–Lesbian questionnaire. Initial evidence of construct validity was found for a 14-item measure of heterosexist attitudes with four subscales: (1) Cognitive/Affective, (2) Language Behaviors, (3) Inclusion Behaviors, and (4) Avoidance of the Lesbian Label. Composite reliability of the four subscales ranged from .64 to .84.

Associations Among Teacher Communication Behaviors, Student Interest, and Engagement: A Validity Test

The results of this study establish the validity of the Student Interest Scale and Student Engagement Scale, as well as associations among teacher communication behaviors, student interest, and engagement. Confirmatory factor analysis indicates that the factor structures of the measures are stable, reliable, and valid. The results indicate positive relationships among teacher immediacy and clarity, and student emotional and cognitive interest and engagement, providing initial evidence for construct validity. Theoretical and pedagogical implications are discussed.

Evaluating the positive and negative benefits of crime: Development and validation of the Decisional Balance Scale for Adolescent Offenders (DBS-AO)

PurposeThe current study focuses on the development and validation of the Decisional Balance Scale for Adolescent Offenders (DBS-AO). This measure was designed to systematically evaluate adolescent offenders’ motivation to end or maintain their criminal behaviors, a critical yet missing component for most assessment measures and treatment programs focused on adolescent offenders. MethodItems based on the decisional balance theory were generated via focus groups and refined through confirmatory factor analyses (CFA) using 238 adolescent offenders from a maximum-security institution. Their results were compared to the stages of change and psychopathic characteristics. ResultsThe CFA demonstrated a good fit for a three-factor model. The first scale, Cons, assesses the negative consequences of ending criminal behavior (e.g., monetary loss). In contrast, the Pros-Self evaluates the positive consequences for offenders when they terminate criminal activities (e.g., improved self-respect). Finally, the Pros-Others considers the positive consequences experienced by significant others when offenders stop engaging in crime (e.g., increased safety). The DBS-AO three scales demonstrated good scale homogeneity and initial evidence of construct validity with the Stages of Change scale. ConclusionsThe DBS-AO provides a theory-driven model for addressing motivational issues for adolescent-offender treatment, which is currently lacking in most interventions for adolescent offenders.