Test-criterion Relationships Research Articles

Psychometric Evaluation of the Modified E-cigarette Evaluation Questionnaire for use with High School Adolescents and Young Adults.

The subjective experience of positive and negative effects of e-cigarette use has been shown to relate to e-cigarette use outcomes in adults, but no validated measure of e-cigarette subjective response exists for adolescents and young adults (AYAs). In the current study, the psychometric properties of the Modified E-cigarette Evaluation Questionnaire (MECEQ) were evaluated for use with AYAs. 997 AYAs who endorsed using nicotine e-cigarettes at least 4 days per week completed an anonymous, online survey in 2022 (51.1% male; 17.39 [1.88] years old; 33.9% Hispanic; 68% White). Analyses included factor analysis to determine the latent structure of the MECEQ, internal consistency, measurement invariance, between-group differences, and test-criterion relationships with vaping frequency and dependence. The originally-proposed, five-factor structure and a novel four-factor structure were supported, and each subscale was internally consistent. Both models reached scalar invariance for all participant subgroups tested (e.g., sex, daily vaping status), and several between-groups differences were observed. For instance, compared to less frequent vaping, daily vaping was associated with increased Craving Reduction (5-factor), reduced Stimulant Effects (4-factor), and reduced Aversion (5-factor; 4-factor). Adjusted relationships between both MECEQ versions and vaping frequency and dependence provided evidence of concurrent validity. Similar to adults, a five-factor and four-factor version of the MECEQ were supported and evidenced internal consistency, scalar measurement invariance, and concurrent relationships with vaping frequency and dependence. Moving forward, researchers are encouraged to include the MECEQ in future studies to better understand the importance of subjective response in AYA vaping behavior. The Modified E-cigarette Evaluation Questionnaire (MCEQ), an e-cigarette-adapted version of the Modified Cigarette Evaluation Questionnaire (MCEQ), recently was validated to assess subjective e-cigarette effects among adults. Here, we demonstrate that the MECEQ can be used among adolescents and young adults (AYAs). The MECEQ can be scored using the original, five-factor MCEQ structure or using a novel, four-factor structure. Both versions were internally consistent, reached scalar measurement invariance, and evidenced concurrent relationships with vaping frequency and dependence. In sum, this study provides the field with the first psychometrically-sound measure of subjective effects of e-cigarette use for use with AYAs.

Adapting a self-efficacy scale to the task of teaching scientific reasoning: collecting evidence for its psychometric quality using Rasch measurement.

Besides teachers' professional knowledge, their self-efficacy is a crucial aspect in promoting students' scientific reasoning (SR). However, because no measurement instrument has yet been published that specifically refers to self-efficacy beliefs regarding the task of teaching SR, we adapted the Science Teaching Efficacy Belief Instrument (STEBI) accordingly, resulting in the Teaching Scientific Reasoning Efficacy Beliefs Instrument (TSR-EBI). While the conceptual framework of the TSR-EBI is comparable to that of the STEBI in general terms, it goes beyond it in terms of specificity, acknowledging the fact that teaching SR requires very specific knowledge and skills that are not necessarily needed to the same extent for promoting other competencies in science education. To evaluate the TSR-EBI's psychometric quality, we conducted two rounds of validation. Both samples (N1 = 114; N2 = 74) consisted of pre-service teachers enrolled in university master's programs in Germany. The collected data were analyzed by applying Rasch analysis and known-group comparisons. In the course of an analysis of the TSR-EBI's internal structure, we found a 3-category scale to be superior to a 5-category structure. The person and item reliability of the scale proved to be satisfactory. Furthermore, during the second round of validation, it became clear that the results previously found for the 3-category scale were generally replicable across a new (but comparable) sample, which clearly supports the TSR-EBI's psychometric quality. Moreover, in terms of test-criterion relationships, the scale was also able to discriminate between groups that are assumed to have different levels of self-efficacy regarding teaching SR. Nonetheless, some findings also suggest that the scale might benefit from having the selection of individual items reconsidered (despite acceptable item fit statistics). On balance, however, we believe that the TSR-EBI has the potential to provide valuable insights in future studies regarding factors that influence teachers' self-efficacy, such as their professional experiences, prior training, or perceived barriers to effective teaching.

Examination of Psychometric Evidence for Criterion-Referenced Scores from the SSIS SEL Brief Scales

Efficient and intuitive interpretive frameworks for social-emotional learning (SEL) measures are necessary for identifying student needs and informing programming decisions across multitiered systems of support in schools. Though familiar to educators and often used with standardized tests of academic achievement, criterion-referenced frameworks are less common in SEL assessment. As such, the current study examined the psychometric evidence for scores from one such framework, the Competency-Referenced Performance Framework, which was developed to inform universal screening decisions based on the SSIS SEL Brief Scales (Elliott et al., 2020). Specifically, we evaluated stability, test-criterion relationships with academic outcomes, and treatment sensitivity of the CRPF using data from an efficacy trial of a universal SEL program. Results provided preliminary supportive evidence for the CRPF.

The Modified E-Cigarette Evaluation Questionnaire: Psychometric Evaluation of an Adapted Version of the Modified Cigarette Evaluation Questionnaire for Use With Adults Who Use Electronic Nicotine Delivery Systems.

The subjective experience of positive and negative effects likely contributes to e-cigarette use, and the Modified Cigarette Evaluation Questionnaire (MCEQ) previously has been adapted to assess the reinforcing and aversive effects of vaping. However, the psychometric properties of the MCEQ for use with e-cigarettes have not been established. We examined the psychometric properties of the Modified E-cigarette Evaluation Questionnaire (MECEQ) within a sample of 857 adults who recently used e-cigarettes in a smoking cessation attempt (52.4% male; 40.84 [12.25] years old; 62.8% non-Hispanic white; 22.4% daily e-cigarette users). Analyses included confirmatory factor analysis of the original structure, exploratory/confirmatory factor analyses to identify the alternate latent structure(s), internal consistency, measurement invariance, between-group differences, and test-criterion relationships with vaping-related outcomes. The original five-factor structure and a novel four-factor structure were supported. Each was scalar invariant across several participant subgroups (eg, current smoking status, daily vaping status). All multi-item subscales were internally consistent. Both versions detected several between-group differences. For example, current smokers reported stronger aversive effects than did exclusive e-cigarette users. Finally, adjusted relationships between both MECEQ versions and vaping-related outcomes provided evidence for concurrent validity. The five-factor and four-factor versions of the MECEQ evidenced good-to-excellent internal consistency, scalar measurement invariance, and concurrent relationships with vaping-related outcomes. While both versions could be used to assess subjective vaping effects in adults with histories of cigarette smoking and vaping, additional research is needed to evaluate the applicability of these factor structures to other samples (eg, e-cigarette users with no smoking history, youth). Although the MCEQ has been adapted in previously published studies to assess the subjective reinforcing and aversive effects of vaping, the psychometric foundation necessary for doing so had not been established. We showed that the MECEQ can be scored using the original five-factor MCEQ format or using a newly identified four-factor structure. Both versions evidenced construct validity, internal consistency, measurement invariance (permitting between-group comparisons), and concurrent validity with vaping-related outcomes. Results strengthen the interpretability of previously published work using the five-factor MCEQ structure and provide an alternative scoring approach for vaping-specific subjective effects.

Psychometric Evaluation of the Short-Form Vaping Consequences Questionnaire for Use With High School Adolescents Who Use and Do Not Use E-cigarettes.

Assessing youth vaping expectancies using a psychometrically sound measure can improve understanding of e-cigarette susceptibility and use. We evaluated the psychometric properties of the Short-Form Vaping Consequences Questionnaire (SF-VCQ), an expectancy measure previously validated with adults, within a sample of 1753 high school adolescents who completed an online, school-based survey in Fall 2020 (51.6% female; 15.56 [1.22] years old; 46.6% non-Hispanic white; 26.9% reported lifetime but no past-30-day vaping; 12.6% reported past-30-day vaping). Analyses included confirmatory factor analysis, internal consistency, measurement invariance, between-group differences, and test-criterion relationships. The four-factor structure was confirmed and was scalar invariant by lifetime and past-month vaping status, sex, and race. All subscales were internally reliable (mean α = 0.94). The subscales were sensitive to differences based on sex, race, vaping susceptibility among never users, and lifetime and past-month vaping status. For example, students who vaped in the past-month held weaker expectancies for negative consequences but stronger expectancies for positive reinforcement, negative reinforcement, and appetite/weight control compared to lifetime vapers. Unadjusted relationships within the subsamples of lifetime and past-month vapers provided evidence of convergent validity. Evidence for concurrent validity was observed for all samples after accounting for covariates. For example, expectancies for positive reinforcement, negative reinforcement, and appetite/weight control remained significantly associated with past-month vaping frequency. The SF-VCQ evidenced excellent internal reliability, scalar measurement invariance, and construct, convergent, and concurrent validity in samples of never, lifetime, and past-month adolescent e-cigarette users. Findings support using the SF-VCQ for assessing youths' vaping-related expectancies. The current study established the psychometric properties of the SF-VCQ for use among adolescents with and without vaping experience, including measurement invariance that permits direct comparisons of expectancies across these two groups. When considered in concert with previously published research in adults, the SF-VCQ provides researchers with a measure that can be used with both youth and adult samples. Observed relationships between positive expectancies and vaping susceptibility in vaping naïve youth and indices of vaping frequency in youth with vaping experience suggest that challenging positive expectancies may be a valuable addition to prevention and intervention efforts to reduce youth vaping.

Academic Interest Scale for Adolescents: Development, Validation, and Measurement Invariance With Chinese Students.

Hidi and Renninger’s four-phase interest development model was identified as the most complete and widely used theoretical model illustrating the essence of academic interest. Using the model along with current research literature as a basis, this study aimed to develop and initially validate a generic multidimensional instrument to measure academic interest across different school subjects in the Chinese education context; this instrument was called the Academic Interest Scale for Adolescents (AISA). Three large samples of Chinese junior high school students were recruited by cluster sampling in the study. (1) Sample 1 (N = 552; 45.5% girls; 12.31 [SD = 0.98] years, range = 10–15 years) completed the draft of AISA, Intrinsic Motivation Scale and Scale for Adolescents’ Flow State in Learning in math and English. (2) Sample 2 (a subgroup of Sample 1, 411 students) completed the AISA in math and English again 2 months later after the first survey. (3) Sample 3 (N = 1,780; 50.1% girls; 13.69 [SD = 0.97] years, range = 12–16 years) completed the AISA in math, English, and Chinese. Identically worded items were used in AISA, except for the name of the subject. An exploratory factor analysis for math in sample 1 using principle axis factoring and promax rotation resulted in a 29-item AISA containing four dimensions: emotion, value, knowledge, and engagement, and the latent variables together explained 59.40% of the total variance. Confirmatory factor analysis for math, English, and Chinese in sample 3 suggested the four-factor model fits well in different samples and subjects. Scale scores showed adequate internal consistency (the Cronbach’s α for AISA and each subscale ranged from 0.86 to 0.93) and acceptable test-criterion relationships (correlations between the AISA score and intrinsic motivation and flow state in learning > 0.51, ps < 0.001). Furthermore, the structural measure invariance across subjects, time (2-month interval), genders and grades were upheld. The AISA promises to be a useful tool for the evaluation of academic interest among Chinese adolescents and can be administered in different educational settings, i.e., different subjects, time, genders, and grades.

Psychometric properties and validation of the Spanish versions of the overall anxiety and depression severity and impairment scales

BackgroundAnxiety and depressive disorders are the most frequent disorders for which patients seek care in public health settings in Spain. This study aimed at validating the Overall Anxiety Severity and Impairment Scale (OASIS) and the Overall Depression Severity and Impairment Scale (ODSIS), which are brief screening scales for anxiety and depression consisting of only five items each. MethodsThe study was conducted in a Spanish clinical sample receiving outpatient mental health treatment (N = 339). A subsample of participants (n = 219) was assessed before and after receiving a course of cognitive-behavioral treatment. ResultsThe results revealed excellent internal consistency estimates (Cronbach's alpha for the OASIS and the ODSIS was 0.87 and 0.94, respectively), along with promising convergent and discriminant validity and test-criterion relationships (i.e., moderate correlation with other measures of depression and anxiety, as well as with neuroticism, quality of life, adjustment, and negative affect). A one-dimensional structure was obtained for the OASIS and the ODSIS. The ROC analyses indicated an area under the curve of 0.83 for the OASIS and the ODSIS when predicting moderate-to-severe anxiety and depression, respectively. Good sensitivity to therapeutic change was also evidence and the analysis of the sensitivity as a function of 1-specificity area suggested a cutoff value of 10 for both scales. LimitationsInter-rater reliability of diagnoses with the ADIS-IV interview could not be investigated and the results obtained may not be generalizable to other samples and health settings. ConclusionsThe availability of these two short and psychometrically sound measures should make screening of anxiety and depressive symptoms in routine care more feasible.

The Medical Cannabis Expectancy Questionnaire: Adult Medical Marijuana Users’ Expectancies Associated with Combustible, Vaporized, and Edible Cannabis Use for Medical Purposes

Measures of medical cannabis (MC) use are lacking. This study details the development and psychometric evaluation of The Medical Cannabis Expectancy Questionnaire (MCEQ), a novel measure of positive and negative expectations associated with using combustible, vaporizable, and edible MC. 333 adult MC users completed a 30-minute online survey in Spring 2017 (64.0% female, 82.3% White, mean age 32.77[±10.19] years). Participants reported on demographics, product preference, MCEs, frequency of MC use, quality of life, and negative cannabis use consequences. Psychometric analyses included evaluations of latent factor structure, measurement invariance, between-groups differences in MCEs, and test-criterion relationships with MC outcomes. The 27-item MCEQ evidenced a 2-factor structure (positive/negative). MCEs were scalar invariant by product type, sex, and reasons for MC use (medical only vs medical/recreational). Participants held more positive MCEs for combustibles than for vaporizables or edibles and more negative MCEs for combustibles and edibles than for vaporizables. MCEs did not differ by sex. Participants who also used cannabis recreationally reported stronger positive MCEs for all MC products. MCEs also differed by product preference. Additionally, preference for and more positive MCEs associated with using a specific product were associated with more frequent use of that product. Positive MCEs for all products also were associated with increased quality of life, but these relationships failed to reach statistical significance after accounting for covariates. Finally, negative MCEs for combustibles and edibles were associated with more negative consequences. The MCEQ is the first psychometrically promising measure of MC expectancies, and it uniquely distinguishes among expectations associated with using combustible, vaporizable, and edible MC. As MC use continues to proliferate, having measures dedicated to MC (versus recreational cannabis) may better inform research and clinical efforts. Further, differentiating between product types is important given established differences among them (e.g., duration of effect onset).

Development and psychometric validation of a novel measure of sensory expectancies associated with E-cigarette use

IntroductionE-cigarette dependence measures largely focus on e-cigarette use (“vaping”) that is linked to nicotine use, and measures assessing sensory aspects of vaping that may influence use (e.g., taste) are limited in scope. Thus, we developed the novel Sensory E-cigarette Expectancies Scale (SEES). MethodsIn Summer 2017, 610 adult e-cigarette users (48.7% male, 84.9% White, 37.41[±12.15] years old) completed an online survey that included 23 SEES items. Psychometric analyses included evaluating latent structure, internal consistency, measurement invariance, mean differences, and test-criterion relationships. ResultsFactor analyses supported a 9-item, 3-subscale structure (taste/smell, pleasure/satisfaction, vapor cloud production). Subscales evidenced internal consistency and scalar invariance by sex, race, smoking status (current/not), vaping status (daily/not), e-liquid nicotine content (yes/no), and device type (cig-a-likes/vape-pens/Advanced Personal Vaporizers [APVs]/Mods). Women and daily e-cigarette users reported stronger SEEs for taste/smell and pleasure than their counterparts. Non-white participants reported stronger SEEs for cloud production than White participants. Cig-a-like users reported the weakest SEEs for taste/smell and weaker SEEs linked to cloud production than APV/mod users. SEES scores evidenced convergence with nicotine dependence (mean r = .36). Finally, SEES scores predicted vaping frequency and habitual vaping concurrently and incrementally beyond nicotine dependence. ConclusionsThe SEES evidenced good psychometric properties, suggesting that the measure can be used to assess sensory vaping expectancies in adults. Importantly, SEES scores indicated that sensory expectancies are related, yet distinct, from nicotine dependence. Future research should evaluate how SEEs relate to product characteristic preferences and patterns of vaping including the development and maintenance of addiction.

Psychometric Evaluation of the E-cigarette Dependence Scale.

Psychometrically sound measures of e-cigarette dependence are lacking. We modified the PROMIS Item Bank v1.0-Smoking: Nicotine Dependence for All Smokers for use with e-cigarettes and evaluated the psychometrics of the 22-, 8-, and 4-item adapted versions, referred to as The E-cigarette dependence scale (EDS). Adults (1009) who reported using e-cigarettes at least weekly completed an anonymous survey in summer 2016 (50.2% male, 77.1% White, mean age 35.81 [10.71], 66.4% daily e-cigarette users, 72.6% current cigarette smokers). Psychometric analyses included confirmatory factor analysis, internal consistency, measurement invariance, examination of mean-level differences, convergent validity, and test-criterion relationships with e-cigarette use outcomes. All EDS versions had confirmable, internally consistent latent structures that were scalar invariant by sex, race, e-cigarette use (nondaily/daily), e-liquid nicotine content (no/yes), and current cigarette smoking status (no/yes). Daily e-cigarette users, nicotine e-liquid users, and cigarette smokers reported being more dependent on e-cigarettes than their counterparts. All EDS versions correlated strongly with one another, evidenced convergent validity with the Penn State E-cigarette Dependence Index and time to first e-cigarette use in the morning, and evidenced test-criterion relationships with vaping frequency, e-liquid nicotine concentration, and e-cigarette quit attempts. Similar results were observed when analyses were conducted within subsamples of exclusive e-cigarette users and duals-users of cigarettes and e-cigarettes. Each EDS version evidenced strong psychometric properties for assessing e-cigarette dependence in adults who either use e-cigarette exclusively or who are dual-users of cigarettes and e-cigarettes. However, results indicated little benefit of the longer versions over the 4-item EDS, which provides an efficient assessment of e-cigarette dependence. The availability of the novel, psychometrically sound EDS can further research on a wide range of questions related to e-cigarette use and dependence. In addition, the overlap between the EDS and the original PROMIS that was developed for assessing nicotine dependence to cigarettes provides consistency within the field.

The Short Form Vaping Consequences Questionnaire: Psychometric Properties of a Measure of Vaping Expectancies for Use With Adult E-cigarette Users.

E-cigarettes are popular in the United States, but psychometrically sound measures of vaping beliefs and behaviors are lacking. We evaluated the psychometrics of the Short Form Vaping Consequences Questionnaire (S-VCQ), a modified version of the Short Form Smoking Consequences Questionnaire that assesses expectancies for negative consequences, positive reinforcement, negative reinforcement, and appetite/weight control associated with vaping. Adult, past-month e-cigarette users completed an anonymous survey in Fall 2015 (N = 522, 50.4% female; 71.5% white; 34.10 [SD = 9.66] years). Psychometric analyses included confirmatory factor analysis, internal consistency, measurement invariance, t tests, correlations, and test-criterion relationships with vaping outcomes. The S-VCQ evidenced a four-factor latent structure (Bentler's Comparative Fit Index = .95, Root Mean Square Error of Approximation = .05, Standardized Root Mean Square Residual = .06), and subscales evidenced internal consistency (mean α = 0.89). S-VCQ scores were scalar invariant for sex and smoking status; women reported stronger appetite/weight control than men and dual cigarette/e-cigarette users (n = 309) reported stronger negative vaping consequences and negative reinforcement than nonsmokers. Among dual users, vaping and smoking expectancies also were scalar invariant; dual users reported stronger positive reinforcement associated with vaping than smoking but stronger negative consequences, negative reinforcement, and appetite/weight control associated with smoking than vaping. Correlations indicated that vaping and smoking expectancies were related, yet distinct constructs. Univariate general linear models indicated that vaping frequency and dependence were associated with positive reinforcement (ηp2 = .02/.02), negative reinforcement (ηp2 = .02/.08), and appetite/weight control (ηp2 = .02/.02) from vaping. The S-VCQ evidences solid psychometrics as a measure of adult e-cigarette users' vaping expectancies. The current study provides evidence for the reliability and validity of the S-VCQ, the first measure of vaping expectancies that has been validated for use with adult e-cigarette users. Results indicated that the S-VCQ comprises four subscales that evidence internal consistency, scalar measurement invariance for important groups of interest, and test-criterion relationships with vaping outcomes. Researchers are encouraged to consider using this measure for assessing vaping expectancies in adult e-cigarette users.

Validity and Utility of the Parent–Teacher Relationship Scale–II

Preliminary findings indicate that positive relations between parents and teachers are associated with successful school outcomes for children. However, measures available to assess parent–teacher relations are scant. The current study examined validity evidence for the Parent–Teacher Relationship Scale–II (PTRS). Specifically, the internal structure of the PTRS and the test–criterion relationships between the PTRS and several important child-level variables were examined. Primary school teachers ( n = 120) completed the PTRS referencing two different parents of children in their classroom, as well as outcome measures about both of these parent’s children (i.e., academic competence, student–teacher relationship, and behavior). Confirmatory factor analyses supported the two-factor solution originally proposed by the PTRS authors. Associations between the PTRS and child outcome variables provided further evidence in support of test–criterion relationships. School mental health professionals and researchers seeking to assess the contributions of parent–teacher relations to academic and behavioral outcomes of children should consider administering the PTRS.

Psychometric validation of measures of alcohol expectancies, retrospective subjective response, and positive drinking consequences for use with adolescents

The Anticipated Effects of Alcohol Scale (AEAS), the Subjective Effects of Alcohol Scale, and the Positive Drinking Consequences Questionnaire (PDCQ) are psychometrically sound measures of alcohol expectancies (expectancies), subjective response to alcohol, and positive drinking consequences, respectively, for use with adults. Prior research using these measures suggests that expectancies, subjective response, and positive drinking consequences are related yet distinct determinants of drinking. The current study presents psychometric evaluations of these measures for use with adolescents including confirmatory factor analyses (CFA) of the previously identified latent structures, internal consistency, and test-criterion relationships. Legally, alcohol cannot be administered to adolescents, so we assessed retrospective subjective response (during the first drinking episode ever [SEAS First] and the most recent drinking episode [SEAS Recent]). The sample comprised 248 Connecticut high school students (53.6% male; mean age 16.50 [1.19] years; 71.4% White) who completed an anonymous survey. CFA confirmed the latent factor structures for each measure. The AEAS, SEAS First, SEAS Recent and the PDCQ were internally consistent (mean α AEAS=0.83; SEAS First=0.88; SEAS Recent=0.89, PDCQ=0.87). AEAS subscales evidenced moderate overlap with corresponding SEAS First subscales (mean=0.36) and SEAS Recent subscales (mean=0.46) and modest overlap with the PDCQ (mean=0.17). Expectancies, subjective response, and positive drinking consequences also accounted for significant variance in monthly drinking, lifetime maximum number of drinks consumed, and alcohol-related problems. In sum, the AEAS, the retrospective SEAS, and the PDCQ are psychometrically sound measures for use with adolescents.

The Yale Craving Scale: Development and psychometric properties

IntroductionThe current study presents a psychometric evaluation of the Yale Craving Scale (YCS), a novel measure of craving for cigarettes and alcohol, respectively. The YCS is the first craving measure to use a generalized Labeled Magnitude Scale (gLMS) as the scoring format, which facilitates between-group comparisons of subjective craving and eliminates ceiling effects by assessing the full range of imaginable sensation intensities. MethodsPsychometric evaluations of the YCS for use with cigarettes (YCS Smoking) and alcohol (YCS Drinking) included assessments of latent factor structure, internal consistency, ceiling effects, and test-criterion relationships. Study samples included 493 treatment-seeking smokers and 213 heavy drinkers. ResultsFactor analyses of the 5-item YCS Smoking and Drinking scores confirmed a 1-factor scale. The YCS Smoking and Drinking scores evidenced: (1) good internal consistency, (2) scalar measurement invariance within several subgroups (e.g., smoking/drinking status; nicotine/alcohol dependence), (3) convergent relationships with extant craving measures, and (4) concurrent relationships with smoking/drinking outcomes. ConclusionsThese results suggest that the YCS represents a psychometrically sound scale for assessing smoking and drinking urges in dependent populations.

An Improved Correction for Range Restricted Correlations Under Extreme, Monotonic Quadratic Nonlinearity and Heteroscedasticity.

Standardized tests are frequently used for selection decisions, and the validation of test scores remains an important area of research. This paper builds upon prior literature about the effect of nonlinearity and heteroscedasticity on the accuracy of standard formulas for correcting correlations in restricted samples. Existing formulas for direct range restriction require three assumptions: (1) the criterion variable is missing at random; (2) a linear relationship between independent and dependent variables; and (3) constant error variance or homoscedasticity. The results in this paper demonstrate that the standard approach for correcting restricted correlations is severely biased in cases of extreme monotone quadratic nonlinearity and heteroscedasticity. This paper offers at least three significant contributions to the existing literature. First, a method from the econometrics literature is adapted to provide more accurate estimates of unrestricted correlations. Second, derivations establish bounds on the degree of bias attributed to quadratic functions under the assumption of a monotonic relationship between test scores and criterion measurements. New results are presented on the bias associated with using the standard range restriction correction formula, and the results show that the standard correction formula yields estimates of unrestricted correlations that deviate by as much as 0.2 for high to moderate selectivity. Third, Monte Carlo simulation results demonstrate that the new procedure for correcting restricted correlations provides more accurate estimates in the presence of quadratic and heteroscedastic test score and criterion relationships.

The Useful Depression Screening Tool for Older Adults: Psychometric Properties and Clinical Applicability

Background and Purpose: The purpose of this study is to test the reliability and validity of the 3-item Useful Depression Screening Tool (UDST) for use with older adults in congregate living settings. Methods: There were 176 residents of senior housing or assisted living who completed the UDST. Rasch analysis and test criterion relationships with pain, physical activity, and depression diagnosis were used to determine validity. Test–retest reliability was conducted with 29 senior housing residents. Results: Rasch analysis demonstrated good fit of all items to the concept of depression. Criterion validity was supported, F(5) = 14.17, p &lt; .001. Test–retest showed no significant differences in UDST scores over time (p = .29). Conclusions: The findings provide support for the validity and reliability of the UDST for use with older adults in congregate living settings.

The Useful Depression Screening Tool for Older Adults: Psychometric Properties and Clinical Applicability.

The purpose of this study is to test the reliability and validity of the 3-item Useful Depression Screening Tool (UDST) for use with older adults in congregate living settings. There were 176 residents of senior housing or assisted living who completed the UDST. Rasch analysis and test criterion relationships with pain, physical activity, and depression diagnosis were used to determine validity. Test-retest reliability was conducted with 29 senior housing residents. Rasch analysis demonstrated good fit of all items to the concept of depression. Criterion validity was supported, F(5) = 14.17, p < .001. Test-retest showed no significant differences in UDST scores over time (p = .29). The findings provide support for the validity and reliability of the UDST for use with older adults in congregate living settings.

Psychometrically improved, abbreviated versions of three classic measures of impulsivity and self-control.

Self-reported impulsivity confers risk factor for substance abuse. However, the psychometric properties of many self-report impulsivity measures have been questioned, thereby undermining the interpretability of study findings using these measures. To better understand these measurement limitations and to suggest a path to assessing self-reported impulsivity with greater psychometric stability, we conducted a comprehensive psychometric evaluation of the Barratt Impulsiveness Scale-11 (BIS-11), the Behavioral Inhibition and Activation Scales (BIS/BAS), and the Brief Self-Control Scale (BSCS) using data from 1,449 individuals who participated in substance use research. For each measure, we evaluated (a) latent factor structure, (b) measurement invariance, (c) test-criterion relationships between the measures, and (d) test-criterion relations with drinking and smoking outcomes. Notably, we could not replicate the originally published latent structure for the BIS, BIS/BAS, or BSCS or any previously published alternative factor structure (English language). Using exploratory and confirmatory factor analysis, we identified psychometrically improved, abbreviated versions of each measure: 8-item, 2-factor BIS-11 (root-mean-square error of approximation [RMSEA] = .06, comparative fit index [CFI] = .95); 13-item, 4-factor BIS/BAS (RMSEA = .04, CFI = .96); and 7-item, 2-factor BSCS (RMSEA = .05, CFI = .96). These versions evidenced (a) stable, replicable factor structures, (b) scalar measurement invariance, ensuring our ability to make statistically interpretable comparisons across subgroups of interest (e.g., sex, race, drinking/smoking status), and (c) test-criterion relationships with each other and with drinking/smoking. This study provides strong support for using these psychometrically improved impulsivity measures, which improve data quality directly through better scale properties and indirectly through reducing response burden.

The Anticipated Effects of Alcohol Scale: Development and psychometric evaluation of a novel assessment tool for measuring alcohol expectancies.

Alcohol expectancy (AEs) research has enhanced our understanding of how anticipated alcohol effects confer risk for heavy drinking and alcohol-related problems. However, extant AE measures have limitations within 1 or more of the following areas: assessing a comprehensive range of effects, specifying the hypothetical number of drinks consumed, assessing AEs by limb of the blood alcohol curve (BAC), and/or not having undergone psychometric evaluation. Building upon the strengths of existing measures, we employed conceptual and statistical advances in measurement development to create the novel, psychometrically sound Anticipated Effects of Alcohol Scale (AEAS). Unique to this study, pilot data ensured that the AEAS comprised a comprehensive sampling of effects that varied in valence (positive/negative) and arousal (low/high) and were identified as plausible outcomes of drinking. The AEAS specified the number of drinks individuals imagined consuming (adjusted for sex) and the hypothetical drinking episode length (2 hr). AEs were also assessed separately by BAC limb. For validation purposes, the AEAS was included in several survey studies of young adults (ages 18-30). The validity argument for the proposed interpretation of AEAS test scores was based upon the following: (a) exploratory and confirmatory factor analyses (N = 546) identified a 22-item, 4-factor internal structure, categorizing alcohol effects into quadrants (high/low arousal crossed with positive/negative valence); (b) scalar measurement invariance was established for BAC limb, sex, and binge drinking status; (c) convergence/divergence was observed with alternative AEs measures and mood; and (d) test-criterion relationships were observed with several alcohol-related outcomes. The reliability argument was based on test-retest and internal consistency coefficients.

The Resilience Scale: Psychometric Properties and Clinical Applicability in Older Adults

Resilience is described as the ability to achieve, retain, or regain a level of physical or emotional health after illness or loss. The Resilience Scale was specifically developed to measure personality characteristics of resilience in older adults. The purposes of this article are to provide additional support for the psychometric properties of the Resilience Scale and to consider the clinical applicability of this tool. Data from two independent samples of older adults were used. Most of the participants were Caucasian women, between 80 and 90 years of age, widowed, single, or divorced, and they had on average approximately three comorbid medical problems. Psychometric testing included confirmatory factor analysis, Rasch analysis, and test criterion relationships for validity testing, and internal consistency and estimates of R(2) for reliability testing. Although there was some support for the reliability and validity of the 25-item Resilience Scale, there was a poor fit of Items 3-6, 9, 11, 20, and 22 in the 25-item measure. Overall, participants in both samples scored high in resilience, and item mapping indicated that additional items are needed on the measure to differentiate those who are particularly resilient. Although revisions are recommended, use of the Resilience Scale can help identify older adults low in resilience and expose these individuals to interventions to improve resilience and facilitate successful aging.