Evidence Of Concurrent Validity Research Articles

Psychometric properties of Guiding Creative Thinking Competency Scale

The purpose of this research is to gather data on how often teachers use creative thinking techniques and encourage students to use such techniques. For this purpose, a valid and reliable scale for guiding creative thinking competency was developed. A survey model was used in the research, which was carried out with participants working as elementary school teachers in Istanbul province of Turkey. The current research was conducted with the participation of 815 individuals in four different sample groups. Data was analyzed via SPSS 21.0 and LISREL software.The findings indicate that there is a positive relationship between teachers’ competency of guiding creative thinking and their own creative thinking dispositions. The competency to guide creative thinking is higher in the case of elementary school teachers who specialize in teaching gifted students than that of those in general education.In conclusion, the scale for creative thinking competency demonstrated a strong factor structure, strong internal consistency and evidence for construct and concurrent validity.

Measuring children’s perceived cost of school science: Instrument development and psychometric evaluation

This investigation addresses the need for valid and reliable instruments that contribute to understanding the factors that lead to the rejection of science-related studies. We discuss the theoretical and methodological limitations of published attitudes toward science questionnaires and describe the development and validation of a short instrument rooted in the cost construct of the expectancy-value model of achievement motivation. We collected data from a sample of six hundred thirty-two 5th and 6th (Mage = 10.87; SD = .76) elementary students in Spain. Exploratory and confirmatory factor analysis revealed a parsimonious structure measuring loss of valued alternatives and task effort ​cost. Further psychometric evaluation displayed evidence for convergent, discriminant, and concurrent validity. Likewise, the reliability was acceptable for both three-item scales. These findings support the proposed instrument to measure barriers experienced by Spanish children when studying school science.

Concurrent validity and reliability of self-selected movement velocity for resistance training monitoring in close grip pull-down and knee extension

Movement velocity (MV) has been featured as a more accurate and stable variable for resistance exercise (RE) monitoring. However, its application in RE prescription based on self-selected MV (MVss) is not possible because the benefits were evaluated only in the maximal intended MV practice context. Thus, the objective of this study was to verify the validity and reliability of MVss as a performance measure in RE. A group of 41 people (28.75 ± 10.06 years, 77.25 ± 9.04 kg, 1.76 ± 0.06 m for men and 30.25 ± 15.97 years, 62.96 ± 14.31 kg, 1.65 ± 0.06 for women) volunteered to participate in this study, and their performances were evaluated in knee extension and close grip pull-down, using a rotary position transducer. In fact, the results presented evidence of concurrent validity of MVss, although its predictive validity must be questioned (R 2 = 0.5; P < 0.05). Moreover, two points of performance transitions seem to exist, which could characterize three distinct zones of effort. Additionally, performances in both RE presented reasonable indicatives of reliability in consecutive evaluations (typical error = 0.05–0.07 m/s), suggesting the existence of minimal MVss thresholds. Despite the positive analyses of validity and reliability, practical applications of the MVss thresholds proposed here should be viewed with caution for RE monitoring in the individual context, taking into account the real capability to discriminate maximal and submaximal performances not supported by average-based comparisons. La vitesse de déplacement (MV) a été présentée comme une variable plus précise et plus stable pour la surveillance des exercices de résistance (RE). Cependant, son application dans la prescription d’exercices de résistance basée sur la vitesse de déplacement auto-sélectionnée (MVss) n’est pas possible parce que les avantages ont été évalués seulement dans le contexte maximal de la pratique de la Vélocité du Mouvement. Ainsi, l’objectif de cette étude était de vérifier la validité et la fiabilité de la vitesse de déplacement auto-sélectionnée comme mesure de performance dans l’exercice de résistance. Un groupe de 41 personnes (28,75 ± 10,06 ans, 77,25 ± 9,04 kg, 1,76 ± 0,06 m pour les hommes et 30,25 ± 15,97 ans, 62,96 ± 14,31 kg, 1,65 ± 0,06 pour les femmes) s’est porté volontaire pour participer à cette étude et leurs performances ont été évaluées dans l’extension du genou et le tirage vertical prise serrée, en utilisant un transducteur de position rotative. En fait, les résultats ont présenté des preuves de la validité concurrente de la vitesse de déplacement auto-sélectionnée, bien que sa validité prédictive doit être remise en question (R 2 = 0,5 ; p < 0,05). De plus, deux points de transitions de performance semblent exister, ce qui pourrait caractériser trois zones d’effort distinctes. De plus, les performances dans les deux exercices de résistance ont présenté des indicateurs de fiabilité raisonnables dans des évaluations consécutives (erreur-type = 0,05–0,07 m/s), ce qui suggère l’existence de seuils de vitesse de mouvement auto-sélectionnés minimaux. Malgré les analyses positives de validité et de fiabilité, les applications pratiques des seuils de vitesse de déplacement auto-sélectionnés proposés ici doivent être considérées avec prudence pour la surveillance de l’exercice de résistance dans le contexte individuel, en tenant compte de la capacité réelle de discriminer les performances maximales et sous-maxima non supportées par Moyennes.

Supervisor Idea Adoption Scale: Construction, reliability, and initial validity evidence.

Despite the importance of workplace innovation, the adoption of creative ideas at workplace level has received little attention due to a lack of measures for idea adoption. The purpose of this study was to develop and validate a scale that measures employees’ perceptions of the process of idea adoption. Specifically, the scale assesses employee perceptions of their supervisor’s behavior in terms of idea openness, selection and application. Three studies were conducted to develop the supervisor idea adoption scale and investigate the scale scores’ psychometric properties (Study 1, n = 326); concurrent, convergent and divergent validity (Study 2, n = 333); and test-retest reliability over a three month period (Study 3, n = 189). The findings indicated good psychometric properties: the three factor structure was supported and the scales scores showed internal consistency and retest reliability. Furthermore, the scale scores’ associations with other variables provided initial evidence for concurrent, convergent and divergent validity. Several recommendations are made for the application of the scale in research and practice.

Evidence of content, concurrent criterion validity, and reliability in a chassè checklist

PurposeThis study aims to verify the evidence of content, concurrent criterion validity, and reliability in a &lt;i&gt;chassè&lt;/i&gt; checklist.MethodsFirst, 3 judges measured 11 items of the checklist based on the Likert scale, varying from 1 (not at all) to 5 (very much clear, pertinent, and representative), for the content evidence validity. In the second stage, 91 girls (12 ± 2.09 years old) were evaluated while performing the skill; 51 of them were skilled and 40 were novice in polka type chassè (concurrent evidence). Concerning reliability, 3 evaluators analysed the videos of 5 volunteers while performing polka type chassè at 2 different times, with an interval of 1 week between evaluations.ResultsAfter the first stage, 1 item presented the content validity coefficient of 0.56 and it was reformulated as well as the skill was renamed to polka type chassè. The second assessment presented clear, pertinent, and representative items of the instrument. The reliability was considered appropriate by the inter-judge intraclass correlation coefficient (ICC) of 0.83 and the lowest intra-judge ICC of 0.80. Lastly, concurrent evidence was better when it came to skilled participants than novice ones related to polka type &lt;i&gt;chassè&lt;/i&gt;.ConclusionsIn general, the results indicated content and concurrent validity and reliability evidence. The instrument can be useful for physical education teachers as well as gymnastics coaches.

Evidence of the validity of a novel version of the computerized cognitive screening battery CompCog.

ABSTRACTAlthough the availability of the computer-based assessment has increased over the years, neuropsychology has not carried out a significant paradigm shift since the personal computer’s popularization in the 1980s. To keep up with the technological advances of healthcare and neuroscience in general, more efforts must be made in the field of clinical neuropsychology to develop and validate new and more technology-based instruments, especially considering new variables and paradigms when compared to paper and pencil tests.Objective:This study’s objective was to produce concurrent validity evidence of the novel version of the computerized cognitive screening battery CompCog.Methods:Participants performed a traditional paper and pencil neuropsychological testing session and another session where CompCog was administrated. The data of a total of 50 young adult college students were used in the analyses.Results:Results have shown moderate and strong correlations between CompCog’s tasks and their equivalents considering paper and pencil tests. Items clustered in agreement with the subtest division in a principal component analysis.Conclusions:The findings suggest that CompCog is valid for measuring the cognitive processes its tasks intend to evaluate.

Development of a common scale for measuring healthy ageing across the world: results from the ATHLOS consortium.

BackgroundResearch efforts to measure the concept of healthy ageing have been diverse and limited to specific populations. This diversity limits the potential to compare healthy ageing across countries and/or populations. In this study, we developed a novel measurement scale of healthy ageing using worldwide cohorts.MethodsIn the Ageing Trajectories of Health-Longitudinal Opportunities and Synergies (ATHLOS) project, data from 16 international cohorts were harmonized. Using ATHLOS data, an item response theory (IRT) model was used to develop a scale with 41 items related to health and functioning. Measurement heterogeneity due to intra-dataset specificities was detected, applying differential item functioning via a logistic regression framework. The model accounted for specificities in model parameters by introducing cohort-specific parameters that rescaled scores to the main scale, using an equating procedure. Final scores were estimated for all individuals and converted to T-scores with a mean of 50 and a standard deviation of 10.ResultsA common scale was created for 343 915 individuals above 18 years of age from 16 studies. The scale showed solid evidence of concurrent validity regarding various sociodemographic, life and health factors, and convergent validity with healthy life expectancy (r = 0.81) and gross domestic product (r = 0.58). Survival curves showed that the scale could also be predictive of mortality.ConclusionsThe ATHLOS scale, due to its reliability and global representativeness, has the potential to contribute to worldwide research on healthy ageing.

Propiedades psicométricas de un instrumento de mecanismos de desconexión moral: validación en adolescentes del noroeste de México

El objetivo del estudio fue traducir, adaptar y evaluar las evidencias de validez, por constructo y concurrente, del instrumento que mide los mecanismos de desconexión moral en adolescentes escolarizados. Se analiza la evidencia de validez concurrente con el rol de espectador-alentador de la agresión. Participaron 1,212 estudiantes de 10 secundarias públicas de cinco municipios de un Estado del noroeste de México. El 54.4% son mujeres y el 45.6% hombres, cuyo rango de edad está comprendido entre los 11 y 15 (M edad = 13.08, DE = .95 años). Se obtuvo un modelo de medida que confirma con indicadores de ajuste aceptables internos y se evidencia la validez concurrente. Los resultados se discuten en términos de su utilidad para identificar el constructo en un ecosistema cultural particular y para el análisis contextualizado. Se concluye que la escala cuenta con propiedades psicométricas adecuadas para la medición de la desconexión moral en adolescentes, concretando, además, un aporte al estudio de la violencia y el acoso escolar.

Innovative Work Behavior: Development and Validation of a Scale for Teachers

The innovative work behaviour constitutes a set of actions of opportunity exploration, idea generation, idea promotion and idea realization. Although generic scales are available, there are none to explore innovative behaviour in teaching practice. The objective of this study was to develop and validate a scale to measure teacher's innovative work behaviour. It was designed as an instrumental- transversal study. A sample of 458 primary school teachers (86.4% women, Mage = 34.67 years, Mseniority = 7.77 years) answered the developed scale with other standardized measures of psychological capital and job satisfaction. Factor analyses indicated a tetra-factorial structure that explained 69% of the total variance. Twelve items with high reliability integrated the final version of the scale. Evidence of convergent, discriminant and concurrent validity was obtained.

Developing and evaluating the validity of the behavioural assessment of dysexecutive functioning – intellectual disabilities adaptation (BADS-ID)

PurposeAssessment of executive functioning is an important element of a comprehensive assessment of intellectual abilities. Few assessments available are accessible for individuals with intellectual disabilities (ID) and none have population-specific norms. This paper aims to describe the adaptation of the behavioural assessment of dysexecutive syndrome (BADS).Design/methodology/approachAdaptations were made to the BADS tests to create the BADS – intellectual disabilities (BADS-ID). Data from three doctoral dissertations were combined to explore the utility, reliability, validity and component structure of the BADS-ID. Properties of the BADS-ID were compared with the Cambridge Executive Functioning Assessment (CEFA).FindingsThe BADS-ID is accessible to IQ range 50–70 and has a two-component structure. It has good inter-rater reliability, but poor internal consistency. It has a good face and content validity but evidence for concurrent and discriminative validity is weak. All properties are comparable to or better than the CEFA.Research limitations/implicationsFurther research is needed to improve reliability and validity. The development of an accessible test battery with known reliability and validity for individuals with ID should facilitate research into executive functioning in this population. There is the potential to develop population-specific norms from the data.Practical implicationsAn accessible test battery for individuals with ID is helpful in clinical situations.Originality/valueTo the best of the authors’ knowledge, this is the first study to explore the adaptation of the BADS for use with individuals with ID.

Development and Validation of the Adolescent Sexting Scale (A-SextS) with a Spanish Sample.

“Sexting” is generally defined as the exchange of sexual media content via the internet. However, research on this topic has underscored the need to seek greater consensus when considering different conceptual elements that make up this definition. The aim of this study was to develop and validate an instrument for measuring sexting among adolescents, in order to cover a gap identified in the previous literature. The Adolescent Sexting Scale (A-SextS for short) was developed for validation on a sample of 579 Spanish secondary school pupils between the ages of 11 and 18. Evidence for face, content, concurrent, and criterion validity were assessed. A comprehensive set of 64 items, covering six defining characteristics of sexting (e.g., actions, recipient, media format, degree of sexual explicitness), was constructed after conducting an extensive literature review, two discussion groups, and a pilot study. Sexting prevalence rates measured by A-SextS were mostly concurrent with those found in previous studies. A-SextS subscales produced statistically significant positive associations with pornography consumption and physical sexual intercourse. The study shows that A-SextS can be an integrating instrument that facilitates a rigorous and comprehensive assessment of adolescent sexting experiences, as well as the formulation of an operationalized definition of the practice of sexting.

Inventář tendence k vině a hanbě (ITVAH): pilotní studie

This paper constitutes a pilot study of a novel measure for assessing proneness to guilt and proneness to shame, Inventář tendence k vině a hanbě (ITVAH, Inventory of Proneness to Guilt and Shame). ITVAH is a scenario-based method distinguishing affective and behavioural components of guilt and shame and also considering the private or public experience of guilt and shame, respectively. Two items (affective and behavioural reaction) were created for each of the 16 scenarios, resulting in total of 32 items. A four-factor measurement model was assumed – Negative behaviour evaluation (NBE), Reparation, Negative self-evaluation (NSE), Withdrawal. Next, we assumed negative correlations of NSE and Withdrawal with self-esteem and self-forgiveness and positive correlations of NBE and Reparation with self-forgiveness. The pilot study was carried out on 249 Czech-speaking adults (67 % women, aged 18–75, Md = 22). An ordinal confirmatory factor analysis with residual covariances between items connected to the same scenarios was conducted. The hypothesized four-factor model was found acceptable. However, we found limited evidence for the hypothesized relationships with self-esteem and self-forgiveness – in contrast to theoretical expectations we found a medium-strong negative relationship between self-forgiveness and affective component of guilt. For further use of the measure in the Czech and Slovak environment it is necessary to assess additional evidence of construct validity and concurrent validity with The Test of Self-Conscious Affect-3 (TOSCA-3).

The Self-Efficacy Questionnaire for Online Learning (SeQoL)

ABSTRACT The purpose of this study was to examine the psychometric properties of the Self-Efficacy Questionnaire for Online Learning (SeQoL; Shen et al., 2013). Using two samples of college students, this study examined evidence of construct validity, concurrent validity, convergent validity, and reliability for the SeQoL. Confirmatory factor analysis and latent profiles analysis were conducted to provide different aspects of construct validity evidence. Our results suggest the SeQoL consistently measures the five dimensions of online learning self-efficacy found in Shen et al.’s original study. We flagged five items from the original scale for further examination. In the current study, strong construct validity and reliability evidence were observed across two different samples, analytical approaches, and related measures. Online learners with higher online learning self-efficacy were found to have higher learning satisfaction and expect better grades. Interpretations and implications of the findings are discussed.

The Test Anxiety Measure for College Students-Short Form: Development and Examination of Its Psychometric Properties

A short form of the 43-item Test Anxiety Measure for College Students (TAM-C) was developed in the present study. The TAM-C consists of six (social concerns, cognitive interference, worry, physiological hyperarousal, task irrelevant behaviors, and facilitating anxiety) scales. Twenty-four items from the TAM-C were selected for the short form. Single-group confirmatory factor analyses (CFAs) and correlational analyses were conducted with the responses of 728 U.S. college students to the TAM-C Short Form. Results of the single-group CFAs supported a six-factor model for the TAM-C Short Form. Concurrent and convergent validity evidence was found for the TAM-C Short Form scores. Overall, the findings suggest the TAM-C Short Form is an economical measure with unique features to assess test and facilitating anxiety in the college student population.

Psychometric validation of an adaptation of the Penn Alcohol Craving Scale to assess aggregated drug craving

PurposeClinicians need a broad spectrum measurement of psychoactive substance craving (i.e., alcohol and/or drug) to assess collective treatment effects, especially in the context of polysubstance use. In three separate studies, we investigated the psychometric properties of an adapted version of the Penn Alcohol Craving Scale (PACS), designed to measure broad range substance craving. DesignIn Study One, we examined the latent factor structure for craving, as well as concurrent validity with measures of frequency and severity of substance use. In Study Two, we examined the short-term test-retest reliability. In Study Three, we examined the long-term sensitivity to treatment effects at 12 month postdischarge. SettingAn inpatient SUD program in Guelph, Ontario, Canada. ParticipantsAdult patients receiving treatment for SUD: Study One, n = 971; Study Two, n = 35; Study Three, n = 191. MeasurementsWe used an adapted version of the PACS, termed the Aggregated Drug Craving Scale (ADCS), and measures of substance use frequency, severity, and abstinence. FindingsIn Study One, confirmatory factor analysis supported the unidimensional structure of the craving scale (CFI: 0.994, RMSEA: 0.071, SRMR: 0.010). In addition, statistically significant, medium effect size associations provided evidence of concurrent validity with measures of substance use frequency and severity (CFI = 0.992; RMSEA = 0.054; SRMR = 0.015). In Study Two, the ADCS demonstrated good agreement over two time points (ICC = 0.82), exhibiting acceptable short-term retest reliability. In Study 3, the mean craving score decreased significantly from 19.6 at baseline to 7.5 at 12-month follow-up (t = −18.48, p < 0.001), demonstrating an ability to detect long-term sensitivity to treatment effects (Cohen's d = −1.54). ConclusionsTogether, these findings provide initial support for a concise, broad-spectrum measure of aggregated drug cravings among an SUD treatment population.

Resilience Resources Scale: A brief resilience measure validated with undergraduate students

Objective This paper presents a theory-based brief resilience scale, the Resilience Resources Scale (RRS), and evidence for its factor structure, reliability, and validity in two studies of undergraduate students. Participants: Study 1 sampled 295 students and Study 2 sampled 244 students. Methods: Study 1 participants completed the RRS and other measures online at one of two time points eight weeks apart (n = 193), or at both time points (n = 102). Study 2 participants completed the RRS and other measures online on a single occasion. Results: Factor analyses provided evidence for a one-factor model. Results indicated high internal consistency and strong test-retest reliability. Evidence of concurrent and predictive validity is presented. Conclusions: The RRS measures resilience resources known to be protective of physical and mental health. This brief scale has sound psychometric properties in these initial studies of undergraduate students. We offer possible directions for use of the RRS in this and other populations.

Psychometric Analysis and Factor Structure of the Spanish Version of the Eight-Item Patient Health Questionnaire in a General Sample of Puerto Rican Adults

Depressive disorders may cause significant impairment in social, occupational, and academic areas of functioning. This research aims to analyze the psychometric properties and factor structure of the Spanish version of the eight-item Patient Health Questionnaire (PHQ-8) in a sample of 494 Puerto Rican adults. We analyzed the Cronbach alpha internal consistency, construct validity, discriminant validity, and factor structure of the instrument. The findings of the study revealed that the PHQ-8 obtained an excellent internal consistency of .92. Pearson’s r correlation analysis showed a high and statistically significant association between PHQ-8 and the Generalized Anxiety Disorder (GAD-7) providing evidence of concurrent validity. We conducted confirmatory factor analyses to examine the factor structure of the PHQ-8. The two models (unidimensional and multidimensional) showed an adequate adjustment to the data, but the unidimensional model was recommended. The PHQ-8 is a plausible adaptation of the PHQ-9 that may be used in any study directed to explore depressive symptoms without considering suicidal thoughts.

Testing the validity and reliability of the doping willingness in sport scale.

Although research investigating doping in sport is burgeoning, there is still a lack of proxy measures of doping behavior that have undergone extensive psychometric testing. To address this issue, we modified a previously used measure of doping willingness in sport and tested aspects of validity and reliability across four studies. In Study 1, we provided support for the face and content validity of the items, and then found support for the factor structure of the scale in a sample of athletes (N=205) using confirmatory factor analysis. In Study 2, we collected data from an independent sample of athletes (N=236) to provide further evidence for the factor structure of the scale using confirmatory factor analysis as well as provided evidence for concurrent and discriminant validity. In Study 3, a further independent sample of athletes (N=144) completed the scale and provided support for discriminant and predictive validity of the scale. In Study 4, we collected data from a further independent sample (N=74) to provide support for the test-retest reliability, and stability of items. Lastly, a confirmatory factor analysis was conducted on the samples across Studies 3 and 4, and the composite sample across all four studies which provided further support for the factor structure of the final 8-item scale. Taken together, these findings provide psychometric support for the scale to be used to measure the willingness of athletes to use banned substances to help facilitate future research investigating doping in sport.

Pasión por el Trabajo: Un Estudio Instrumental con Trabajadores Argentinos

This article presents the results of the validation of the Work Passion Scale developed by Vallerand et al. (2003). To determine the construct validity and the psychometric properties of the scale, a convenience multi-occupational sample of 452 Argentinean workers (56% women, average age = 35.56 years [SD = 10.84], average seniority = 8.82 years [SD = 9.10]) was used. Factor analyses revealed a structure composed of 2 correlated latent factors, comprising 14 items as observable indicators (S-Bχ2/gl = 1.85, GFI = 0.90, CFI = 0.94, RMSEA = 0.04), with adequate reliability according to the ordinal alpha coefficient and the composite reliability coefficient (harmonious passion: α = 0.79, CR = 0.80; obsessive passion: α = 0.80, CR = 0.81). Evidence of concurrent validity was obtained from direct correlations, calculated using Spearman’s rho, between the scales of passion for work, flow, job involvement, and job satisfaction. According to the R2 coefficient, the predictive and incremental validity of passion as an explanation of job satisfaction surpassed the impact of flow and job involvement. The configural and measurement invariance of the scale across gender was demonstrated using the χ2 difference test. The results obtained p

Evaluación de la dimensionalidad del Student School Engagement Survey: apoyo para un modelo multidimensional bifactor

The Student School Engagement Survey (SSES) is used to evaluate student engagement interventions run by the National Center for Student Engagement in the U.S. It was designed to measure the behavioral, emotional, and cognitive components of engagement, but its factorial structure has not been validated. To address this limitation, we tested the factorial structure of the Portuguese version of the SSES using a representative sample of 4866 adolescents. An exploratory factor analysis revealed five theoretically meaningful factors describing subtypes of emotional and behavioral engagement, and teacher support for learning. A confirmatory factor analysis supported modelling a shortened version of the SSES with a bifactor model. Bifactor indices indicated total SSES scores are interpretable as a measure of a single student engagement construct. Finally, as evidence of concurrent validity, the scale had a strong positive correlation with an established measure of student engagement. The proposed version of the SSES is a psychometrically adequate measure of student engagement, although cannot be said to measure cognitive engagement.