Evidence Of Validity In Relation Research Articles

The Revised American Occupational Therapy Association Fieldwork Performance Evaluations: Evaluation of Internal Structure, Response Processes, and Precision-Part 2.

There is an evidence-based need to assess the validity and reliability/precision of the revised American Occupational Therapy Association's Fieldwork Performance Evaluation (FWPE) items for the occupational therapy student (OTS) and the occupational therapy assistant student (OTAS). To evaluate evidence of validity in relation to response processes, internal structure, and precision of the FWPEs. Cross-sectional study design. OTS and OTAS fieldwork practice settings, United States. Two hundred sixty-seven fieldwork educators participated in total, providing 228 OTS evaluations and 39 OTAS evaluations. A Rasch model was used to evaluate aspects of validity and precision. The rating scales provided evidence of the tools' overall validity. Thirty-two of 37 items on the FWPE for the OTS, and 27 of 31 items on the FWPE for the OTAS demonstrated acceptable fit, but the evidence of unidimensionality in the subscales and in the total scales was not fully supported. The total/reduced FWPE scales were able to separate students into at least four distinct groups of fieldwork performance. The relationships between the current and revised FWPEs indicate that the new scales measure different but related constructs of student fieldwork performance, compared with the current version. The findings support that the revised FWPEs for the OTS and OTAS demonstrate preliminary evidence of internal structure, response processes, and precision, supporting evidence-based practice in fieldwork evaluations. What This Article Adds: This article highlights evidence demonstrating the validity and precision of the revised American Occupational Therapy Association's Fieldwork Performance Evaluation items and supports academic and fieldwork settings for occupational therapy students and occupational therapy assistant students.

Development of a Scale to Measure Healthy Behaviors in Spanish-Speaking University Students.

Chronic non-communicable diseases (NCDs) are a public health problem that affect the quality of life and well-being of people, especially the youth, who have been identified as a high-risk population. Physical inactivity is a key risk factor for NCDs, and an unhealthy diet is a significant driver of NCDs. On the other hand, physical exercise and healthy habits are effective methods of prevention. Although there are scales that measure different behaviors related to NCDs, most of them have been developed in another language (e.g., English) or only focus on one aspect of NCDs. The present study aimed to develop a scale to assess healthy behaviors (i.e., healthy eating and physical exercise) in Spanish-speaking university students, using an instrumental design, with a sample of 369 Chilean university students between 18 and 25 years of age. The results presented show evidence of validity through an exploratory structural equation model (ESEM), reliability estimation through McDonald's omega and Cronbach's alpha, evidence of invariance by sex, and evidence of validity in relation to other variables with an SEM model. It is concluded that the Healthy Behavior Scale, consisting of nine items to measure healthy eating and physical exercise, is a brief instrument with evidence of reliability and validity (CFI = 0.998; TLI = 0.995; and RMSEA = 0.063) for application in a Spanish-speaking university population, offering potential applications in research instruments, screening studies, and the development of new studies for other contexts.

Validação de conteúdo de protocolo de decanulação de pacientes adultos traqueostomizados

ABSTRACT Purpose Perform content validation of a decannulation protocol for tracheostomized adult patients. Methods To validate the content of the protocol developed by speech therapists, the Delphi technique was used. The 11 items of the protocol were judged by experts through rounds via e-mail and were classified as adequate, partially adequate or inadequate, in addition to providing comments and suggestions on each item. 30 speech therapists, 30 respiratory physiotherapists and 30 physicians responsible for the tracheostomy and decannulation procedure were invited. The percentage of agreement adopted was ≥ 80% and the process was interrupted when this percentage was obtained in all items. Results At the end of the process, 24 professionals participated in the third round, being 46% speech therapists, 29% physiotherapists and 25% physicians. After the experts' suggestions and comments, two items were kept as they were in the initial protocol, seven were reformulated, six were included and two were excluded. The final version of the protocol included: identification, absence of abundant secretions, characteristics of the secretion, effective cough, ability to remove secretions, tolerate the deflated cuff, aptitude in the decannulation process, level of consciousness, change of cannula to a smaller caliber, absence of current/active infection, spontaneous and effective swallowing of saliva, use of a speech valve, aptitude for occlusion of the cannula, assessment of aptitude for decannulation and objective examinations. Conclusion Through the Delphi Technique, the content of the instrument was validated, with substantial changes occurring. The next stage of instrument validation is obtaining evidence of validity in relation to the internal structure.

Problematic Social Network Use: Structure and Assessment

Using social networks (SNs) inappropriately can lead to psychological problems. The objective of this study was to develop a new measuring instrument of problematic use of SNs. The sample comprised 1003 participants over 18 years old (M = 42.33; SD = 14.32). Exploratory factor analysis was performed with a randomly selected 30% of the sample, and confirmatory factor analysis with the remaining 70%. The reliability of the instrument was estimated, and evidence of validity in relation to the variables—anxiety, depression and satisfaction with life—was obtained. The new scale demonstrated a two-dimensional structure (GFI =0.99; RMSEA= 0.06), with one factor of negative social comparison (α = 0.94) and another of addictive consequences (α = 0.91). Clear evidence of validity related to other variables was found. The new scale demonstrated good psychometric properties. The advantage of this questionnaire is that it assesses not only excessive use but also social comparison through SNs.

Development and validation of the MARA scale in Spanish to assess knowledge and perceived risks and barriers relating to breast cancer prevention

ObjectiveThe aim of this study was to develop a measurement instrument for assessing knowledge of breast cancer and perceived risk of developing the disease (MARA).Methods641 women with a mean age of 36.19 years (SD = 7.49) participated in the study. Data collection took place during 2019 and included sociodemographic data, data on history of cancer and breast cancer, perceived risk, and feelings of concern about developing breast cancer. Internal consistency, test–retest reliability, convergent validity, and structural validity were tested.ResultsThe questionnaire items comprise 4 subscales: risk factors (9 items), signs and symptoms (9 items), perceived risk (6 items), barriers (7 items). A factor analysis revealed that the first two subscales had two dimensions each, whereas the other two subscales had one dimension each. Each subscale was shown to have adequate reliability (α = 0.74–0.92) and temporal stability (r = 0.201–0.906), as well as strong evidence of validity in relation to a questionnaire on breast cancer knowledge (r = 0.131–0.434). In addition, the subscales were shown to have high discriminatory power in terms of the presence or absence of a history of cancer or breast cancer, perceived risk, and feelings of concern.ConclusionThe MARA questionnaire represents a valid, reliable tool for assessing Spanish women’s knowledge, risks, perceptions, and barriers regarding breast cancer.

Grit Assessment: Is One Dimension Enough?

Grit is one of the non-cognitive variables that has received the most attention in recent years given its relationship to and influence in various aspects of life. There are very few reliable, valid instruments to evaluate it in Spanish-speaking countries. Because of that, the aim of this study is the development and validation of a new scale to evaluate grit in Spanish-speaking contexts. We used a sample of 531 Spanish participants (60% women) from the general population (Myears = 38.60, SDyears = 14.90). We examined the structure and measurement invariance of the instrument. We calculated the instrument’s reliability and obtained evidence of validity in relation to other variables. We examined the differences in grit as a function of gender and age. The factorial analyses confirmed the unidimensionality of the instrument, along with the measurement invariance of the scores with respect to sex and age. The new grit scale demonstrated excellent reliability (α = .94; ω = .94). We found clear evidence of validity in relation to other variables; the Grit short scale (r = .691), self-control (r = .595), self-efficacy (r = .703), and conscientiousness (r = .661). The new scale for evaluating grit (Oviedo Grit Scale) is essentially unidimensional, and scores produced by it exhibit excellent indicators of reliability and validity.

The Revised American Occupational Therapy Association Fieldwork Performance Evaluations: Evaluation of Content Validity-Part 1.

Occupational therapy education and practice has changed over time; however, items on the American Occupational Therapy Association's (AOTA's) Fieldwork Performance Evaluations (FWPEs) for the Occupational Therapy Student (OTS) and Occupational Therapy Assistant Student (OTAS) have not been updated in more than two decades. To explore evidence of validity in relation to test content of the revised FWPEs for the OTS and OTAS. A qualitative study using cognitive interviews was conducted to gather perspectives on the revised FWPEs, including updated items and a proposed rating scale. A content analysis approach was used to link patterns in responses to stable, meaningful constructs to further align and refine content of the tool before further validation. Fieldwork sites and academic settings. Eighteen fieldwork educators (FWEs) and academic fieldwork coordinators. Seven areas for refinement were identified: (1) relevance to a variety of practice settings, (2) overlapping and redundant items, (3) long item statements, (4) double- and triple-barreled item statements, (5) alignment between OTS and OTAS items, (6) further alignment with AOTA and Accreditation Council for Occupational Therapy Education documents and contemporary practice, and (7) wording and features of the proposed rating scale. The findings guided revisions of FWPE content. Cognitive interviewing was a critical step in refining the FWPE items to support content validity. The issues identified may not have been detected using traditional approaches to survey development and therefore were critical in maximizing the validity and usefulness of the final items, which will ultimately benefit fieldwork educators and students. This study resulted in refinements to FWPE items before the next step in the validation process, ultimately improving the final FWPE items. In addition, this article outlines a process that other researchers can use to validate similar tools.

Measurement equivalence of PROMIS depression in Spain and the United States.

In this study, we assessed the psychometric properties of the Spanish Patient-Reported Outcomes Measurement Information System (PROMIS) Depression in an adult population-representative sample from Spain (n = 1,503). We tested unidimensionality and local independence item response theory (IRT) assumptions with confirmatory factor and bifactor models under the exploratory structural equations modeling framework. We evaluated item monotonicity assumption with Mokken scaling analysis. We calibrated the items with an IRT-graded response model and assessed score reliability and test information, and evidence of validity with regard to scores on external measures. To examine differential item functioning by age, sex, education, and country (United States vs. Spain, N = 2,271), we used ordinal logistic regression. Results support compliance with IRT assumptions. We found few signs of differential item functioning: Only one item showed country differential functioning between the United States (n = 768) and Spain, with minimal impact on the overall score. Information values were equivalent to reliabilities over 0.90 from -1 (low depression) to +4 SD (high depression) around the population score mean. Evidence of validity in relation to concurrent measures was supported by the expected correlation pattern with external variables of depression, but higher than expected correlations with anxiety were found. Results indicate that the Spanish version of PROMIS Depression is adequate for assessing and monitoring depression levels in the general population and that PROMIS Depression is especially suitable for cross-national comparisons. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Locus of Control revisited: Development of a new bi-dimensional measure

<p>Locus of control (LOC) has a long tradition in Psychology, and various instruments have been designed for its measurement. However, the dimensionality of the construct is unclear, and still gives rise to considerable controversy. The aim of the present work is to present new evidence of validity in relation to the dimensionality of LOC. To this end, we developed a new measurement instrument with 23 items. The sample was made up of 697 Spanish participants, of whom 57.5% were women (<em>M</em>=22.43; <em>SD</em>= 9.19).<strong> </strong>The results support the bi-dimensionality of LOC: internal (α=.87) and external (α=.85). Furthermore, both subscales have shown adequate validity evidence in relation to self-efficacy, achievement motivation and optimism (<em>r</em><sub>xy</sub>> .21). Statistically significant differences were found by sex (<em>p </em>< .05): men scored higher in external LOC and women in internal LOC. The validity evidence supports a two-dimensional structure for the LOC, and the measurement instrument developed showed adequate psychometric properties.</p>

Validation of the Serbian adaptation of the Trait Emotional Intelligence Questionnaire-Child Form (TEIQue-CF)

This study investigated trait EI in childhood in a Serbian population by validating a Serbian adaptation of the Trait Emotional Intelligence Questionnaire - Child Form (TEIQue-CF). All 606 participants (Mage = 10.33, SD = 1.55) completed the TEIQue-CF, the Reading the Mind in the Eyes Test (revised version), and the Guess Who peer assessment. Data on academic achievement and truancy were also obtained. The Serbian TEIQue-CF demonstrated robust psychometric properties with satisfactory internal consistencies and extensive evidence of validity in relation to criteria such as emotion recognition, academic grades, truancy rates, and peer ratings. Factor analyses suggested a two-factor solution for the total sample, but a unifactorial structure for the two groups of younger children aged 8 to 9 and 10 to 11. Overall, the results corroborate the validity of the Serbian adaptation and the theoretical and practical importance of the construct of trait EI in children.