Further Evidence For Validity Research Articles

Translation, cultural adaptation and linguistic validation of the postgraduate hospital educational environment measure into Arabic

BackgroundAssessment of the clinical learning environment (CLE) is an essential step that teaching hospitals routinely undertake to ensure the environment is conducive, learning-oriented and supportive of junior doctors’ education. The Postgraduate Hospital Educational Environment Measure (PHEEM) is an internationally recognized tool for assessing the CLE with evidence of high reliability and validity. Translation of PHEEM into other languages such as Spanish, Japanese and Persian enabled wider adoption of the instrument in the world. However, in Syria and other Arabic countries, a validated Arabic translation of PHEEM is still not available, making it difficult to adopt it and use it in Arabic contexts. This study aims to translate and culturally adapt the PHEEM from English into Arabic.MethodsThis study followed the structured translation and validation process guideline proposed by Sousa & Rojjanasrirat 2010. First, the PHEEM went through forward translation by three translators, then reconciled with the aid of a fourth translator. Afterwards, two professional bicultural and bilingual translators conducted back translation into English and compared it with the original version. This formed the Pre-final Version (PFV) which was then pretested for clarity on a sample of medical residents in Damascus, Syria. Following appropriate modifications, the PFV was sent to a panel of experts for a comprehensive review of language clarity and to assess content validity.ResultsA total of thirty-five medical residents were recruited. Ten items with language clarity issues were identified and modified according to the elicited suggestions. Thereafter, the modified PFV was presented to ten subject experts who identified three items in need of revision. The item-content Validity Index (CVI) was over 0.78 for all of the 40 items; the calculated scale-CVI was 0.945.DiscussionThis study provided the first linguistically valid Arabic translation of the widely used PHEEM inventory. The next step is to conduct a full psychometric analysis of the Arabic PHEEM to provide further evidence of validity and reliability.

Reliability and validity of the revised Rushton Moral Resilience Scale for healthcare workers.

To refine the Rushton Moral Resilience Scale (RMRS) by creating a more concise scale, improving the reliability, particularly of the personal integrity subscale and providing further evidence of validity. Healthcare workers are exposed to moral adversity in practice. When unable to preserve/restore their integrity, moral suffering ensues. Moral resilience is a resource that may mitigate negative consequences. To better understand mechanisms for doing so, a valid and reliable measurement tool is necessary. Cross-sectional survey. Participants (N = 1297) had completed ≥1 items on the RMRS as part of the baseline survey of a larger longitudinal study. Item analysis, confirmatory factor analyses, reliability analyses (Cronbach's alpha), and correlations were used to establish reliability and validity of the revised RMRS. Item and confirmatory factor analysis were used to refine the RMRS from 21 to 16 items. The four-factor structure (responses to moral adversity, personal integrity, relational integrity and moral efficacy) demonstrated adequate fit in follow-up confirmatory analyses in the initial and hold-out sub-samples. All subscales and the total scale had adequate reliabilities (α ≥ 0.70). A higher-order factor analysis supports the computation of either subscale scores or a total scale score. Correlations of scores with stress, anxiety, depression and moral distress provide evidence of the scale's validity. Reliability of the personal integrity subscale improved. The RMRS-16 demonstrates adequate reliability and validity, particularly the personal integrity subscale. Moral resilience is an important lever for reducing consequences when confronted with ethical challenges in practice. Improved reliability of the four subscales and having a shorter overall scale allow for targeted application and will facilitate further research and intervention development. Data came from a larger study of Canadian healthcare workers from multiple healthcare organizations who completed a survey about their experiences during COVID-19.

Examining the antecedents and outcomes of satisfaction in film festival context: Further evidence of validity of the eudaimonic feelings construct

Within festivals and events, film festivals are among the fastest growing cultural events in the world and are recognised as bringing environmental, sociocultural and economic benefits to host tourism destinations including enhanced well-being. These festivals are an important marketing strategy for developing destination image and attracting interest towards a destination. However, there are limited studies on the film festival experience exploring the antecedents of participants’ satisfaction. This study examines the relationship between eudaimonic feelings, novelty, local culture, nostalgia, perceived quality, satisfaction, and behavioural intentions. Data were gathered during the last 3 days of the Penedo Film in the City of Penedo, Northeast Brazil using a questionnaire. A total of 97 valid questionnaires were collected from the festival attendees. Findings show that only eudaimonic feelings and perceived quality are predictors of satisfaction. To the best of authors knowledge, this study is the first to examine the perceived experience of participants in a film festival context from a positive psychology perspective and providing further empirical support for construct validity of eudaimonic feelings. The findings contribute to the existing tourism literature on film festivals by identifying key antecedents (eudaimonic feelings and perceived quality) and outcomes (behavioural intentions) of satisfaction with film festival. One of the main managerial implications includes engaging film festival participants in co-creation processes and in promoting group discussions about a specific movie with an appealing and social relevant theme.

Development and Validation of the Disclosure Expectancy Scale.

Although the disclosure of traumatic experiences is believed to influence trajectories of post-trauma recovery, less is known about individual differences that affect survivors' motivation to share. The current project describes the development and evaluation of the Disclosure Expectancy Scale (DExS), a novel instrument intended to assess survivors' expectations about the potential risks and benefits of disclosure. Items targeting both positive and negative expectancies were generated based on existing research and the authors' clinical experience with various survivor populations. Preliminary analyses in trauma-exposed undergraduates (N = 359) offer support for hypothesized positive and negative expectancy dimensions with evidence for the convergent and discriminant validity of scores. Subsequent evaluation in active-duty, help-seeking military personnel (N = 35) provides further evidence of validity based on correlations with relevant clinical measures. A final regression demonstrating unique effects of initial disclosure expectancies on post-traumatic stress disorder (PTSD) severity following trauma-focused treatment highlights the predictive validity of DExS scores.

Applying the Clinician-reported Genetic testing Utility InDEx (C-GUIDE) to genome sequencing: further evidence of validity

Genome sequencing (GS) outperforms other rare disease diagnostics, but standardized approaches to assessing its clinical utility are limited. This study assessed the validity of the Clinician-reported Genetic testing Utility InDEx (C-GUIDE), a novel tool for assessing the utility of genetic testing from a clinician’s perspective, for GS. C-GUIDE ratings were completed for patients who received GS results. For each patient, total C-GUIDE and single item global scores were calculated. Construct validity was assessed using linear regression to determine the association between C-GUIDE total and global item scores and measure the effects of potential explanatory variables. Ratings were completed for 67 pediatric and 36 adult patients. GS indications were neurological for 70.9% and results were diagnostic for 28.2%. When the C-GUIDE assessed primary (PV), secondary (SV), and pharmacogenomic (PGx) variants, on average, a one unit increase in the global item score was associated with an increase of 7.3 in the C-GUIDE score (p < 0.05). Diagnostic results were associated with an increase in C-GUIDE score of 5.0 compared to non-diagnostic results (p < 0.05) and an increase of one SV was associated with an increase of 2.5 (p < 0.05). For children, decreased age of one year was associated with an increase in C-GUIDE score of 0.3 (p < 0.05). Findings provide evidence that C-GUIDE measures the construct of clinical utility in pediatric and adult rare disease populations and is sensitive to changes in utility related to variant type. Quantifying the clinical utility of GS using C-GUIDE can inform efforts to optimize its use in patient care.

Further evidence of validity of the Nursing Decision Making Instrument: an Italian validation study.

This study aimed to provide the Italian version of the Nursing Decision Making Instrument (NDMI) and establish its content and face validity, construct validity, and reliability among Italian nurses. A three phases validation, methodological and cross-sectional study was realized. Phase one referred to the cultural-linguistic translation of the NDMI into Italian (i.e., I- NDMI). Phase two aimed to obtain a good level of content and face validity (cut-off <0.70). Phase three involved a cross-section data collection amongst Italian nurses in assessing the construct validity and reliability of the I-NDMI. I-NDMI showed adequate content validity. Confirmatory factor analysis models supported the four-factorial structure of the I-NDMI (i.e., Intuition; Prevision; Assessment; Planning) in explaining data obtained from nurses. Moreover, the scale and each domain showed adequate internal consistency. This study constituted an advancement in the psychometric testing of the NDMI. Future research should identify specific decision-making processes and their determinants to allow theoretically grounded interventions to improve decision-making among nurses.

Validation of Spanish Erasmus-Modified Nottingham Sensory Assessment Stereognosis Scale in Acquired Brain Damage.

Acquired brain injury (ABI) is the third leading cause of death in Spain. The disability derived from ABI can include considerable difficulties in upper-limb use due to somatosensory deficits. One of the assessments most commonly used to evaluate ABI is the Nottingham Sensory Assessment (NSA); however, there is no complete psychometric analysis or standardized version in Spanish. We aimed to develop and validate a Spanish version of the stereognosis component of the NSA for evaluating Spanish adults with ABI via a single-center, observational, cross-sectional study. The Spanish version of the NSA was developed in two steps. The first was based on the standardization and collection of normative data in 120 asymptomatic participants. For the second, we recruited 25 participants with ABI to establish concurrent criterion-related validity, internal consistency, and floor/ceiling effects. Criterion validity was assessed against two-point discrimination and tactile-localization tests. Our normative data showed significant differences among the various age groups (p < 0.05), supporting the validity of the Spanish-version assessment. For the ABI sample, we also found further evidence of validity with Spearman’s rho coefficient between the total scores and the two-point discrimination and tactile-localization tests, which showed low and moderate correlations (rho = 0.50–0.75, p < 0.05). Internal consistency was excellent, with a Cronbach’s alpha of 0.91. No ceiling or floor effects were found. We conclude that the stereognosis component of the NSA in its Spanish version is a valid scale that can be used to comprehensively and accurately assess stereognosis capacity in adults with ABI. As a low-cost evaluation, this assessment has great potential to be widely used in clinical practice and research settings.

Further evidence for the validity of a survey for self-regulated learning in sport practice

Self-regulated learning (SRL) is associated with enhanced athletic practice and sport expertise development. Self-report measures show promising associations with criteria for expertise development, yet there remains a need to further evidence of validity. We assessed whether modifications to the Self-Regulated Learning for Sport Practice (SRL-SP) survey to better consider practice challenges, and consideration of social desirability, would impact how survey scores discriminated between athletic skill-levels. A predominantly North American, mixed sport sample of competitive athletes (n = 235; ages 13–42; 66.8% female, 32.8% male, 0.4% non-binary) completed the modified SRL-SP survey online. Scores were then compared between athletes (n = 194) competing at four skill levels of senior (18+) competition (city/regional; provincial; national; international). Factor analysis confirmed the measurement model with five subscales. International-level athletes scored significantly higher on a composite score of all SRL subscales, and on individual subscales of effort and evaluating/reflecting, with larger effect sizes compared to previous work. Evidence of an advantage for more-elite athletes was characterized by complete correspondence in planning, checking and self-efficacy for challenge subscale scores. Controlling for social desirability scores did not meaningfully change results. The findings replicate associations between SRL and skill level, with enhanced criterion validity, and we recommend this refined version—the Self-Regulation of Sport Practice survey—for measuring self-reported SRL among competitive athletes.

Situational judgement test: Psychometric analysis of a pilot study for selecting post graduate medical student in residency program

Introductions: Selection process of post graduate medical students requires combination of knowledge, cognitive abilities and skills. Situational judgement test (SJT) is one on the important tools to measure cognitive abilities and skills. This study aims to measure the internal consistency reliability of SJT tool and item quality for local validation of the non-academic attributes. It also aims to do sub-group analysis of SJT scores based on this tool to provide further evidence for validity. &#x0D; Methods: This cross-sectional study was conducted at Patan Academy of Health Sciences (PAHS) in May 2017. Two sets of SJTs were developed after iterative discussion and modification to suit the local context. Set A had five options to a given situation, students had to rank these options from most appropriate to least appropriate. Set B had seven options to a given situations, students had to pick three best options. Medical officers and interns who were working at PAHS as medical officers participated in this study. &#x0D; Results: One hundred and sixteen medical officers participated in the study. Thirty-nine (33.6%) participants were interns who had graduated from PAHS and 77 (66.4%) were medical officers who had graduated from various institute inside and outside the Nepal. The overall Cronbach’s alpha for 35 questions was 0.65, that for set A (19 questions) was 0.56 and that for set B (16 questions) was 0.52. Adding SJT questions improved value of Cronbach’s alpha for SJT test as 40, 50, 60 and 70 questions gave Cronbach’s alpha of 0.68, 0.73, 0.76 and 0.79. Average percentage correct of set A was 76.3% and that of set B was 60.5%. SJT scores were statistically different for medical graduates from Nepal and different universities within Nepal. &#x0D; Conclusions: Locally developed situational judgement test is found to be reliable instrument for measuring non-academic construct of post-graduate medical entrance examination.

A measure of school racial socialization and quality of intergroup interactions.

The current study presents a comprehensive framework of campus racial climate and tests the validity and reliability of a new measure, the School Climate for Diversity Scale-College, in three independent samples. The scale measures 10 dimensions of campus racial climate in the two domains of intergroup interactions (frequency of interaction, quality of interaction, equal status, support for positive interaction, and stereotyping) and campus racial socialization (cultural socialization, mainstream socialization, promotion of cultural competence, colorblind socialization, and critical consciousness socialization). Participants were college students drawn from an online task system and a public university on the West Coast. Study 1 provided evidence of reliability and validity with existing measures of college climate, whereas Study 2 provided evidence of factor stability through exploratory factor analysis as well as additional evidence of discriminant and concurrent validity. Finally, Study 3 replicated the factor structure of Study 2 and provided further evidence of validity. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Evaluation of the Reliability and Validity of the Brazilian Version of the Here's How I Write: A Child's Self-Assessment and Goal Setting Tool.

Our objective was to translate the Here's How I Write: A Child's Self-Assessment and Goal Setting Tool (HHIW) to Portuguese; adapt it to the Brazilian culture; and analyze its reliability, validity, and clinical feasibility. The study was developed in two steps: adaptation of the HHIW to Brazilian Portuguese, followed by experimental application to examine its validity and reliability. The participants were 60 children and their teachers, divided into two groups: Group 1, whose members had handwriting difficulties, and Group 2, whose members did not. Children with poor handwriting scored lower on the HHIW for both self- and teacher report. Test-retest reliability of the children's (.96) and teachers' (.93) questionnaires as well as internal consistency (.91 and .95, respectively) were excellent. There was good agreement (.74) between the children's and teachers' total scores. This study adds further evidence of validity and reliability and supports the international use of the HHIW. The HHIW is a useful resource to engage children and teachers in a collaborative relationship to improve handwriting.

Identification of a novel mutant spp1 that specifies the identity of inflorescence meristem in rice

Homeotic mutations can affect the genetic architecture of flower structure. Some genes have been identified that specify shoot and floral meristem development. ABCDE and floral quartet are two widely accepted models that explain how genes interact to form all the whorls of a flower. In the current study, we identified an spp1 (SUPER PISTIL 1) mutant controlled by a single recessive nuclear gene mapping to chromosome 6 near RM50. Compared to wild type, spp1 mutants showed similar agronomic traits, except for panicle length and 1000-grain weight, which were significantly lower in the spp1 mutant plants. The mutation in the SPP1 gene induced complete homeotic transformations of paleae, lodicules, and stamens into carpelloid structures. Although lemmata were only marginally affected in the spp1 mutants, they developed a stigma-like structure on the top instead of an awn. Interestingly, stigma-like structures were also observed at the base of panicle branches. From the results, we propose that the SPP1 gene plays an important role in specifying the identity of lemmata/paleae, lodicules, stamens, and inflorescence meristem in rice. Identification of this mutant not only provides further evidence for validity of the ABCDE model in monocots, but also contributes to the understanding of meristem development.

Anticoagulation Knowledge Tool (AKT): Further evidence of validity in the Italian population.

IntroductionOral Anticoagulation therapy (OAC) is highly effective in the management of thromboembolic disorders. An adequate level of knowledge is important for self-management and optimizing clinical outcomes. The Anticoagulation Knowledge Tool (AKT) was developed to assess OAC knowledge and caters for both patients prescribed direct oral anticoagulants or vitamin K antagonist (VKA). However, evidence regarding its psychometric proprieties, validity and reliability are unavailable in non-English speaking settings. For this reason, the aim of this study is to provide further evidence of validity for AKT and also developing an Italian AKT version (I-AKT) supported by evidence of validity and reliability.MethodsA multiphase study was conducted which included the following: cultural and linguistic validity; i.e. content validity; construct validity; reliability assessment. The Construct validity was performed using the contrasted group approach using three groups comprised of health care providers, patients and the general public. Furthermore, Exploratory Structural Equation Modelling (ESEM) was performed to confirm the mono-dimensional structure of the items in the AKT.ResultsIn construct validity phase 334 participants were enrolled. One-way ANOVA and post hoc analysis test demonstrated significant differences between the means knowledge scores of the three groups: 30.42±3.04 vs 23.45± 4.57 vs14.32±6.07 (Statistic F = 266.83; p < .001). ESEM analysis demonstrates the I-AKT mono-dimensionally structure with an explained variance of 56.42%. The scale also showed both good internal consistency reliability (Cronbach’s α = 0.896) and test-retest reliability (r = 0.855).ConclusionThis study developed and validated I-AKT with supporting evidence for validity and reliability. The study also confirms the mono-dimensional of the items in the AKT. This suggest that the instrument can be useful in non-English setting for knowledge assessment and in potentially developing patient education materials.

Development and Preliminary Psychometric Evaluation of a Patient-Reported Outcome Measure for Lung Cancer Stigma: The Lung Cancer Stigma Inventory (LCSI).

Among patients with lung cancer, stigma is associated with negative psychosocial and behavioral outcomes. There is a need to develop psychometrically robust patient-reported outcome (PRO) measures for stigma that incorporate perspectives of patients diagnosed with lung cancer. As part of our multi-phase process of measure development and validation, we report on scale formation and preliminary psychometric evaluation of the Lung Cancer Stigma Inventory (LCSI). Building on previously reported concept elicitation (Phase I) work, Phase II of LCSI development involved item generation and refinement, informed by literature review, provider input, and patient (N=20) feedback. Phase III focused on initial psychometric scale evaluation in a unique sample of 231 lung cancer patients. Based on provider input and patient cognitive interviews, 49 items were included in a preliminary measure. In an exploratory factor analysis (EFA) of the 37 retained items, three factors emerged: Perceived Stigma, Internalized Stigma, and Constrained Disclosure. Internal consistency of the final, 25-item LCSI scale was high (Cronbach's alpha= 0.89) and the three subscales demonstrated good internal consistency. The test-retest correlation was high (r = 0.91), suggesting strong stability of measurement over time. There was good convergent validity between the LCSI and an existing measure of lung cancer stigma, the Cataldo Lung Cancer Stigma Scale (CLCSS; r= 0.58, p< 0.001). In a multi-phase process, we have developed a reliable, multi-dimensional measure of lung cancer stigma, the Lung Cancer Stigma Inventory (LCSI). Subsequent work will be conducted to establish further evidence of validity and clinically meaningful change.

Implicit Association Test for Aggressiveness: Further evidence of validity and resistance to desirable responding

This paper reports the results of three interrelated studies investigating the validity and resistance to desirable responding of the Implicit Association Test for Aggressiveness (IAT-A). In Studies 1 and 2, we tested its validity by correlating it with an established explicit measure of aggressiveness, the conceptually closest measure of socially desirable responding (SDR), and various aggression-related criteria in two large samples of participants. The results supported the validity of IAT-A. It had satisfactory reliability, it was non-significantly or weakly related to an explicit measure of aggressiveness and unrelated to the SDR measure, and it explained different aggression-related behaviors over and above the explicit aggressiveness measure. In Study 3, we examined the IAT-A's susceptibility to deliberate response distortion by comparing the IAT-A and self-reported aggressiveness between situations of honest responding and simulated personnel selection. The results revealed that the IAT-A is less susceptible to deliberate response distortion than the self-report measure of explicit aggressiveness. The mean result on the IAT-A was almost identical between the two response situations, whereas for the self-report measure of aggressiveness, participants scored significantly lower in the simulated selection situation. Altogether, the results suggest that IAT-A is a valid and potentially useful implicit aggressiveness measure.

Factorial Invariance and Convergent Validity of the Group-Based Medical Mistrust Scale across Gender and Ethnoracial Identity.

The objective of this study was to assess the factorial invariance and convergent validity of the Group-Based Medical Mistrust Scale (GBMMS) across gender (male and female) and ethnoracial identity (Latino and Black). Minority students (N = 686) attending a southeastern university were surveyed in the fall of 2011. Psychometric analysis of the GBMMS was performed. A three-factor solution fit the data after the omission of two problematic items. This revised version of the GBMMS exhibited sufficient configural, metric, and scalar invariance. Convergence of the GBMMS with conceptually related measures provided further evidence of validity; however, there was variation across ethnoracial identity. The GBMMS has viable psychometric properties across gender and ethnoracial identity in Black and Latino populations.

Continued Validation of the O-SCORE (Ottawa Surgical Competency Operating Room Evaluation): Use in the Simulated Environment

Construct: The Ottawa Surgical Competency Operating Room Evaluation (O-SCORE) is a 9-item surgical evaluation tool designed to assess technical competence in surgical trainees using behavioral anchors. Background: The initial development of the O-SCORE produced evidence for valid results. Further work is required to determine if the use of a single surgeon or an unblinded rater introduces bias. In addition, the relationship of the O-SCORE to other currently used technical assessment tools should be explored to provide validity evidence related to the relationship to other measures. We have designed this project to provide continued validity evidence for the O-SCORE related to these two issues. Approach: Nineteen residents and 2 staff Orthopedic Surgeons from the University of Ottawa volunteered to participate in a 2-part OSCE style station. Participants completed a written questionnaire followed by a videotaped 10-minute simulated open reduction and internal fixation of a midshaft radius fracture. Videos were rated individually by 2 blinded staff orthopedic surgeons using an Objective Structured Assessment of Technical Skills (OSATS) global rating scale, an OSATS checklist, and the O-SCORE in random order. Results: O-SCORE results appeared sensitive to surgical training level even when raters were blinded. In addition, strong agreement between two independent observers using the O-SCORE suggests that the measure captures a performance easily recognized by surgical observers. Ratings on the O-SCORE also were strongly associated with global ratings on the currently most validated technical evaluation tool (OSATS). Collectively, these results suggest that the O-SCORE generates accurate, reproducible, and meaningful results when used in a randomized and blinded fashion, providing continued validity evidence for using this tool to evaluate surgical trainee competence. Conclusions: The O-SCORE was able to differentiate surgical trainee level using blinded raters providing further evidence of validity for the O-SCORE. There was strong agreement between two independent observers using the O-SCORE. Ratings on the O-SCORE also demonstrated equivalence to scores on the most validated technical evaluation tool (OSATS). These results suggest that the O-SCORE demonstrates accurate and reproducible results when used in a randomized and blinded fashion providing continued validity evidence for this tool in the evaluation of surgical competence in the trainees.

Psychometric Properties of the Korean Version of the HIV Self-Management Scale in Patients with HIV.

The purpose of this study was to examine validity and reliability of Webel and colleagues' HIV Self-Management Scale when used with a Korean sample. The original 20-item HIV Self-Management Scale was translated into Korean using translation and back-translation. Nine HIV nurse experts tested content validity. Principal component analysis (PCA) and confirmatory factor analysis (CFA) of data from 203 patients was used to test construct validity. Concurrent validity was evaluated using correlation with patients' self-rating as a "smart patient" measured using a visual analogue scale. Internal consistency was tested by Cronbach's alpha coefficients. All items were rated as having satisfactory content validity. Based on PCA and consideration of conceptual meaning, a three-factor solution was selected, explaining 48.76% of the variance. CFA demonstrated the adequacy of the three-domain structure of the construct HIV self-management: daily self-management health practices, social support and HIV self-management, and chronic nature of HIV self-management. Goodness-of-fit indices showed an acceptable fit overall with the full model (χ²/df(₁₆₄)=1.66, RMSEA=0.06, SRMR=0.05, TLI=0.91, and CFI=0.92). The Korean version of the HIV Self-Management Scale (KHSMS) was significantly correlated with patients' self-rated smart patient (r=.41). The subscale Cronbach's alpha coefficients ranged from .78 to .81; alpha for the total scale was .89. The KHSMS provides a valid and reliable measure of self-management in Korean patients with HIV. Continued psychometric testing is recommended to provide further evidence of validity with this population.

The well-being 5: development and validation of a diagnostic instrument to improve population well-being.

Building upon extensive research from 2 validated well-being instruments, the objective of this research was to develop and validate a comprehensive and actionable well-being instrument that informs and facilitates improvement of well-being for individuals, communities, and nations. The goals of the measure were comprehensiveness, validity and reliability, significant relationships with health and performance outcomes, and diagnostic capability for intervention. For measure development and validation, questions from the Well-being Assessment and Wellbeing Finder were simultaneously administered as a test item pool to over 13,000 individuals across 3 independent samples. Exploratory factor analysis was conducted on a random selection from the first sample and confirmed in the other samples. Further evidence of validity was established through correlations to the established well-being scores from the Well-Being Assessment and Wellbeing Finder, and individual outcomes capturing health care utilization and productivity. Results showed the Well-Being 5 score comprehensively captures the known constructs within well-being, demonstrates good reliability and validity, significantly relates to health and performance outcomes, is diagnostic and informative for intervention, and can track and compare well-being over time and across groups. With this tool, well-being deficiencies within a population can be effectively identified, prioritized, and addressed, yielding the potential for substantial improvements to the health status, performance, and quality of life for individuals and cost savings for stakeholders.

Development and psychometric evaluation of scales to measure professional confidence in manual medicine: a Rasch measurement approach.

BackgroundHealth professionals in athletic training, chiropractic, osteopathy, and physiotherapy fields, require high-level knowledge and skills in their assessment and management of patients. This is important when communicating with patients and applying a range of manual procedures. Prior to embarking on professional practice, it is imperative to acquire optimal situation-specific levels of self-confidence for a beginner practitioner in these areas. In order to foster this professional self-confidence within the higher education context, it is necessary to have valid and reliable scales that can measure and track levels and how they change. This study reports on the development and psychometric analysis of two new scales, Patient Communication Confidence Scale (PCCS) and the Clinical Skills Confidence Scale (CSCS), to measure confidence in these two areas for students in manual medicine programs. The Rasch measurement model was used to guide the development of the scales and establish their psychometric properties.MethodsThe responses to 269 returned questionnaires over two occasions were submitted to psychometric analysis, with various aspects of the scales examined including: item thresholds; item fit; Differential Item Functioning; targeting; item locations; item dependencies; and reliability. To provide further evidence of validity, scores were correlated with two existing valid scales.ResultsAnalyses showed that the scales provided valid and reliable measures of confidence for this sample of persons. High Person Separation Indices (0.96 for PCCS; 0.93 for SCSC) provided statistical evidence of reliability, meaning the scales are able to discriminate amongst persons with different levels of confidence. For the PCCS, item categories were operating as required, and for the CSCS only two items’ thresholds were slightly disordered. Three tests of fit revealed good fit to the model (indicating the internal consistency of both scales) and results of the correlations with two existing valid scales were consistent with expectations.ConclusionsThe importance of confidence cannot be overlooked in health education because students learning new information and skills, and dealing with challenging situations can be negatively impacted by a lack of confidence which can result in students disengaging from placements or leaving a program. Valid and reliable instruments are essential in tracking change in levels of confidence in specific skills over time and the examination of the degree of congruence between confidence and competence. Analysis of responses to the two confidence scales established that they are valid and reliable instruments.