Establishing the Validity and Reliability of a Beginner-Level Volleyball Blocking Evaluation Tool

Face Validity

Adaptation and psychometric validation of the Turkish version of the motivation for healing scale in patients with cancer

Development and Content and Face Validation of Low-Cost Simulators Evaluation Instrument

To assess the face and content validity of artificial temporal bone dissection in surgical training in the UK. Expert and non-expert groups participated in artificial temporal bone dissection at the Queen Elizabeth Hospital, Birmingham, UK. Face and content validity were assessed by a validated post-dissection questionnaire. The median content validity score was 34 out of 35 (interquartile range 32.00-35.00). Mean face validity score compared to human was 45.76 out of 65 (95 per cent CI 42.57-48.94). Face validity compared to cadaveric models demonstrated equivalence (95 per cent CI 25.30-30.70, crossing equivalence value 27.00). Experts rated face validity less favourably than non-experts (p = 0.012 and 0.042, respectively). Content validity was equivalent between experts and non-experts (p = 0.052). There were no significant differences in total content (p = 0.606) and face validity (p = 0.133, p = 0.105) scores between different artificial bones. The high content and face validity suggests ENT training programs should consider formally incorporating artificial models into mastoid surgery training pathways.

MP23-09 A NOVEL TECHNIQUE FOR SIMULATED SURGICAL PROCEDURES USING 3D PRINTING TECHNOLOGY

BackgroundPrevious research indicates that routine inquiry or screening conducted by healthcare providers may significantly increase the identification of interpersonal violence. There is a lack of comprehensive instruments to routinely assess patients about interpersonal violence and violence against children in the household. The purpose of this study was to assess the content validity, face validity and reliability of the Questions on Violence (FOV) tool, an instrument specifically designed for routine inquiries about interpersonal violence in healthcare settings within the Swedish context.MethodsThe content validity, face validity and reliability of the FOV instrument was assessed through (1) a content validity index with six experts in the field of intimate partner violence, (2) cognitive interviews with nine patients recruited from a primary healthcare facility, and (3) an evaluation of the test-retest reliability based on responses from 37(50.0%) university students. The intraclass correlation coefficient, model 2.1, was calculated to assess the degree of correlation and agreement between the two measurements.ResultsCalculations based on the content validity index indicated that five out of seven items had excellent content validity (≥ 0.78). The average content validity index of included items was 0.88, which is slightly below the recommended threshold for excellent content validity. The results based on the cognitive interviews revealed that participants found the seven items to be relevant and easy to understand. Overall, the participants agreed that the concept of ‘close relationships’ primarily encompassed intimate partners, family members, and close friends. The value of the intraclass correlation coefficient was 0.85 (0.77–0.91; CI 95%), indicating good reliability with an interval of good to excellent test-retest reliability.ConclusionsThe results demonstrate that the seven-item FOV instrument has good content and face validity as well as good to excellent test-retest reliability. The current study provides healthcare professionals with a short yet comprehensive instrument for identifying patients who have experienced or perpetrated different forms of interpersonal violence.

The cause of constipation is multifactorial and common problem for patients on hemodialysis. A lack of strong evidence on suitable treatment strategies means there is an unorganized approach to selecting therapies, which can exacerbate constipation or worsen symptoms. Clinicians and patients would benefit from a content and face validated treatment algorithm for treating constipation. In this study, our objective was to develop and content and face validate a constipation treatment toolkit for patients on hemodialysis, consisting of treatment algorithm, and patient information tools (pamphlet and video). Literature searches were performed to develop an initial toolkit using Lynn's method for developing content-valid clinical tools. Content and face validity were evaluated as per Lynn's method for determining content validity; the algorithm was evaluated by Canadian nephrology clinicians, while patient information tools were evaluated by clinicians and patients. Components were rated on a Likert scale for content relevance and on a 5-point scale for face validity. After each round, the content validity index (CVI) score was calculated and revisions were made based on feedback. A total of 23 clinicians and 15 patients were interviewed across three validation rounds. After three rounds, the treatment algorithm achieved content (overall CVI=0.93) and face (91% agreement) validity. Our patient information tools achieved content and face validity (pamphlet overall CVI=0.99, 85.5% agreement; video overall CVI=0.99, 90.5% agreement). A treatment algorithm and patient information toolkit for the treatment of constipation in patients on hemodialysis were content and face validated via expert review. Further research will be needed to ascertain the effectiveness and implementation of this toolkit.

MP23-08 INITIAL VALIDATION DURING DEVELOPMENT OF LOW COST ALTERNATIVE TO THE DV-TRAINER USING THE HYDRA SYSTEM

Purpose The study aims to determine the content and face validity of the education conditionality and impact instrument for conditional cash transfers in zakat distribution (EDCI-ZCCT) measurement instrument. Design/methodology/approach The study uses the content validity ratio (CVR), content validity index (CVI) and modified Kappa statistic (K) for content validity and face validity ratio (FVI) for face validity. Ten experts in Malaysia from diverse fields – academia, industry research and zakat management – were selected to evaluate 16 items for relevance (content validity) and clarity (face validity). Findings The findings indicate that the instrument demonstrates high content and face validity, with strong agreement among the experts. The 16 items of the EDCI-ZCCT instrument achieved strong content validity, with CVR values ranging from 0.800 to 1.000, I-CVI between 0.900 and 1.000, an S-CVI of 0.988 and Kappa values from 0.899 to 1.000. The I-FVI clarity scores ranged from 1.000 to 0.900, with an average S-FVI/Ave of 0.969. Research limitations/implications These results confirm the instrument’s relevance, clarity and appropriate, with all 16 items retained and one additional item added based on expert feedback. Practical implications The validated EDCI-ZCCT instrument provides policymakers and zakat institutions with a practical, evidence-based tool to design, implement and evaluate education-conditional cash transfer programs, promoting accountability, educational attainment and human capital development among asnaf beneficiaries. Originality/value The originality of this research is associated with the validation of the CCT instrument for zakat distribution, with a specific focus on the education dimension, which has not been previously explored.

High fidelity, low cost moulage as a valid simulation tool to improve burns education

Medical Conundrums: Dress Codes: Are They Appropriate for Medical Education?

BackgroundThe reliability and validity of instruments used to survey health-care providers' views about and experiences with research evidence have seldom been examined.MethodsCountry teams from ten low- and middle-income countries (China, Ghana, India, Iran, Kazakhstan, Laos, Mexico, Pakistan, Senegal and Tanzania) participated in the development, translation, pilot-testing and administration of a questionnaire designed to measure health-care providers' views and activities related to improving their clinical practice and their awareness of, access to and use of research evidence, as well as changes in their clinical practice that they attribute to particular sources of research evidence that they have used. We use internal consistency as a measure of the questionnaire's reliability and, whenever possible, we use explanatory factor analyses to assess the degree to which questions that pertain to a single domain actually address common themes. We assess the questionnaire's face validity and content validity and, to a lesser extent, we also explore its criterion validity.ResultsThe questionnaire has high internal consistency, with Cronbach's alphas between 0.7 and 0.9 for 16 of 20 domains and sub-domains (identified by factor analyses). Cronbach's alphas are greater than 0.9 for two domains, suggesting some item redundancy. Pre- and post-field work assessments indicate the questionnaire has good face validity and content validity. Our limited assessment of criterion validity shows weak but statistically significant associations between the general influence of research evidence among providers and more specific measures of providers' change in approach to preventing or treating a clinical condition.ConclusionOur analysis points to a number of strengths of the questionnaire - high internal consistency (reliability) and good face and content validity - but also to areas where it can be shortened without losing important conceptual domains.

Introduction: Cognitive deficits impact the ability to perform instrumental activities of daily living (IADL) in patients diagnosed with Parkinson's disease (PD). Improved IADL measurement plays an important role in the assessment of functional independence and new cognition-enhancing treatments in PD. The purpose of this study was to translate and investigate the face and content validity of Penn Parkinson's Daily Activities Questionnaire-15 in Persian. Materials and Methods: This was a methodological study where the forward-backward method was used for the translation process. Face validity by 15 knowledgeable informants (KI) of PD participants and content validity by 15 occupational therapists were evaluated. Face validity was measured using quantitative and qualitative approaches, and quantitative content validity was determined by calculating Content Validity Ratio (CVR) and Content Validity Index (CVI). Results: Face validity was high (2/92-5), and all items were reported to be acceptable and understandable by KI, except for one question that needed to be explained to them with an example. Final corrections were done. Also, CVR (0.73-1) and CVI (0.86-1) were found to be within the acceptable range. Discussion: The Persian version of PDAQ-15 shows strong psychometric properties and also appears suitable for use as a clinical and research tool to evaluate daily cognitive functioning in PD patients. Key words: Parkinson's disease, instrumental activities of daily living, cognition, face validity, content validity

Face, Content, and Construct Validation of the Bristol TURP Trainer

Introduction: Quantifying Home Cooking EnviRonments has applications in nutrition epidemiology, health promotion, and nutrition interventions. This study aimed to develop a tool to quantify household cooking environments and establish its content validity, face validity, and inter-rater agreement. Methods: The Home Cooking EnviRonment and equipment Inventory observation form (Home-CookERI™) was developed as a 24-question (91-item) online survey. Items included domestic spaces and resources for storage, disposal, preparation, and cooking of food or non-alcoholic beverages. Home-CookERITM was piloted to assess content validity, face validity, and usability with six Australian experts (i.e., dietitians, nutrition researchers, chefs, a food technology teacher, and a kitchen designer) and 13 laypersons. Pilot participants provided feedback in a 10 min telephone interview. Home-CookERI™ was modified to an 89-item survey in line with the pilot findings. Inter-rater agreement was examined between two trained raters in 33 unique Australian households. Raters were required to observe each item before recording a response. Home occupants were instructed to only assist with locating items if asked. Raters were blinded to each other’s responses. Inter-rater agreement was calculated by Cohen’s Kappa coefficient (κ) for each item. To optimize κ, similar items were grouped together reducing the number of items to 81. Results: Home-CookERITM had excellent content and face validity with responding participants; all 24 questions were both clear and relevant (X2 (1, n = 19; 19.0, p = 0.392)). Inter-rater agreement for the modified 81-item Home-CookERI™ was almost-perfect to perfect for 46% of kitchen items (n = 37 items, κ = 0.81–1), moderate to substantial for 28% (n = 23, κ = 0.51–0.8), slight to fair for 15% (n = 12, κ = 0.01–0.5), and chance or worse for 11% of items (n = 9, κ ≤ 0.0). Home-CookERITM was further optimized by reduction to a 77-item version, which is now available to researchers. Conclusion: Home-CookERI™ is a comprehensive tool for quantifying Australian household cooking environments. It has excellent face and content validity and moderate to perfect inter-rater agreement for almost three-quarters of included kitchen items. To expand Home-CookERI™ applications, a home occupant self-completion version is planned for validation.