Excellent Validity Research Articles

Validation of the Efficacy of Ultrasound Speckle Tracking in Measuring Tendon Gliding After Finger Flexor Tendon Repair.

Restricted tendon gliding is commonly observed in patients after finger flexor tendon (FFT) repair. The study described here was aimed at quantifying the amount of FFT gliding to evaluate the recovery of post-operative tendons using a 2-D radiofrequency (RF)-based ultrasound speckle tracking algorithm (UST). Ex vivo uniaxial tensile testing of porcine flexor tendons and in vivo isometric testing of human FFT were implemented to verify the efficacy of UST beforehand. The verified UST was then applied to the patients after FFT repair to compare tendon gliding between affected and healthy sides and to investigate its correlation with the joint range of motion (ROM). Excellent validity was confirmed with the average R2 value of 0.98, mean absolute error of 0.15 ± 0.08 mm and mean absolute percentage error of 5.19 ± 2.43% between results from UST and ex vivo testing. The test-retest reliability was verified with good agreement of ICC (0.90). The affected side exhibited less gliding (p=0.001) and smaller active ROM (p=0.002) than the healthy side. Meanwhile, a significant correlation between tendon gliding and passive ROM was found only on the healthy side (ρ=0.711, p=0.009). The present study provides a promising protocol to evaluate post-operative tendon recovery by quantifying the amount of FFT gliding with a validated UST. FFT gliding in patients with different levels of ROM restriction should be further explored for categorizing the severity of tendon adhesion.

Development and validation of a novel instrument to capture companion dog mortality data: the Dog Aging Project End of Life Survey.

The researchers and clinicians within the Dog Aging Project (DAP), a longitudinal cohort study of aging in companion dogs, created and validated a novel survey instrument titled the End of Life Survey (EOLS) to gather owner-reported mortality data about companion dogs. Bereaved dog owners who participated in the refinement, face validity assessment, or reliability assessment of the EOLS (n = 42) and/or completed the entire survey between January 20 and March 24, 2021 (646). The EOLS was created and modified by veterinary health professionals and human gerontology experts using published literature, clinical veterinary experience, previously created DAP surveys, and feedback from a pilot study conducted with bereaved dog owners. The EOLS was subjected to qualitative validation methods and post hoc free-text analysis to evaluate its ability to thoroughly capture scientifically relevant aspects of companion dogs' deaths. The EOLS was well received with excellent face validity as assessed by dog owners and experts. The EOLS had fair to substantial reliability for the 3 validation themes-cause of death (κ = 0.73; 95% CI, 0.5 to 0.95), perimortem quality of life (κ = 0.49; 95% CI, 0.26 to 0.73), and reason for euthanasia (κ = 0.3; 95% CI, 0.08 to 0.52)-and had no need for any substantial content alterations based on free-text analysis. The EOLS has proven to be a well-accepted, comprehensive, and valid instrument for capturing owner-reported companion dog mortality data and has the potential to enhance veterinarians' ability to care for the aging dog population by illuminating their understanding of companion dogs' end-of-life experiences.

Aggressive Driving, Rule-Breaking, and Driver Stress in Spanish-speaking countries

Driver Aggression is a phenomenon many have studied in all five continents. It has been the focus of curiosity for all sorts of disciplines, and science has been unable to curb it, much less park it. Driver Stress, Road Aggression and Road Rule-Breaking are crucial elements in traffic psychology. Those who do not respect the rules are a major factor in increased risk and the occurrence of major traffic accidents. Little work has been done on how these phenomena behave in Spanish-speaking countries, much less the development of useful instruments to evaluate them. This study aims to generate two unique scales that can be used in Spanish speaking countries regardless of culture or geography, as well as determining the influence Driver Stress has on Driver Aggression and Rule-Breaking. This study comprises a sample of 1827 drivers from Mexico, Guatemala, Costa Rica, and Spain. Through this paper, a small yet significant relationship was found between Driver Stress, Driver Aggression, and Driver Rule-Breaking. This suggests that personality factors are at play in these relationships in Spanish-speaking countries, and that these variables are an important factor on how drivers behave. This study also delivers two useful tools for evaluating Driver Aggression (LatinCAT) and Driver Rule-Breaking (LatinDANT) that have excellent construct validity for further research in Spanish-speaking countries.

Development of a transdiagnostic digital interactive application for eating disorders: psychometric properties, satisfaction, and perceptions on implementation in clinical practice

BackgroundGiven limited availability of informed treatments for people affected by eating disorders (EDs), there has been increasing interest in developing self-administered, technology-based ED interventions. However, many available interventions are limited to a specific ED diagnosis or assume that participants are ready to change. We developed a digital self-help application (called ASTrA) that was explicitly designed to be transdiagnostic and to help increase motivation for change. The aim of the present study was to describe the development and examine the psychometric properties, user satisfaction and rated potentials for practical use of our application.MethodsThe content of our application was based on concepts derived from self-determination theory, the transtheoretical model of change, and cognitive theory. The application was developed by a multidisciplinary team of clinicians, researchers, staff members and individuals with lived ED experience, each being involved in all steps of the application’s development. We tested validity, reliability, satisfaction and perceived feasibility for clinical implementation in an independent sample of 15 patients with an ED and 13 clinicians specialized in ED treatment. Psychometric properties were evaluated using descriptive statistics, correlations, content validity indices and intraclass coefficients. Differences in satisfaction ratings and perceived potential for clinical implementation of the application between clinicians and patients were examined using Mann–Whitney U tests.ResultsThe digital application showed excellent validity (mean i-CVI: .93, range: .86–.96) and internal reliability (all Cronbach alpha’s > .88). Patients and clinicians both considered the application acceptable, appropriate, and feasible for use in clinical practice.ConclusionsFindings suggest that our transdiagnostic interactive application has excellent psychometric properties. Furthermore, patients and clinicians alike were positive about the possible use of the application in clinical practice. The next step will be to investigate the application's effectiveness as an intervention to promote autonomous motivation and to facilitate remission in people on the waitlist for specialized ED treatment.

Remote severity assessment in atopic dermatitis: Validity and reliability of the remote Eczema Area and Severity Index and Self-Administered Eczema Area and Severity Index

Reliable assessment of atopic dermatitis (AD) severity is necessary for clinical practice and research. Valid and reliable remote assessment is essential to facilitate remote care and research. Assess the validity and reliability of the Eczema Area and Severity Index (EASI) based on images and patient-assessed severity based on the Self-Administered EASI (SA-EASI). Whole-body clinical images were taken during consultation from children with AD. After consultations, caregivers completed the SA-EASI and provided images from home. Four raters assessed all images twice using EASI. A total of 1534 clinical images and 425 patient-provided images were collected from 87 and 32 children. Excellent (0.90) validity, good inter (0.77) and intrarater reliability (0.91), and standard error of measurement (4.31) was found for the EASI based on clinical images. Feasibility of patient-provided images showed limitations with missing images (43.8%) and quality issues (23.1%). However, good validity (0.86), inter (0.74) and intrarater reliability (0.94) were found when assessment was possible. Moderate correlation (0.60) between SA-EASI and EASI was found. Low portion patient-provided images. AD severity assessment based on images strongly correlates with in-person AD assessment. Good measurement properties confirm the potential of remote assessment. Moderate correlation between SA-EASI and in-person EASI suggest limited value of self-assessment.

Multiscale progressive text prompt network for medical image segmentation

The accurate segmentation of medical images is a crucial step in obtaining reliable morphological statistics. However, training a deep neural network for this task requires a large amount of labeled data to ensure high-accuracy results. To address this issue, we propose using progressive text prompts as prior knowledge to guide the segmentation process. Our model consists of two stages. In the first stage, we perform contrastive learning on natural images to pretrain a powerful prior prompt encoder (PPE). This PPE leverages text prior prompts to generate multimodality features. In the second stage, medical image and text prior prompts are sent into the PPE inherited from the first stage to achieve the downstream medical image segmentation task. A multiscale feature fusion block (MSFF) combines the features from the PPE to produce multiscale multimodality features. These two progressive features not only bridge the semantic gap but also improve prediction accuracy. Finally, an UpAttention block refines the predicted results by merging the image and text features. This design provides a simple and accurate way to leverage multiscale progressive text prior prompts for medical image segmentation. Compared with using only images, our model achieves high-quality results with low data annotation costs. Moreover, our model not only has excellent reliability and validity on medical images but also performs well on natural images. The experimental results on different image datasets demonstrate that our model is effective and robust for image segmentation.

Navigating young minds: reliability and validity of the Greek version of kiddie – schedule for affective disorders and schizophrenia – present and lifetime DSM-5 version (K-SADS-PL-GR-5)

BackgroundThe Kiddie-Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version (K-SADS-PL) is one of the most popular semi-structured psychiatric interviews for children and adolescents. Its latest DSM-5 version (K-SADS-PL DSM-5) has only recently been adapted and validated in various languages. In the present study, we aimed to investigate the reliability and validity of the Greek version of the K-SADS-PL DSM-5.MethodsA total of 137 patients consecutively referred for admission, aged 7–17, were included. The K-SADS-PL DSM-IV was translated and adapted to correspond to DSM-5 categories. Convergent and divergent validity were assessed against two self-report rating scales, Children’s Depression Inventory (CDI) and Screen for Child Anxiety Related Emotional Disorders (SCARED). Inter-rater reliability was calculated exclusively for instances where a diagnosis involved three or more patients.ResultsOur findings revealed good to excellent inter-rater reliability and good to excellent consensual validity across most psychiatric diagnoses, except for panic disorder. Diagnostic efficiency, measured by sensitivity, specificity, positive and negative predictive values, consistently showed high specificity and negative predictive validity across all diagnostic categories.ConclusionsThese findings support the applicability of the Greek version of the K-SADS-PL DSM-5 as a reliable and valid diagnostic tool in Greek-speaking populations.

THA-Net: A Deep Learning Solution for Next-Generation Templating and Patient-specific Surgical Execution

BackgroundThis study introduces THA-Net, a deep learning inpainting algorithm for simulating postoperative total hip arthroplasty (THA) radiographs from a single preoperative pelvis radiograph input, while being able to generate predictions either unconditionally (algorithm chooses implants) or conditionally (surgeon chooses implants). MethodsThe THA-Net is a deep learning algorithm which receives an input preoperative radiograph and subsequently replaces the target hip joint with THA implants to generate a synthetic yet realistic postoperative radiograph. We trained THA-Net on 356,305 pairs of radiographs from 14,357 patients from a single institution’s total joint registry and evaluated the validity (quality of surgical execution) and realism (ability to differentiate real and synthetic radiographs) of its outputs against both human-based and software-based criteria. ResultsThe surgical validity of synthetic postoperative radiographs was significantly higher than their real counterparts (mean difference: 0.8 to 1.1 points on 10-point Likert scale, P < .001), but they were not able to be differentiated in terms of realism in blinded expert review. Synthetic images showed excellent validity and realism when analyzed with already validated deep learning models. ConclusionWe developed a THA next-generation templating tool that can generate synthetic radiographs graded higher on ultimate surgical execution than real radiographs from training data. Further refinement of this tool may potentiate patient-specific surgical planning and enable technologies such as robotics, navigation, and augmented reality (an online demo of THA-Net is available at: https://demo.osail.ai/tha_net).

Validity and reliability of an app-based medical device to empower individuals in evaluating their physical capacities.

Cardiorespiratory fitness and muscle strength are valid markers of health and strong predictors of mortality and morbidity. The tests used to measure these variables require in-person visits with specialized equipment and trained personnel-leading to organizational constraints both for patients and hospitals, and making them difficult to implement at a large scale. In this context, technologies embedded in smartphones offer new opportunities to develop remote tests. This study aimed to test the validity and reliability of MediEval, a newly developed app-based medical device that allows individuals to perform the 6-minute walk test (6MWT) and the 30-second sit-to-stand (30s-STS) test on their own using GPS signal and camera detection with a skeleton extraction algorithm. A total of 53 healthy adults performed the two tests in three different sessions to determine the intra- and inter-day reproducibility. Test validity was assessed by comparing the results obtained from the app to gold standard measures. Pearson correlations and concordance correlation coefficients, the relative measurement error, intraclass correlation coefficients, the standard error of measure and the minimal detectable change were computed for each test.s. The results revealed high to excellent validity of the app in comparison to gold standards (ρ = 0.84 for the 6MWT and ρ = 0.99 for the 30s-STS test) with low relative measurement error. The mean differences between the app and the gold standard measures were 8.96m for the 6MWT and 0.28 repetition for the 30s-STS test. Both tests had good test-retest reliability (ICCs = 0.77). The minimal detectable changes were respectively 97.56 meters for the 6MWT and 7.37 repetitions for the 30s-STS test. The MediEval medical device proposes valid and reproducible measures of the 6MWT and the 30s-STS test. This device holds promise for monitoring the physical activity of large epidemiologic cohorts while refining patient experience and improving the scalability of the healthcare system. Considering minimal detectable change values, it may be important to ask participants to perform several tests and average them to improve accuracy. Future studies in clinical context are needed to evaluate the responsiveness and the smallest detectable changes of the device for specific populations with chronic diseases.

Validation of the youth-nine item avoidant/restrictive food intake disorder screen.

This study assessed the factorial, divergent, and criterion-related validity of the Youth-Nine Item Avoidant/Restrictive Food Intake Disorder (ARFID) Screen (Y-NIAS) in a paediatric clinical sample at initial evaluation for an eating disorder (ED). Participants included 310 patients (82.9% female, 77.4% White, Age M=14.65) from a tertiary ED clinic. Confirmatory factor analysis (CFA) evaluated the three-factor of the Y-NIAS. One-way analysis of variance compared Y-NIAS scores across diagnoses. A receiver operating curve analysis assessed the ability of each subscale to identify ARFID presentations from the full sample. Two logistic regressions assessed the criterion-related validity of the obtained Y-NIAS cut-scores. CFA supported the original three-factor structure of the Y-NIAS. Clinically-elevated scores were observed in all diagnostic groups except for binge-eating disorder. Subscales were unable to discriminate ARFID cases from other ED diagnoses. Cut scores were identified for picky eating subscale (10) and Fear subscale (9), but not for Appetite subscale. In combination with the ED Examination Questionnaire (EDE-Q), classification accuracy was moderate for ARFID (62.7%) and other EDs (89.4%). The Y-NIAS demonstrated excellent factorial validity and internal consistency. Findings were mixed regarding the utility of the Y-NIAS for identifying clinically-significant ARFID presentations from other ED diagnoses.

Laser-Based 3D Body Scanning Reveals a Higher Prevalence of Abdominal Obesity than Tape Measurements: Results from a Population-Based Sample.

The global obesity epidemic is a major public health concern, and accurate diagnosis is essential for identifying at-risk individuals. Three-dimensional (3D) body scanning technology offers several advantages over the standard practice of tape measurements for diagnosing obesity. This study was conducted to validate body scan data from a German population-based cohort and explore clinical implications of this technology in the context of metabolic syndrome. We performed a cross-sectional analysis of 354 participants from the Study of Health in Pomerania that completed a 3D body scanning examination. The agreement of anthropometric data obtained from 3D body scanning with manual tape measurements was analyzed using correlation analysis and Bland-Altman plots. Classification agreement regarding abdominal obesity based on IDF guidelines was assessed using Cohen's kappa. The association of body scan measures with metabolic syndrome components was explored using correlation analysis. Three-dimensional body scanning showed excellent validity with slightly larger values that presumably reflect the true circumferences more accurately. Metabolic syndrome was highly prevalent in the sample (31%) and showed strong associations with central obesity. Using body scan vs. tape measurements of waist circumference for classification resulted in a 16% relative increase in the prevalence of abdominal obesity (61.3% vs. 52.8%). These results suggest that the prevalence of obesity may be underestimated using the standard method of tape measurements, highlighting the need for more accurate approaches.

Probing apathy in children and adolescents with the Apathy Motivation Index–Child version

Apathy is linked to mental health and altered neurocognitive functions such as learning and decision-making in healthy adults. Mental health problems typically begin to emerge during adolescence, yet little is known about how apathy develops due to an absence of quantitative measurements specific to young people. Here, we present and evaluate the Apathy Motivation Index–Child Version (AMI-CV) for children and adolescents. We show across two samples of young people (aged 8 to 17 years, total N = 191) tested in schools in the UK and on a smartphone app, that the AMI-CV is a short, psychometrically sound measure to assess levels of apathy and motivation in young people. Similar to adult versions, the AMI-CV captures three distinct apathy domains: Behavioural Activation, Social Motivation and Emotional Sensitivity. The AMI-CV showed excellent construct validity with an alternative measure of apathy and external validity replicating specific links with related mental health traits shown in adults. Our results provide a short measure of self-reported apathy in young people that enables research into apathy development. The AMI-CV can be used in conjunction with the adult version to investigate the impact of levels of apathy across the lifespan.

Development of Shooting and Dribbling Skill Test Instruments for U-23 Futsal Players in Central Java Province

A futsal basic skills measurement tool with excellent validity and reliability in test shooting and test dribbling was created as a result of this research to be used in the teaching and training of U-23 futsal sports. The research design employed was development research, with procedures for formulating initial product types/models for PORPROV Surakarta futsal players aged 18 to 23 years, with as many as 15 players for small groups and 90 PORPROV players for group trials. This is made up of the six districts of Banyumas Regency, Klaten Regency, Kebumen Regency, and Kendal Regency. The validity, reliability, and norms of the product skills test were then evaluated. Validity and dependability tests for small-scale instruments consisting of the basic skills of the shooting test obtained a value of 0.959 and the shooting retest obtained a value of 0.971 while the reliability test was 0.979. The dribbling validity test for the test was obtained at 0.968 and for the retest was 0.964 with a reliability of 0.893. The results of the large-scale validity of the basic skills of test shooting obtained a value of 0.948 and a retest obtained a value of 0.988 while the reliability test was 0.971. The results of the large-scale validity on the basic skills of the dribbling validity test for the test were obtained at 0.995 and for the retest at 0.995 with a reliability of 0.990, so it can be said that a reliable measuring instrument will still produce the same relative value even though it is carried out at different times. There is no difference between the small group and the large group in the U-23 futsal test shooting and test dribbling basic skill norms so the measuring instrument can be said to be objective.

Co-designing psychosis simulated patient scenarios with mental health stakeholders for pharmacy curricula

BackgroundPharmacists need knowledge and confidence to support people living with mental illness. Evidence-based educational materials for pharmacy students to provide psychosis care is limited.AimTo co-design, content validate and pilot-test, with mental health stakeholders, simulated patient scenarios to educate and assess students in providing psychosis care.MethodMental health consumers were invited to co-design three simulated patient scenarios (first-episode psychosis, carer of someone living with schizophrenia, non-adherence to antipsychotics), guided by published and psychometrically-tested materials. A panel of mental health stakeholders participated in two rounds of content validation (RAND/UCLA appropriateness model). Round 1 involved individual survey completion to calculate item content validity index (I-CVI) for relevance/clarity, content validity ratio for essentiality and overall scale content validity index (S-CVI/Ave and S-CVI/UA) scores for each scenario. Scores analyses and feedback comments informed revisions. Round 2 involved a panel meeting to discuss revisions and finalise content. The scenarios were then pilot-tested with pharmacy students.ResultsTwo consumers participated in co-design, nine stakeholders in content validation. All items showed excellent content validity for relevance/clarity. Eleven items were revised for essentiality, discussed, then re-rated at the panel meeting for consensus. The scenarios were pilot-tested with pharmacy students (n = 15) and reported to be realistic and relevant to future practice, contributing to students’ confidence in supporting people experiencing mental health symptoms or crises.ConclusionPartnering with mental health stakeholders has enabled co-design of authentic, content valid educational materials for pharmacy students to provide psychosis care, in preparation for future provision of mental health support.

The Dutch language short Anterior Cruciate Ligament—Return to Sport after Injury scale has good to excellent construct validity, internal consistency, and test-retest reliability when assessing athletes undergoing rehabilitation after ACL injury or ACL reconstruction

ObjectivesTo examine the validity and reliability of the Dutch language short Anterior Cruciate Ligament—Return to Sport after Injury scale (short ACL-RSI-NL) in recreational athletes undergoing rehabilitation after ACL injury or ACL reconstruction (ACLR). MethodsThe original 12-item version of the ACL-RSI had been translated into Dutch. Short ACL-RSI-NL items were derived from this 12-item Dutch version. Content validity was evaluated by a team consisting of eight ACL experts and eight athletes. A cohort of 115 athletes with ACL injury or after ACLR completed the short ACL-RSI-NL and related questionnaires at various time points during their rehabilitation. Construct validity (hypothesis testing using Spearman correlations), internal consistency (Cronbach's alpha), floor and ceiling effects (percentage of athletes having the lowest or highest score possible), and structural validity (exploratory factor analysis) were evaluated in the entire ACL athlete group. Test-retest reliability (using intra-class correlation, ICC; standard error of measurement, SEM; smallest detectable change, SDC, at both group and individual levels) was investigated in a subgroup of athletes with a stable outcome on psychological readiness within a two-week interval (n ​= ​27). ResultsThe short ACL-RSI-NL demonstrated good construct validity (83% of hypotheses confirmed). Internal consistency was excellent (Cronbach's alpha 0.84), and there were no floor and ceiling effects (≤13.9% lowest or highest score). Test-retest reliability was good (ICC 0.89 with 95% CI 0.77–0.95, SEM 6.93, SDC individual level 19.2, SDC group level 3.7). Exploratory factor analysis confirmed the presence of a single underlying factor (accounting for 56.4% of the total variance of the score). ConclusionThe short ACL-RSI-NL exhibited good to excellent construct validity, internal consistency, and test-retest reliability. An averaged score ranging from 0 to 100 can be used to measure psychological readiness to return to sport. The short ACL-RSI-NL has potential for use in day-to-day practice to assess the psychological readiness of recreational athletes to return to sport after ACL injury or ACLR during their rehabilitation process. Level of evidenceLevel II.

Assessment of laparoscopic intracorporeal intestinal anastomosis training using simulation-based 3D printed models: exploring surgical performance and learning curves.

Intestinal anastomosis is a clinical procedure widely used to reconstruct the digestive tract, but authentic laparoscopic intracorporeal intestinal anastomosis（LIIA） models are lacking. However, three-dimensional (3D) printing can enable authentic and reusable models. In this paper, a novel cost-effective 3D-printing training model of LIIA is designed and the authenticity and validity of the model are tested. An FDM 3D printing and assembled lab model were built to test LIIA. Fifteen surgeons were required to perform LIIA, and their operation score and time were recorded and analyzed. Five experts were invited to assess the face and content validity of the models. A study was also performed to further evaluate and validate the learning curve of surgeons. The difference in Modified anastomosis objective structured assessment of technical skills (MAOSATS) scores between the expert, intermediate and novice groups were significant (64.1±1.8: 48.5±1.7: 29.5±3.1, P < 0.001). In addition, the operation time of the procedure was statistically different for all three groups (21.5±1.9: 30.6±2.8:70.7±4.0, P < 0.001). The five experts rated the face and content validity of the model very highly, with the median being four out of five. Surgeons who underwent repeated training program showed improved surgical performance. After eight training, the novices' performance was similar to that of the average level of untrained intermediates, while the operation scores of the intermediates were close to that of the average level of experts. In this study, it is found that the LIIA model exhibits excellent face, content and construct validity, repeated simulation training of the LIIA training program improved the surgeon's operative performance, so the model is considered one of the effective methods for LIIA training and assessment of surgical quality in the future and for reducing healthcare costs.

The Psychometric Properties of the 9-Item Vestibular Activities Avoidance Instrument.

The purpose of this study was to establish the psychometric properties of the 9-Item Vestibular Activities Avoidance Instrument (VAAI-9), a patient-reported outcome measure developed to identify fear avoidance beliefs in persons with vestibular disorders. This prospective cohort study included 100 participants 18years and older seeking care at a balance disorders clinic for dizziness. Participants completed the VAAI-9, the Dizziness Handicap Inventory (DHI), and other patient-reported outcomes at the initial visit and the 3-month follow-up. To measure test-retest reliability, the VAAI-9 was completed again 5days after the initial visit and was analyzed using a 2-way mixed ICC for absolute agreement. Internal consistency was determined using the Cronbach alpha. The Spearman correlation coefficient was used to assess convergent validity of the VAAI-9 with other outcomes. Receiver operating characteristic curves were used to identify baseline VAAI-9 cutoff scores for those who reported mild (DHI ≤ 30) or moderate or severe (DHI > 30) perceived disability at the 3-month follow-up. The mean age of the study cohort was 49 (SD = 16) years; 73 (73%) were women. Seventy-one participants completed the 5-day follow-up, and 68 completed the 3-month follow-up. The VAAI-9 demonstrated excellent internal consistency (α = 0.91) and test-retest reliability (ICC = 0.90). Baseline VAAI-9 scores had moderate to strong associations with other outcome measures at baseline and 3months. A baseline VAAI-9 score of 26 or higher had a sensitivity of 80.6% and a specificity of 78.4% for identifying a DHI score of >30 at 3months (area under the curve = 0.86). The results provide evidence of excellent reliability and validity for the 9-item VAAI in persons with vestibular disorders. A baseline VAAI-9 score of ≥26 identified individuals at risk of persistent moderate to severe disability due to dizziness. Initial levels of fear avoidance beliefs measured using the VAAI-9 provided important prognostic information about outcomes for persons with vestibular symptoms.

Psychometric evaluation of the depression, anxiety, and stress scale-21 (DASS-21) among Chinese primary and middle school teachers

BackgroundTeachers in high-stress roles face increasing psychological distress such as anxiety and depression, underscoring the need for validated assessment instruments. Given the current absence of a comprehensive, designated, and time-efficient scale capable of evaluating depression, anxiety, and stress among the teacher population, the Depression, Anxiety, and Stress Scale-21 (DASS-21) presents itself as a promising alternative. Despite the widespread application of the DASS-21 for assessing psychological distress across various populations, its validity among teachers, along with questions about its factor structure and its potential property of time equivalence, remain unverified. This study endeavors to address these considerations by investigating the psychometric properties of the DASS-21 specifically within the population of Chinese primary and middle school teachers.MethodsCross-sectional (n = 9,030) and longitudinal surveys (n = 1,642) were conducted using a non-probability sampling method. In addition to the DASS-21, the Chinese version of Chinese Teachers’ Job Burnout Questionnaire (CTJBO) was utilized to evaluate the criterion validity of this scale. Three different approaches, namely confirmatory factor analysis, Rasch analysis, and network analysis, were employed to evaluate internal reliability, construct validity, as well as time invariance of the DASS-21.ResultsThe DASS-21 demonstrated a high degree of internal consistency (Cronbach’s α > 0.85) as well as excellent convergent validity, despite poor discriminant validity as determined by average variance extracted. Confirmatory factor analysis and network analysis further supported convergent validity. The three-factor structure outperformed one- and two-factor alternatives, establishing time invariance. Rasch analysis at the item level identified six inappropriate items within the anxiety and stress subscales, which were subsequently removed. Network analysis presented a better revised network. Regression analysis with emotional exhaustion as the criterion provided logical and accurate results.ConclusionThe DASS-21 was found to be a reliable and valid tool for measuring the mental health of teachers over time. To assess the instrument’s psychometric properties, a combination of confirmatory factor analysis, Rasch analysis, and network analysis was utilized, which proved effective and is recommended for evaluating contentious instruments. Based on the results of the study, researchers and healthcare professionals are recommended to use the DASS-21 for assessing teachers’ psychological distress. However, certain items identified in the study may need to be removed to enhance the instrument’s appropriateness for this specific population.

Development and Validation of an ICU Delirium Playbook for Provider Education.

Building on our previous ICU Delirium Video Series, our interdisciplinary team developed a corresponding quiz to form a digital "ICU Delirium Playbook." Playbook content validity was evaluated by delirium experts, and face validity by an ICU nurse focus group. Additionally, focus group participants completed the quiz before and after video viewing. Remaining focus group concerns were evaluated in semi-structured follow-up interviews. Online validation survey, virtual focus group, and virtual interviews. The validation group included six delirium experts in the fields of critical care, geriatrics, nursing, and ICU education. The face validation group included nine ICU nurses, three of whom participated in the semi-structured feedback interviews. None. The 44-question quiz had excellent content validity (average scale-level content validity index [S-CVI] of individual items = 0.99, universal agreement S-CVI = 0.93, agreement κ ≥ 0.75, and clarity p ≥ 0.8). The focus group participants completed the Playbook in an average (sd) time of 53 (14) minutes, demonstrating significant improvements in pre-post quiz scores (74% vs 86%; p = 0.0009). Verbal feedback highlighted the conciseness, utility, and relevance of the Playbook, with all participants agreeing to deploy the digital education module in their ICUs. The ICU Delirium Playbook is a novel, first-of-its-kind asynchronous digital education tool aimed to standardize delirium detection and prevention practices. After a rigorous content and face validation process, the Playbook is now available for widespread use.

Development of a menu of recovery goals to facilitate goal setting after critical illness

ObjectiveTo develop an expert-informed (including end users) recovery goal menu for adults recovering from critical illness applicable to the community/home setting. Research methodology/designStage 1 Item generation: iterative development of domains, sub-domains, and goals in consultation with former intensive care patients, family members and expert clinicians. Stage 2 Content validity assessment: cognitive interviews and the content validity index. SettingVirtual consultation meetings facilitated by the research team at King’s College London and Guy’s and St Thomas’ NHS Foundation Trust. Main outcome measuresContent validity as assessed by: the Item-Content Validity Index (I-CVI), Scale Level-Content Validity Index/Universal Agreement (S-CVI/UA) score, the Scale Level-Content Validity Index/Average (S-CVI/Ave) score and Average Content Validity Ratio (CVR). ResultsItem generation resulted in a goal menu comprising 4 domains, 22 sub-domains and 95 goals assigned as follows: Self-care: 9 sub-domains with 37 goals, Productivity: 7 sub-domains with 13 goals, Leisure: 3 sub-domains with 25 goals, and Person domain 3 sub-domains with 20 goals. Cognitive interviews resulted in addition of 79 goals and modification of 7, addition of 4 new sub-domains and modification of 4, thus resulting in 4 domains, 26 sub-domains with a total of 174 goals. Twenty-four sub-domains (169 goals) were deemed relevant with Item-Content Validity Index (I-CVI) scores ranging from 0.72 to 1. Two sub-domains (5 goals) did not meet the 0.7 cut-off and were removed. The Scale Level-Content Validity Index/Universal Agreement (S-CVI/UA) score was 0.46; the Scale Level-Content Validity Index/Average (S-CVI/Ave) 0.91. Average Content Validity Ratio (CVR) was 0.93. ConclusionAn expert informed recovery goal menu for former intensive care patients has been developed with excellent content validity. The final goal menu comprises 169 goals within 24 sub-domains grouped under 4 domains. Implications for Clinical PracticeThis menu will help patients to set goals and increase our understanding of how individuals recover from critical illness.