Interrater Reliability Intraclass Correlation Research Articles

Validity and reliability of the Endotracheal Suction Assessment Tool© in adult ICU patients: A methodological study

BackgroundNovice nurses often find endotracheal suctioning signs unfamiliar. The Endotracheal Suction Assessment Tool© (ESAT©) aids pediatric nurses in suctioning but lacks an adult equivalent. A valid and reliable ESAT© for assessing intensive care unit patients’ suction needs across different populations is necessary. AimTo test the validity and reliability of the ESAT© in adult ICU patients. MethodsThis methodological study assessed suction needs in patients at a tertiary adult ICU of a university hospital. Two independent observers used the ESAT© to determine suction needs. Data from 106 suction procedures were collected using a patient characteristics form, the ESAT©, and a suction monitoring form. The ESAT© includes eight respiratory and ventilation parameters and seven clinical consideration parameters. Hemodynamic and respiratory parameters were measured before, and one and five minutes after suction. Linguistic validity, content validity, and pilot testing were conducted. Interobserver agreement was evaluated, and psychometric evaluation was done using content validity index (CVI) and intraclass correlation coefficient (ICC). Data were analyzed with paired samples t-test and ANOVA. ResultsItem CVI ranged from 0.80 to 1.00, and scale CVI was 0.96. Inter-item correlation and ICC for inter-rater reliability were both 0.933 (95 % CI = 0.903–0.954, p < 0.001 for ICC). Cohen’s Kappa coefficients ranged from 0.690 to 1.000 (p < 0.001), indicating high consistency between raters for all tool items. All scale items showed near-perfect agreement except SpO2, which showed substantial agreement. ConclusionThe S-CVI was good, indicating near-perfect agreement among raters. ESAT© is highly reliable and valid for determining suction needs in adult intensive care patients. Implications for PracticeThe ESAT© aids autonomous decision-making for suctioning needs. Originally for novice pediatric nurses, the ESAT© was adapted for adult intensive care nurses. The ESAT© is valid and reliable for adult intensive care patients.

A novel radiographic finding for estimation of the cortical-cancellous boundary: A magnetic resonance imaging case series of patients with femoroacetabular impingement

PurposeTo determine if comparing alpha angle measurements of the outer cortical margin (preoperative alpha angle) and the inner cortical margin (theoretical postoperative alpha angle) on magnetic resonance imaging (MRI) can estimate the amount of sclerotic bone that needs to be resected to restore the alpha angle to normative values (<55⁰) in patients with symptomatic femoroacetabular impingement (FAI). MethodsA retrospective review was conducted on patients with FAI undergoing primary hip arthroscopy and CAM osteoplasty from June 2013 to February 2017. Inclusion criteria were radiologist-measured alpha angles >70° on 3T oblique axial MRI, unilateral primary hip arthroscopy, and age ≥18. Exclusions included previous hip surgery, hip trauma, avascular necrosis, advanced osteoarthritis, dysplasia, poor quality images, or missing MRI images. Alpha angles were measured preoperatively using the outer cortical margin and postoperatively using the inner cortical margin of femur. Surgeries were performed by the senior surgeon. Paired t-tests compared preoperative and postoperative alpha angles, and intraclass correlation coefficients (ICC) were used to assess inter-rater and intra-rater reliability. ResultsOne hundred patients (100 hips) were included with an average age of 40.8 years (range, 18.7–64.9), with 75 % being male (n = 75). The average BMI was 24.7 ± 3.9 (range, 17.1–38.8). The average maximum alpha angle at the outer cortical margin was 77.0 ± 4.2° (range, 70.0–90.8), with an ICC for inter-rater reliability of 0.861, indicating excellent agreement. The average inner cortical alpha angle was 46.4 ± 3.4° (range, 36.5–55.4), significantly less than 55° (p<0.001). The mean difference between the outer and inner cortical alpha angles was −30.6 ± 5.1° (p< 0.001). ConclusionsThe difference between outer and inner cortical alpha angles on MRI can accurately estimate the amount of sclerotic bone resection needed to restore the alpha angle to normative values in patients with FAI. This information may be directly applied clinically marker to assess adequacy of CAM resection.

Test-Retest and Inter-Rater Reliability for Selected Outcomes from a Wearable 3D Inertial Sensor Over Different Stable and Unstable Postural Conditions: A Validation Study

ABSTRACT The agreement between a wearable inertial sensor (GYKO, G) and the force platform (P) was assessed by evaluating test-retest and inter-rater reliability. Thirty-eight subjects were enrolled; the selected indices of balance were investigated over foot positions and (un)stable conditions. Intraclass correlation coefficient (ICC), standard error of measurement (SEM%) and minimal detectable change (MDC95%) were computed. For G, ICC bounds range from poor to excellent (0.040 ÷ 0.921), mean of 0.687 (= moderate reliability). Regarding P, ICC ranges from poor to excellent (0.070 ÷ 0.920), mean of 0.683 (= moderate reliability). For G, SEM% ranges from 11% to 47%; MDC95% from 30% to 132%. Concerning P, SEM% ranges from 7% to 41%; MDC95% from 21% to 114%. Finally, the inter-rater reliability ICC by comparing devices ranges from poor to excellent (−0.162 ÷ 0.911), mean of 0.338 (= poor reliability). GYKO appears to be a convenient tool with high consistency among multiple measurements but for specific clinic/research purposes.

Reliability of a Photo-Based Modified Foot Posture Index (MFPI) in Quantifying Severity of Foot Deformity in Children With Cerebral Palsy.

Children with cerebral palsy (CP) have high rates of foot deformity. Accurate assessment of foot morphology is crucial for therapeutic planning and outcome evaluation. This study aims to evaluate the reliability of a novel photo-based Modified Foot Posture Index (MFPI) in the evaluation of foot deformity in children with CP. Thirteen orthopaedic surgeons with neuromuscular clinical focus from 12 institutions evaluated standardized standing foot photographs of 20 children with CP, scoring foot morphology using the MFPI. Raters scored the standardized photographs based on five standard parameters. Two parameters assessed the hindfoot: curvature above and below the malleoli and calcaneal inversion/eversion. Three parameters assessed the midfoot and forefoot: talonavicular congruence, medial arch height, and forefoot abduction/adduction. Summary MFPI scores range from -10 to +10, where positive numbers connote planovalgus, whereas negative numbers connote a tendency toward cavovarus. Intra- and interrater reliability were calculated using a 2-way mixed model of the intraclass correlation coefficient (ICC) set to absolute agreement. Feet spanned the spectrum of potential pathology assessable by the MFPI, including no deformity, mild, moderate, and severe planovalgus or cavovarus deformities. All scored variables showed high intrarater reliability with ICCs from 0.891 to 1. ICCs for interrater reliability ranged from 0.965 to 0.984. Hindfoot total score had an ICC of 0.979, with a 95% CI, 0.968-0.988 (P<0.001). The forefoot total score had an ICC of 0.984 (95% CI, 0.976-0.991, P<0.001). Mean total score by the MFPI was 3.67 with an ICC of 0.982 (95% CI, 0.972-0.990, P<0.001). The photo-based MFPI demonstrates high intra- and interrater reliability in assessing foot deformities in children with CP. Its noninvasive nature and ease of use make it a promising tool for both clinical and research settings. MFPI should be considered as part of standard outcomes scores in studies regarding the treatment of CP-associated foot deformities. Level V.

Performance of bowel preparation quality scales in patients with Crohn's disease.

The performance of bowel preparation (BP) in patients with Crohn's disease (CD) is unknown. To evaluate the operating properties of instruments used to assess BP quality in patients with CD. We used the Boston Bowel Preparation Scale, modified Boston Bowel Preparation Scale, Harefield Cleansing Scale, Food and Drug Administration Bowel Cleansing Assessment Scale (BCAS), and a 100-mm visual analogue scale of bowel cleanliness to assess BP quality in 50 videos from 40 patients with CD. We assessed endoscopic activity with the Simple Endoscopic Score for CD (SES-CD). Assessments were on endoscope insertion and withdrawal. Reliability was quantified using the intraclass correlation coefficient (ICC). We assessed validity by within-patient correlation between instruments and the visual analogue scale using mixed-effect models. The correlation between BP quality and SES-SD scores was assessed using Spearman's rho. Inter- and intra-rater reliability for all BP quality instruments was substantial (ICC ≥0.61) except for the Food and Drug Administration BCAS on insertion (inter-rater reliability ICC ≥0.41). The visual analogue scale had substantial inter- and almost perfect (ICC ≥0.81) intra-rater reliability. Correlation coefficients for the validity of the instruments exceeded 0.58. BP quality and endoscopic disease activity scores in the colon were negatively correlated. Most existing instruments reliably assess BP quality in patients with CD. These results support the use of these instruments in clinical practice, provide a framework for scoring BP quality in CD clinical trials, and support evaluation of novel BP agents in patients with CD.

Reliability of the Moover® 3D Inertial Motion Sensor in Greek Patients With Chronic Neck Pain in a Primary Care Urban Setting.

Introduction Neck pain has a high lifetime prevalence and represents a significant health issue. Reduced active cervical range of motion (ACROM) has been found in neck pain patients. Inertial sensor technology can provide objective measurements to assess the impaired ACROM. Purpose Primarily, this study investigated the inter- and intra-rater reliability of the Moover® three-dimensional (3D) inertial motion sensor (Sensor Medica, Rome, Italy) in Greek patients with non-specific chronic neck pain. Secondly, the intra-rater reliability of the Neck Disability Index (NDI) was also assessed. Methods Fifty patients (18 males and 32 females) suffering from non-specific chronic neck pain participated in this study. Two physiotherapists measured separately each participant's ACROM in three planes, within a 48-hour period. The participants' position and the sequence and direction of the three cervical movements (cervical rotation, lateral flexion, and flexion-extension) were standardized. Results The inter-rater reliability intraclass correlation coefficient (ICC) values were good to excellent ranging from 0.77 to 0.95 for the first measurement and 0.85 to 0.95 for the second (p < 0.001). The intra-rater reliability ICC values were moderate to excellent ranging from 0.74 to 0.92 for the first rater and good to excellent ranging from 0.83 to 0.94 for the secondrater(p < 0.001). Intra-rater reliability of the overall NDI was indicated as good, and ICC was 0.80 (95%CI: 0.65-0.89; p < 0.001). ICC values for all sections were significant and ranged from 0.40 to 0.88. Conclusion This study showed the reliability of the Moover 3D inertial sensorfor ACROM measurementin Greek patients with chronic neck pain. The NDI scale also showed good intra-rater reliability in the same sample. Both intra- and inter-rater reliability of the Moover 3D were proven to be acceptable over a 48-hour period. The specific sensor might have a potential application in a clinical setting.

Evaluation of the Anatomical Cross-Sectional Area of Psoas Major Muscle Using an Ultrasound Imaging System Combined With an Inertial Measurement Unit: Improved Reliability in the US Using IMU-Based Positioning Techniques.

Introduction: Recently, ultrasound (US) imaging has been used to estimate the cross-sectional area of skeletal muscle, but the reliability is uncertain. To improve the reliability of the US, we investigated skeletal muscle thickness measurement using an inertial measurement unit (IMU) to determine the direction of US beam incidence based on posture angle information. In addition, we examined whether the anatomical cross-sectional area (ACSA) of muscle can be estimated from the muscle thickness measured using the US with the IMU. Methods: In Experiment 1, two examiners measured the right psoas major at the fourth lumbar vertebra level in 10 university students using the US with and without an IMU. The intraclass correlation coefficient (ICC) was used to examine intra- and inter-rater variability. In Experiment 2, the two examiners measured the muscle thickness of the right psoas major in 31 male subjects using the US with an IMU. In addition, the ACSA of this muscle was measured using MRI. Pearson's correlation coefficient was used to examine the relationship between muscle thickness and ACSA, and a single regression analysis was performed. Results: Both intrarater reliability ICC (1, 2) and inter-rater reliability ICC (2, 2) were higher when US was used with IMU compared to without IMU (Experiment 1). A significant positive correlation (r = 0.84, p < 0.01) was observed between muscle thickness and ACSA (Experiment 2). The regression equation was significant at R 2 = 0.71 (p < 0.01). Conclusion: Using an IMU during US measurement of the psoas major improves intra- and interexaminer reliability and can be used to estimate the ACSA of the muscle.

Reliability of confocal corneal microscopy for measurement of dendritic cell density in suspected small fiber neuropathy.

Dendritic cells (DCs) and their contacts with corneal nerves are described in animal models of nerve damage. Dendritic cell density (DCD) is a potential marker of immune activity in suspected small-fiber neuropathy (SFN). Here, we aim to evaluate the intra- and inter-rater reliability of DCD measurements in suspected SFN. This retrospective study collected DCD from confocal microscopy images from the corneal sub-basal epithelium of the eye from 48 patients (mean age 49.6 ± 12.1 y, 61% female). Two examiners, each blinded to the other's examinations and measurements, assessed DCD to evaluate inter-rater reliability. For intra-rater reliability, the first examiner performed a second measurement after 14 days. DCs were classified into two cell morphological subtypes: mature and immature. Test-retest reliability for total DCD showed excellent agreement, with an intraclass correlation coefficient of 0.96 and inter-rater reliability intraclass correlation coefficient of 0.77. The immature cell subtype showed excellent intra-rater reliability but lower inter-rater reliability. We found that DCD measurements in the corneal sub-basal epithelium are sufficiently reliable for consideration in clinical studies of patients with suspected SFN.

Reliability of the 44-question Home Fall Hazard Assessment Tool and demographic characteristics associated with home hazards among the Thai elderly

Background: The 44-question Thai Home Fall Hazard Assessment Tool (Thai-HFHAT) was developed to assist healthcare professionals in identifying the risk of falls among community-dwelling older adults from their home environment. However, the reliability of this tool has not been studied. This study aimed to examine the reliability of the 44-question Thai-HFHAT and determine the demographic characteristics associated with home hazards. Methods: A descriptive cross-sectional study design was used to evaluate inter-rater reliability. The participants in this study were 51 older people from various types of Thai houses: a one-story elevated house, a one-story non-elevated house, and a house with two or more floors, 51 caregivers of older patients, and 5 village health volunteers (VHV). A prospective design was used to evaluate test-retest reliability with older people at different times in their homes. All participants answered 44 Thai-HFHAT questions to determine inter-rater and test-retest reliabilities. The reliabilities were analyzed using an intra-class correlation coefficient (ICC). Demographic characteristics including sex, occupation, and education were used to identify the factors affecting home hazards, and linear regression was used to analyze. Results: The ICC of inter-rater reliability of the 44-question Thai-HFHAT was 0.74 (95% CI: 0.57-0.84) and the test-retest reliability was 0.80 (95% CI: 0.64-0.88) for the older adults, 0.80 (95% CI: 0.65-0.89) for the caregivers and 0.70 (95% CI: 0.477-0.83) for the VHV. In demographic variables, personal business career and education level (grades 1-3) had significant relations with the total number of home hazards in the 44-questions Thai-HFHAT. Conclusions: The 44-question Thai-HFHAT is suitable for home hazard assessment among older adults in Thailand. Further studies are needed to investigate changes in the house environment after using the 44-question Thai-HFHAT to determine which changes can reduce fall risk.

Reliability of the 44-question Home Fall Hazard Assessment Tool and demographic characteristics associated with home hazards among the Thai elderly.

Background: The 44-question Thai Home Fall Hazard Assessment Tool (Thai-HFHAT) was developed to assist healthcare professionals in identifying the risk of falls among community-dwelling older adults from their home environment. However, the reliability of this tool has not been studied. This study aimed to examine the reliability of the 44-question Thai-HFHAT and determine the demographic characteristics associated with home hazards. Methods: A descriptive cross-sectional study design was used to evaluate inter-rater reliability. The participants in this study were 51 older people from various types of Thai houses: a one-story elevated house, a one-story non-elevated house, and a house with two or more floors, 51 caregivers of older patients, and 5 village health volunteers (VHV). A prospective design was used to evaluate test-retest reliability with older people at different times in their homes. All participants answered 44 Thai-HFHAT questions to determine inter-rater and test-retest reliabilities. The reliabilities were analyzed using an intra-class correlation coefficient (ICC). Demographic characteristics including sex, occupation, and education were used to identify the factors affecting home hazards, and linear regression was used to analyze. Results: The ICC of inter-rater reliability of the 44-question Thai-HFHAT was 0.74 (95% CI: 0.57-0.84) and the test-retest reliability was 0.80 (95% CI: 0.64-0.88) for the older adults, 0.80 (95% CI: 0.65-0.89) for the caregivers and 0.70 (95% CI: 0.477-0.83) for the VHV. In demographic variables, personal business career and education level (grades 1-3) had significant relations with the total number of home hazards in the 44-questions Thai-HFHAT. Conclusions: The 44-question Thai-HFHAT is suitable for home hazard assessment among older adults in Thailand. Further studies are needed to investigate changes in the house environment after using the 44-question Thai-HFHAT to determine which changes can reduce fall risk.

Reliability of the 44-question Home Fall Hazard Assessment Tool and personal characteristics associated with home hazards among the Thai elderly

Background: The 44-question Thai Home Fall Hazard Assessment Tool (Thai-HFHAT) was developed to assist healthcare professionals in identifying the risk of falls among community-dwelling elderly from their home environment. However, the reliability of this tool has not been studied. This study aimed to examine the reliability of the 44-question Thai-HFHAT and determine the personal characteristics associated with home hazards. Methods: A descriptive cross-sectional study design was used to evaluate interrater reliability. The participants in this study were 51 elderly people from various types of Thai houses: a one-story elevated house, a one-story non-elevated house, and a house with two or more floors, 51 caregivers of elderly patients, and 5 village health volunteers (VHV). A prospective design was used to evaluate test-retest reliability with older people at different times in their homes. All participants answered 44 Thai-HFHAT questions to determine inter-rater and test-retest reliabilities. The reliabilities were analyzed using an intra-class correlation coefficient (ICC). Personal characteristics including sex, occupation, and education were used to identify the factors affecting home hazards, and linear regression was used to analyze. Results: The ICC of inter-rater reliability of the 44-question Thai-HFHAT was 0.74 (95% CI: 0.57-0.84) and the test-retest reliability was 0.80 (95% CI: 0.64-0.88) for the elderly, 0.80 (95% CI: 0.65-0.89) for the caregivers and 0.70 (95% CI: 0.477-0.83) for the VHV. Personal business career and education level grades 1-3 are less than 0.05, which showed these factors had a significant relationship with the 44-question Thai-HFHAT score as the dependent variable. Conclusions: The 44-question Thai-HFHAT is suitable for home hazard assessment among the elderly in Thailand. Further studies are needed to investigate changes in the house environment after using the 44-question Thai-HFHAT to determine which changes can reduce fall risk.

Reliability of the 44-question Home Fall Hazard Assessment Tool and personal characteristics associated with home hazards among the Thai elderly

Background: The 44-question Thai Home Fall Hazard Assessment Tool (Thai-HFHAT) was developed to assist healthcare professionals in identifying the risk of falls among community-dwelling elderly from their home environment. However, the reliability of this tool has not been studied. This study aimed to examine reliability of the 44-question Thai-HFHAT and determine the person characteristics associated with home hazards. Methods: A descriptive cross-sectional study design was used for this research. The participants in this study were 51 elderly people from various types of Thai houses: a one-story elevated house, a one-story non-elevated house, and a house with two or more floors, 51 caregivers of elderly patients and 5 village health volunteers (VHV). All participants answered 44 Thai-HFHAT questions to determine inter-rater and test-retest reliabilities. The reliabilities were analyzed using an intra-class correlation coefficient (ICC). Personal characteristics including sex, occupation, and education were used to identify the factors affecting home hazard and linear regression was used to analyze. Results: The ICC of inter-rater reliability of the 44-question Thai-HFHAT was 0.74 (95% CI: 0.57-0.84) and the test-retest reliability was 0.80 (95% CI: 0.64-0.88) for the elderly, 0.80 (95% CI: 0.65-0.89) for the caregivers and 0.70 (95% CI: 0.477-0.83) for the VHV. Personal business career and education level grade 1-3 are less than 0.05, which showed these factors had a significant relationship with the 44-question Thai-HFHAT score as dependent variable. Conclusions: The 44-question Thai-HFHAT is suitable for the home hazards assessment among the elderly in Thailand. Further studies are needed to investigate changes in the house environment after using the 44-question Thai-HFHAT to determine which changes can reduce the risk of fall.

Registration of Bony Landmarks and Soft Tissue Laxity during Robotic Total Knee Arthroplasty is Highly Reproducible.

There is growing interest and enthusiasm for robotic total knee arthroplasty (TKA). Many robotic systems require registration of bony landmarks as well as a dynamic soft tissue evaluation to plan femoral and tibial resections. Variability in this user-driven registration can introduce error and undermine the purported precision and accuracy offered by robotics. The purpose of this study was to evaluate inter- and intrarater reliability in robotic registration with a new robotic system (ROSA®; Zimmer-Biomet, Warsaw, IN). Two unpaired cadaveric knee specimens were exposed, and optical arrays were placed into the femur and tibia. Three separate evaluators conducted repeated trials of anatomic registration and assessment of soft tissue laxity, as well as coronal alignment, sagittal alignment, femoral size, and maximum opening in the medial and lateral compartments in both flexion and extension. Repeated trials were conducted using these specimens with and without preoperative imaging for landmarking (image-based and image-free workflows). An Intraclass Correlation Coefficient (ICC) was calculated for each observer and across observers to determine intra-and interrater reliability, respectively, in robotic registration. There was good to excellent reliability for all conditions, and all correlation coefficients were >0.767. On average, ICCs for intrarater reliability were excellent for Doctor 1 (0.952), Doctor 2 (0.975), and Doctor 3 (0.925). On average, the ICCs for interrater reliability were excellent for both the "Registration + Gap Assessment" condition (0.961) and the "Gap Assessment" condition (0.994). Our results show a high repeatability of registration of anatomic landmarks and gap assessment among observers using this robotic system for both image-based and image-free software.

Development of the Auburn Induction Scale for evaluating induction quality in dogs

ObjectiveTo develop and begin establishing evidence for validity of an instrument to assess the quality of induction in dogs. Study designCross-sectional survey and video scoring. Animals and populationA total of 51 veterinary anesthesia personnel, four board-certified anesthesiologists and videos of induction of anesthesia in 18 dogs. MethodsIn Part 1, an online survey was sent to veterinary anesthesia personnel to solicit expressions and words that they associate with induction of anesthesia. These expressions were evaluated by four anesthesiologists to create a composite scale (Auburn Induction Scale). In Part 2, 18 videos were reviewed by the same four anesthesiologists on two separate occasions. The videos were scored using the Auburn Induction Scale, a simple descriptive scale (SDS) and a visual analog scale (VAS). Intra-rater and inter-rater reliability was measured using an intraclass correlation coefficient (ICC). Significance was set at p < 0.05. ResultsThe survey yielded 51 responses that were condensed into 133 expressions. The four anesthesiologists created 18 items incorporating the 133 expressions. The mean ± standard deviation intra-rater reliability ICC was 0.81 ± 0.08 for the Auburn Induction Scale, 0.71 ± 0.02 for the SDS and 0.71 ± 0.08 for the VAS for all raters. The mean ± standard deviation inter-rater reliability ICC was 0.69 ± 0.04 for the Auburn Induction Scale, 0.61 ± 0.05 for the SDS and 0.60 ± 0.06 for the VAS. Conclusions and clinical relevanceIn a research setting, widespread use of this scale may be helpful in increasing the accuracy of data and improving agreement between studies assessing induction of anesthesia in dogs. The results of this study have yielded a composite scale that is more reliable between and among raters than a unidimensional scale.

The Polish Version of the Alberta Infant Motor Scale: Cultural Adaptation and Validation.

The Alberta Infant Motor Scale (AIMS) is a diagnostic tool for the assessment of the motor performance of infants from the time of birth, to the period of independent walking (0–18 months). This study aims to derive a Polish version of the AIMS through its cultural adaptation and validation. The study included 145 infants aged 0–18 months, who were divided into four further age groups: 0–3 months, 4–7 months, 8–11 months, and older than 12 months. The validation was based on an analysis of intrarater and interrater reliability values, as well as concurrent validity, using the gross motor scale of Peabody Developmental Motor Scales-2 (PDMS-2). The total Intraclass Correlation Coefficient (ICC) for intrarater reliability was 0.99 (ICC range in positions was 0.87–0.99, in subgroups was 0.91–0.99), while in particular positions, the ICC ranges were as follows: prone 0.97–0.99, supine 0.94–0.99, sitting 0.95–0.99, and standing: 0.63–0.99. The total ICC for interrater reliability was 0.99 (ICC range in positions was 0.98–0.99, in subgroups was 0.91–0.99), while in particular positions, the ICC ranges were as follows: prone 0.95–0.99, supine 0.93–0.96, sitting 0.93–0.98, standing 0.91–0.98. Only the standing position was analyzed for the subgroup of participants over 12 months old. The Spearman correlation between the Polish version of the AIMS and the gross motor scale of PDMS-2 was significant in the total population (r = 0.97, p < 0.0001) and in subgroups (r = 0.79–0.85, p < 0.0001). The results of our study confirm that the Polish version of the AIMS is reliable for infants aged 0–18 months and can be applied to this population for clinical and scientific purposes.Trial RegistryClinicalTrials.gov ID NCT05264064, URL https://clinicaltrials.gov/ ct2/show/NCT05264064.

Application of objective structured clinical examination (OSCE) for the evaluation of Kampo medicine training

BackgroundThe purpose of this study was to develop an objective, content-valid, and reliable assessment method for Kampo medicine using an objective structured clinical examination (OSCE) for the assessment of clinical competence in Kampo medicine.MethodsWe developed a blueprint followed by a list of 47 assessment items and three task scenarios related to clinical competence in Kampo medicine. An eight-member test committee checked the relevance of the assessment items on a Likert scale. We calculated a content validity index and content validity ratio, and used the Angoff method to set the passing threshold. We trained a total of nine simulated patients with three assigned to each scenario. We conducted an OSCE for 11 candidates with varying medical abilities, and conducted three stations per person, which were evaluated by one evaluator in one room by direct observation. We used video recordings to test the inter-rater reliability of the three raters. We used the test results to verify the reliability of the assessment chart.ResultsThe inter-rater reliability (intraclass correlation coefficient [2,1]) was 0.973. The reliability of the assessment chart for each scenario (Cronbach’s α) was 0.86, 0.89, and 0.85 for Scenarios 1, 2, and 3, respectively. The reliability of the assessment chart for the whole OSCE (Cronbach’s α) was 0.90.ConclusionsWe developed a content-valid new OSCE assessment method for Kampo medicine and obtained high inter-rater and test reliabilities. Our findings suggest that this is one of the most reliable evaluation methods for assessing clinical competence in Kampo medicine.

Validity and Reliability of Quick Motor Function Test in Ambulatory Duchenne Muscular Dystrophy Patients

AbstractThe quick motor function test (QMFT) is used to evaluate Pompe patients' motor function. This study aims to evaluate the convergent validity and reliability of the cross-culturally adapted Turkish version of QMFT in patients with Duchenne muscular dystrophy (DMD). Twenty-eight patients diagnosed with DMD were included in the study. The QMFT was translated and adapted to Turkish. The functionality of the patients was assessed with the north star ambulatory assessment (NSAA) and the 6-minute walk test (6MWT); muscle strength was evaluated with a hand-held dynamometer. There were two separate practitioners on the first day of the QMFT study; it was applied a second time by the first practitioner 14 days later. The mean age of DMD patients was 9.03 ± 3.39 (minimum 4–maximum 18 . Twenty-seven patients concluded all the necessary assessments. Intrarater reliability of QMFT in patients with DMD was intraclass correlation coefficient (ICC) = 0.98, and interrater reliability ICC = 0.98 was excellent. QMFT correlated very well with 6MWT (r s = 0.86; p &lt; 0.001) and NSAA (r s = 0.91; p &lt; 0.001). Both the QMFT and NSAA show stronger correlations with proximal muscle groups (convergent validity) than with distal muscle groups (divergent validity). QMFT is a reliable and valid test for evaluating motor function in patients with DMD.

Aliased Flow Signal Planimetry by Cardiovascular Magnetic Resonance Imaging for Grading Aortic Stenosis Severity: A Prospective Pilot Study.

Objectives: Transthoracic echocardiography (TTE) is the standard technique for assessing aortic stenosis (AS), with effective orifice area (EOA) recommended for grading severity. EOA is operator-dependent, influenced by a number of pitfalls and requires multiple measurements introducing independent and random sources of error. We tested the diagnostic accuracy and precision of aliased orifice area planimetry (AOAcmr), a new, simple, non-invasive technique for grading of AS severity by low-VENC phase-contrast cardiovascular magnetic resonance (CMR) imaging.Methods: Twenty-two consecutive patients with mild, moderate, or severe AS and six age- and sex-matched healthy controls had TTE and CMR examinations on the same day. We performed analysis of agreement and correlation among (i) AOAcmr; (ii) geometric orifice area (GOAcmr) by direct CMR planimetry; (iii) EOAecho by TTE-continuity equation; and (iv) the “gold standard” multimodality EOA (EOAhybrid) obtained by substituting CMR LVOT area into Doppler continuity equation.Results: There was excellent pairwise positive linear correlation among AOAcmr, EOAhybrid, GOAcmr, and EOAecho (p < 0.001); AOAcmr had the highest correlation with EOAhybrid (R2 = 0.985, p < 0.001). There was good agreement between methods, with the lowest bias (0.019) for the comparison between AOAcmr and EOAhybrid. AOAcmr yielded excellent intra- and inter-rater reliability (intraclass correlation coefficient: 0.997 and 0.998, respectively).Conclusions: Aliased orifice area planimetry by 2D phase contrast imaging is a simple, reproducible, accurate “one-stop shop” CMR method for grading AS, potentially useful when echocardiographic severity assessment is inconclusive or discordant. Larger studies are warranted to confirm and validate these promising preliminary results.

Inter-rater and test-retest reliability of computerized clinical vestibular tools.

Clinical vestibular technology is rapidly evolving to improve objective assessments of vestibular function. Understanding the reliability and expected score ranges of emerging clinical vestibular tools is important to gauge how these tools should be used as clinical endpoints. The objective of this study was to evaluate inter-rater and test-retest reliability intraclass correlation coefficients (ICCs) of four vestibular tools and to determine expected ranges of scores through smallest real difference (SRD) measures. Sixty healthy graduate students completed two 1-hour sessions, at most a week apart, consisting of two video head-impulse tests (vHIT), computerized dynamic visual acuity (cDVA) tests, and a smartphone-assisted bucket test (SA-SVV). Thirty students were tested by different testers at each session (inter-rater) and 30 by the same tester (test-retest). ICCs and SRDs were calculated for both conditions. Most measures fell within the moderate ICC range (0.50-0.75). ICCs were higher for cDVA in the inter-rater subgroup and higher for vHITs in the test-retest subgroup. Measures from the four tools evaluated were moderately reliable. There may be a tester effect on reliabilities, specifically vHITs. Further research should repeat these analyses in a patient population and explore methodological differences between vHIT systems.

Reliability and validity of the Japanese version of the overall dry skin score in older patients.

Dry skin is the most common skin problem, especially in the elderly. However, there is no effective instrument to assess dry skin in Japan. This study aimed to evaluate the reliability and validity of the Japanese version of the overall dry skin score (ODS-J), the gold standard for dry skin assessment. A cross-sectional study was conducted on 47 patients aged>65 years. Images of skin on their limbs were captured using a digital camera; both upper and lower limbs were assessed (n=4/patient). One dermatologist; two wound, ostomy, and continence nurses; and three nursing researchers independently evaluated the images using the ODS-J to assess the intraclass correlation coefficient (ICC) for inter-rater reliability. Stratum corneum hydration (SCH) and transepidermal water loss (TEWL) were the external criteria used to verify concurrent and known-groups validity. In total, 182 sites at which the SCH and TEWL could be measured were evaluated for the ODS-J. The ICC for inter-rater reliability of the six raters was 0.939 (p<0.001). A higher ODS-J was associated with lower SCH (ρ=-0.374; p<0.001) and lower TEWL (ρ=-0.287; p<0.001) values. The ODS-J for the lower legs was significantly higher than that of the forearms (p<0.001). The ODS-J showed good inter-rater reliability, concurrent validity, and known-groups validity. It can be used by clinical nurses in Japan to observe patients' skin and is an effective indicator for the evaluation of skin care.