Intra-rater Agreement Research Articles

Intrarater and Interrater Reliability and Agreement of a Method to Quantify Lower-Extremity Kinematics Using Remote Data Collection.

To assess the reliability of a remote 2D markerless motion tracking method (Kinovea) to quantify knee and hip angles during dynamic tasks. Fourteen healthy adults performed body weight squats and lateral lunges while video recording themselves at home. Knee and hip angles were quantified in the sagittal plane for the squats and in the frontal plane for the lateral lunges. Two students each performed the video analysis procedure twice, 2 weeks apart. Intraclass correlation coefficients were used to calculate the intrarater and interrater reliability for angles at maximum depth. The intrarater and interrater agreement over the joint angle-time signals were quantified using a validation metric; an acceptable agreement threshold was set at a validation metric of 0.803 or higher. Standard error of measurement (SEM) was also calculated. Reliability was good to excellent (intraclass correlation coefficients = .80-.98) for all angle comparisons at maximum depth. The agreement over the entire joint angle-time signal was acceptable for all squat variables except for the interrater hip angle comparison (validation metric = 0.797). None of the lateral lunge variables met the threshold of acceptable agreement. The mean SEM across participants for all joint angle-time signal and for maximum depth was acceptable (<5°) for all measurements (SEM = 1.2°-4.9°). Overall, the reliability, agreement, and SEM quantified in this study support the integration of remote methods to quantify lower-extremity kinematics into research and clinical practice.

Performance evaluation of human cough annotators: optimal metrics and sex differences

IntroductionDespite its high prevalence and significance, there is still no widely available method to quantify cough. In order to demonstrate agreement with the current gold standard of human annotation, emerging...

Post-parotidectomy facial nerve function: comparison between original and modified Sunnybrook Facial Grading Systems.

Facial nerve dysfunction is the principal postoperative complication related to parotidectomy. To test the hypothesis that the modified Sunnybrook Facial Grading System (mS-FGS) is superior to the original S-FGS in the assessment of facial nerve function following parotidectomy. Prospective, longitudinal study evaluating patients with primary or metastatic parotid neoplasms undergoing parotidectomy with facial nerve-sparing between 2016 and 2020. The subjects were assessed twice, on the first postoperative day and at the first outpatient evaluation, 20-30 days post-surgery. Facial assessments were performed using the original and modified (plus showing the lower teeth) versions of the Sunnybrook System and documented by pictures and video recordings. Intra- and inter-rater agreements regarding the assessment of the new expression were analyzed. 101 patients were enrolled. In both steps, the results from the mS-FGS were significantly lower (p < 0.001). Subjects with a history of previous parotidectomy and those who underwent neck dissection had more severe facial nerve impairment. The mandibular marginal branch was the most frequently injured, affecting 68.3% of the patients on the first postoperative day and 52.5% on the first outpatient evaluation. Twenty patients (19.8%) presented an exclusive marginal mandibular branch lesion. The inter-rater agreement of the new expression assessment ranged from substantial to almost perfect. The intra-rater agreement was almost perfect (wk = 0.951). The adoption of the Modified Sunnybrook System, which includes evaluation of the mandibular marginal branch, increases the accuracy of post-parotidectomy facial nerve dysfunction appraisal.

Reliability of the global cortical atrophy visual rating scale applied to computed tomography versus magnetic resonance imaging scans in acute stroke

IntroductionResearch using magnetic resonance imaging (MRI) suggests regional cerebral atrophy measures (e.g., frontal lobe, temporal lobe) may predict post-stroke outcomes. Clinical CT scans have excellent potential for use in research but it is unclear whether regional atrophy measures from CT are reliable compared to MRI reference standards.MethodsWe used the Global Cortical Atrophy (GCA) scale to investigate reliability of atrophy measures on CT versus MRI scans from stroke patients originally recruited to the Oxford Cognitive Screening programme. Two raters provided standardised visual ratings at two timepoints. Weighted Kappa statistics assessed the reliability of regional atrophy scores. Spearman’s correlation and a two-way repeated measures ANOVA assessed the reliability of the total score.ResultsOn clinically acquired neuroimaging from 98 stroke patients (mean/SD age = 70.97/11.99, 42 female, 84 ischaemic stroke), regional GCA scores on CT versus MRI showed fair to almost perfect intra-rater agreement (κ = .50–.87), substantial to almost perfect intra-rater agreement on CT (κ = .67–.88), and moderate to almost perfect intra-rater reliability on MRI (κ = .50–.89). Regional GCA scores showed mostly moderate to substantial inter-rater reliability on both CT and MRI (κ = .43–.69), except the temporal horns and parieto-occipital region. There was a strong correlation between total GCA scores on CT and MRI (r (96) = .87–.88, p < .001).ConclusionsThese results support the use of cerebral atrophy measures from CT in clinical research, as visual ratings showed generally good agreement between CT and MRI, between raters, and between timepoints.

Intra- and inter-rater reliability of a manual codification system for footwear impressions: first lessons learned from the development of a footwear database for forensic intelligence purposes

To generate forensic intelligence from footwear impressions and link crime scenes, most law enforcement agencies and forensic laboratories rely on a manual codification system based on pattern recognition and classification by human analysts. However, although they are commonly used in practice, to date we still know little about the reliability of such systems. Taking advantage of the development of a footwear database for forensic intelligence purposes at the Laboratoire de sciences judiciaires et de médecine légale in Quebec (Canada), this study aims to make a preliminary assessment of the intra- and inter-rater reliability (i.e., the level of repeatability over time and the level of consensus between analysts) of the proposed codification system. To do so, three forensic intelligence analysts classified a set of 27 crime scene impressions and test impressions at two different times (two weeks apart). Percent agreement, Cohen’s Kappa, and Light’s Kappa were then calculated. Results show that two out of three analysts have reached an almost perfect level of intra-rater agreement, while the other have achieved a substantial level of intra-agreement, and that all analysts have reached a substantial level of inter-rater agreement. Findings suggest that, although a few patterns may have lower levels of agreement, overall, the developed codification system presents a satisfactory level of reliability. This preliminary study thus suggests that contrary to what advocates of fully automated systems may sometimes imply, manual codification of footwear impressions may be fairly appropriate for intelligence purposes. It calls for further evaluative research in the field.

Perceptual Evaluation of the Tracheoesophageal Voice: Italian Validation of the Sunderland Tracheoesophageal Perceptual Scale

This study aimed to validate the Sunderland Tracheoesophageal Perceptual Scale (SToPS) in the Italian language by checking the inter- and intra-rater reliability. Scale validation METHODS: The validation of the tool involved the following steps: (1) translation and adaptation of the SToPS into Italian language; (2) recruitment of participants (60 laryngectomized patients with a voice prosthesis and 12 health professionals-six speech and language therapists (SLTs) and six ear, nose, and throat surgeons-classified into experienced (Exp) or not at assessing voice; (3) recording of patients' speech samples; (4) perceptual evaluation of recorded speech samples (test and retest) performed by the 12 health professionals; and (5) statistical analysis (quadratic weighted Cohen kappa and weighted kappa of Light coefficients). When all raters were considered as one group, an agreement ≥0.50 was reached for all parameters. The "ExpSLTs" group rated more reliably than the other groups, achieving a "good" intrarater agreement for 9/10 parameters. Despite the interrater coefficients were lower than the intrarater ones for all rater groups, "ExpSLTs" obtained the best levels of interrater agreement, achieving a level of agreement ≥0.50 for all parameters. Finally, considering intrarater+interrater agreement ("good+good" or "good+moderate"), the "ExpSLTs" group showed the greatest agreement, attaining all parameters that met the criteria for "good" or "moderate" agreement levels. The Italian version of SToPS can be considered a reliable tool. As in the original version, expert SLTs are the better judges for tracheoesophageal voice assessment.

P109 Paediatric Limited Channel Sleep Monitoring Alternate Sleep Scoring Compared with Type 1 PSG

Abstract Introduction Obstructive sleep apnoea (OSA) has deleterious effects on children’s cognition, behaviour and cardiovascular system. Early diagnosis and treatment may improve long-term outcomes. Attended polysomnography (PSG) is the gold standard for OSA diagnosis, however access is limited with prolonged wait times. Home based limited channel sleep monitoring (LCSM) offers a more accessible alternative but may result in inaccurate sleep staging. We aimed to evaluate sleep scoring using a single channel combined EEG/EOG compared with full PSG. Methods Sample size calculations indicated 1000 epochs would be sufficient to demonstrate a kappa statistic of at least 0.7 for sleep stage comparison. Four patients undergoing in-laboratory PSG for suspected OSA gave consent for placement of an additional combined EEG/EOG simulating our LCSM montage. A single senior scientist scored sleep using full PSG montage, and after a minimum of 2 weeks, using the abbreviated montage. Results Epoch-by-epoch comparisons were made for 3,930 epochs. When comparing awake, N1, N2, N3 and REM, kappa=0.77 (p&amp;lt;0.001). Using the abbreviated montage, N1 was mostly misclassified as awake (28% of epochs) or REM (32% of epochs). When comparing awake, NREM and REM, kappa = 0.79 (p&amp;lt;0.001). When comparing awake and sleep, kappa = 0.82 (p&amp;lt;0.001). Discussion Accurate total sleep time is important for accurate respiratory index calculation. The abbreviated montage was reliable compared with PSG for scoring sleep versus awake (kappa &amp;gt;0.8). The addition of an EMG signal may correct misclassification of N1 as wake or REM and improve intra-rater agreement. EMG will be included in future studies.

"Soap bubble" sign as an imaging marker for posterior fossa ependymoma Group B.

To investigate the predictive value of the "soap bubble" sign on molecular subtypes (Group A [PFA] and Group B [PFB]) of posterior fossa ependymomas (PF-EPNs). MRI scans of 227 PF-EPNs (internal retrospective discovery set) were evaluated by two independent neuroradiologists to assess the "soap bubble" sign, which was defined as clusters of cysts of various sizes that look like "soap bubbles" on T2-weighted images. Two independent cohorts (external validation set [n = 31] and prospective validation set [n = 27]) were collected to validate the "soap bubble" sign. Across three datasets, the "soap bubble" sign was observed in 21 PFB cases (7.4% [21/285] of PF-EPNs and 12.9% [21/163] of PFB); none in PFA. Analysis of the internal retrospective discovery set demonstrated substantial interrater agreement (1st Rating: κ = 0.71 [0.53-0.90], 2nd Rating: κ = 0.83 [0.68-0.98]) and intrarater agreement (Rater 1: κ = 0.73 [0.55-0.91], Rater 2: κ = 0.74 [0.55-0.92]) for the "soap bubble" sign; all 13 cases positive for the "soap bubble" sign were PFB (p = 0.002; positive predictive value [PPV] = 100%, negative predictive value [NPV] = 44%, sensitivity = 10%, specificity = 100%). The findings from the external validation set and the prospective validation set were similar, all cases positive for the "soap bubble" sign were PFB (p < 0.001; PPV = 100%). The "soap bubble" sign represents a highly specific imaging marker for the PFB molecular subtype of PF-EPNs.

Relation of lumbar intervertebral disc height and severity of disc degeneration based on Pfirrmann scores

BackgroundDisc height (DH) change is considered one of the most critical factors in assessing intervertebral disc degeneration (IVD). Pfirrmann et al. developed a scoring system for disc degeneration evaluation based on changes in DH in magnetic resonance imaging (MRI). While the relationship between DH measurements and Pfirrmann scores for disc degeneration has been explored, the validity of different DH measuring techniques or their connection with disc degeneration is yet uncertain. The present study investigates intra-rater and inter-rater agreement and reliability of different DH measurement methods on MRI and evaluates the relationship between different DH measurement methods and Pfirrmann scores of IVD degeneration, as well as between different Pfirrmann scores and clinical outcomes. MethodsAdult patients with MRI scans of the lumbar spine were recruited. Eight DH measuring techniques were tested for intra-rater and inter-rater agreement and reliability. Bland and Altman's Limits of Agreement (LOA) was used to evaluate intra-rater and inter-rater agreements. Intra-rater and inter-rater reliability were evaluated using intra-class correlations (ICC) with 95 % confidence intervals (95 % CI). The association between DH and Pfirrmann scores was examined using one-way ANOVA. ResultsExcellent intra-rater reliability was reported for 332 participants on DH (ranging from 0.912 (0.901, 0.923) to 0.973 (0.964, 0.981) and from 0.902 (0.892, 0.915) to 0.975 (0.962, 0.985) by two independent raters). All measuring methods had high intra-rater agreement, except for methods 4 and 5. All methods had good-to-excellent of inter-rater reliability on DH (ICCs ranging from 0.812 (0.795, 0.828) to 0.995 (0.994, 0.995)) except for the posterior disc material length of method 5 (ICC 0.740 (0.718, 0.761)). Methods 1 to 6 for evaluating DH in patients with spondylolisthesis had poor inter-rater reliability. The IVD levels with grades IV and V in Pfirrmann scores had significantly lower DH than the IVD levels with grades I to III in Pfirrmann scores. IVD levels with grades IV and V in Pfirrmann scores had significantly higher VAS and ODI than IVD levels with grades I in Pfirrmann scores. ConclusionA good-to-excellent intra-rater and inter-rater reliability was achieved on most DH measuring methods on MRI following a standardized and structured protocol. However, small anatomical structures and different tissue borders could influence measurements. Additionally, DH can differentiate between grade IV and V Pfirrmann scores, and severe IVD degeneration (IV and V Pfirrmann) is linked to clinical outcomes.

Reliability and Measurement Error of the Qualitative Analysis of Single Leg Loading (QASLS) Tool For Unilateral Tasks.

Movement quality assessment is popular within clinical and sporting practice, due to the contribution diminished or suboptimal movement quality is believed to have on musculoskeletal (MSK) injury risk. Various movement quality assessments exist, many are limited to bilateral or jumping movements evaluation. Qualitative analysis of single leg loading (QASLS) is a new clinical assessment tool for unilateral tasks that utilizes a dichotomous scoring system of ten questions relating to the segmental body regions of the trunk, lower and upper limb. To determine the intra and inter-rater, within- and between-session reliability of the QASLS tool during two unilateral movement tasks, and provide insight to measurement error and smallest detectable difference (SDD). Reliability Study. Fifteen healthy females (mean age 19 years SD2; height 167 cm, +/- 6; weight 56 kg, +/- 6) completed two unilateral tasks, single leg squat (SLS) and single leg landing (SLL), within session data collection occurred on the same day, with between session data collection occurring seven days later. Tasks were scored with the QASLS tool via video playback. Intra-Class correlation coefficients (ICCk,3) were used to measure within and between session reliability, and Kappa coefficients and percentage of exact agreement (PEA%) were used to determine intra and inter-rater reliability. Standard error of measurement (SEM) and the SDD for the compound score of each limb was calculated. Within session reliability of QASLS scores was good (ICC = 0.82-0.86) for SLS and moderate (ICC = 0.67-0.87) for SLL. Between session reliability was moderate (ICC = 0.69-0.87) for SLS and excellent (ICC = 0.92-0.93) for SLL. SEM was less than 1 point, and SDD for compound score ranging from 1.0-2.5 points. Intra-rater agreement of compound QASLS score was near perfect (k = 0.85-100; PEA% 90-100%) and agreement of individual components was substantial- near perfect (k = 0.13-0.74; PEA% 78-100%). Inter-rater agreement for compound QASLS scores ranged from non-substantial (k = 0.13-0.74; PEA% 43.3-90%) for SLS and non-slight (k =0.03-0.17; PEA% 43.3-60%) for SLL. The QASLS movement analysis tool can be used to analyze movement quality during two unilateral loading tasks with moderate to excellent within and between session reliability. PEA% was acceptable for inter-rater agreement, however rater education training is recommended to develop more acceptable levels of reliability. 3.

Novel Validated Five-point Photonumeric Scales for Assessment of Static and Dynamic Forehead Lines.

The objective of this investigation was to create and validate five-point photonumeric scales which assess static and dynamic forehead lines. Two different novel five-point photonumeric scales for the assessment of static and dynamic forehead lines were developed. Moreover, a photoguide was created, including subjects from both sexes, all age groups, and different Fitzpatrick skin types. A total of 11 raters from all over the world were involved in the digital validation, whereas four raters performed a live validation. The Croma Static Forehead Lines-Assessment Scale showed almost perfect inter and intra-rater agreement in both the digital and the live setting with inter-rater intraclass correlation coefficients of 0.86 [95% confidence interval (CI): 0.82-0.89] in the first digital rating and 0.82 [95% CI: 0.78-0.86] in the second digital rating. The Croma Dynamic Forehead Lines-Assessment Scale showed almost perfect inter and intra-rater agreement in the digital setting with inter-rater intraclass correlation coefficients of 0.83 [95% CI: 0.79-0.86] in the first digital rating and 0.80 [95% CI: 0.75-0.84] in the second rating and almost substantial agreement in the live setting. The Croma Static Forehead Lines-Assessment Scale and the Croma Dynamic Forehead Lines-Assessment Scale have excellent inter and intra-rater agreements to be justifiably used in the clinical and study setting, both digitally and live across ethnic groups.

Application of Deep Learning Algorithm in the Grading Assessment of Corneal Fluorescein Staining

To explore the application value of applying deep learning (DL) algorithm in the grading assessment of corneal fluorescein staining. A cross-sectional study was carried out, covering 600 corneal fluorescein staining photos acquired in the Contact Lens Clinic, West China Hospital, Sichuan University between 2020 and 2022. Out of the 600 photos, 500 were used to construct the algorithm and the remaining 100 were used for the validation of the algorithm and a comparative analysis of the difference in grading accuracy (ACC) and the length of diagnostic time between artificial intelligence (AI) and optometry students. One month after finishing the first grading analysis, assessment by AI and optometry students was conducted for a second time and results from the two rounds of assessment were compared to examine the intrarater agreement ( kappa value) of the two analyses. The grading analysis results of 3 experienced optometrists were used as the gold standard in the study. Findings of the cross validation with the complete dataset, the training dataset, and the test dataset showed that ResNet34 had the highest predictive accuracy among four DL models. ResNet34 DL model achieved an accuracy of 93.0%, sensitivity of 89.5%, and specificity of 89.6% in the grading of corneal staining. In the comparison of the grading accuracy of AI and two optometry students, AI showed better accuracy, with the respective grading accuracy being 87.0%, 78.0%, and 52.0% for AI, student 1, and student 2 ( P ACC=0.001). In addition, the average diagnostic time of AI was shorter than that of optometry students ( t AI=1.00 s, t S1=11.86 s, t S2=13.25 s, P t =0.001). In the comparative analysis of the intrarater agreement between the two assessments, AI ( kappa AI=0.658, P AI=0.001) achieved better consistency than the two optometry students did （ kappa S1=0.575, P S1=0.001; kappa S2=0.609, P S2=0.001). Applying deep learning algorithms in the grading assessment of corneal fluorescein staining has considerable feasibility and clinical value. In the performance comparison between AI and optometry students, AI achieved higher accuracy and better consistency, which indicates that AI has potential application value for assisting optometrists to make clinical decisions with speed and accuracy.

Psychometric Properties and Clinical Usefulness of the Spanish Version of the Toe Walking Tool.

The Toe Walking Tool (TWT) was developed in Australia as a valid and reliable screening tool for children who toe-walk. However, psychometric properties of the Spanish version of the TWT have not been studied. The aim of this study was to assess psychometric properties and clinical usefulness of the Spanish version of the TWT. A cross-sectional study was conducted. Twelve children were assessed with the TWT. Intrarater and interrater reliability and agreement were calculated using the intraclass correlation coefficient (ICC) and the Fleiss kappa method for multiple raters. Internal consistency and construct validity were assessed with the Kuder-Richardson formula 20 coefficient and known-group methods, respectively. Sensitivity and specificity were analyzed using the receiver operating characteristic curve. The Content Validity Index was calculated to determine clinical usefulness. An excellent intrarater (ICC = 1) and interrater reliability (ICC = 0.8), moderate interrater agreement (Fleiss kappa, 0.6), strong internal consistency (Kuder-Richardson formula 20 coefficient, 0.86), and very good construct validity were found. Sensitivity and specificity results were appropriate (area under the curve, 0.845). The Content Validity Index was 0.906, suggesting high usefulness. The Spanish version of the TWT was found to be a valid, reliable and useful screening tool for children who toe-walk, providing evidence for its recommendation.

The CADA-MRIT: An MRI Inventory Tool for Evaluating Cerebral Lesions in CADASIL Across Cohorts.

Cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy (CADASIL) is the most frequent genetic cerebrovascular disease. The clinical aspects of the disease in relation to the various types of lesions on MRI vary widely not only within families but also between different cohorts reported worldwide. Many limitations prevent comparison of imaging data obtained with different scanners and sequences in different patient cohorts. We aimed to develop and validate a simple tool to inventory quickly the key MRI features in CADASIL to compare imaging data across different populations. The Inventory Tool (CADA-MRIT) was designed by consensus after repeated expert meetings. It consists of 11 imaging items to assess periventricular, deep, and superficial white matter hyperintensity (WMH), lacunes, cerebral microbleeds (CMB), centrum semiovale and basal ganglia dilated perivascular spaces (dPVS), superficial and deep atrophy, large infarcts, and macrobleeds. The reliability, clinical relevance, and time-effectiveness of CADA-MRIT were assessed using data from 3 independent patient cohorts. Imaging data from 671 patients with CADASIL (440 from France, 119 from Germany, and 112 from Taiwan) were analyzed. Their mean age was 53.4 ± 12.2 years, 54.5% were women, 56.2% had stroke, and 31.1% had migraine with aura. Any lacune was present in at least 70% of individuals, whereas CMB occurred in 83% of patients from the Asian cohort and in only 35% of European patients. CADA-MRIT scores obtained for WMH, CMB, and dPVS were comparable regardless of the scanner or sequence used (weighted κ > 0.60). Intrarater and interrater agreements were from good to very good (weighted κ > 0.60). Global WMH and atrophy scores correlated strongly with accurate volumetric quantification of WMH or brain parenchymal fraction (Pearson r > 0.60). Different imaging scores were significantly associated with the main clinical manifestations of the disease. The time for evaluating 1 patient was approximately 2-3 minutes. The CADA-MRIT is an easy-to-use tool for analyzing and comparing the most frequent MRI lesions of CADASIL across different populations. This instrument is reliable. It can be used with different imaging sequences or scanners. It also provides clinically relevant scores in a very short time for completion.

A weighted cranial diffusion-weighted imaging scale for Wilson's disease.

Cranial magnetic resonance imaging (MRI) could be a crucial tool for the assessment for neurological symptoms in patients with Wilson's disease (WD). Diffusion-weighted imaging (DWI) hyperintensity reflects the acute brain injuries, which mainly occur in specific brain regions. Therefore, this study aimed to develop a weighted cranial DWI scale for patients with WD, with special focus on specific brain regions. In total, 123 patients with WD were enrolled, 118 of whom underwent 1.5 T-MRI on admission. The imaging score was calculated as described previously and depended on the following sequences: one point was acquired when abnormal intensity occurred in the T1, T2, and fluid-attenuation inversion recovery sequences, and two points were acquired when DWI hyperintensity were found. Consensus weighting was conducted based on the symptoms and response to treatment. Intra-rater agreement were good (r = 0.855 [0.798-0.897], p < 0.0001). DWI hyperintensity in the putamen was a high-risk factor for deterioration during de-copper therapy (OR = 8.656, p < 0.05). The high-risk factors for readmission for intravenous de-copper therapies were DWI hyperintensity in the midbrain (OR = 3.818, p < 0.05) and the corpus callosum (OR = 2.654, p < 0.05). Both scoring systems had positive correlation with UWDRS scale (original semi-quantitative scoring system, r = 0.35, p < 0.001; consensus semi-quantitative scoring system, r = 0.351, p < 0.001.). Compared to the original scoring system, the consensus scoring system had higher correlations with the occurrence of deterioration (OR = 1.052, 95%CI [1.003, 1.0103], p < 0.05) and readmission for intravenous de-copper therapy (OR = 1.043, 95%CI [1.001, 1.086], p < 0.05). The predictive performance of the consensus semi-quantitative scoring system for cranial MRI was improved to guide medication, healthcare management, and prognosis prediction in patients with WD. For every point increase in the neuroimaging score, the risk of exacerbations during treatment increased by 5.2%, and the risk of readmission to the hospital within 6 months increased by 4.3%.

Three-Dimensional Distance Mapping to Identify Safe Zones for Lateral Column Lengthening.

Evans (E-LCL) and Hintermann LCL (H-LCL) lateral column lengthening osteotomies are standard surgical solutions for flexible, progressive collapsing feet. E-LCL is performed between the anterior and middle facets and endangers specific os calcis subtalar joint (OCST) subtypes without distinct facets. H-LCL is oriented between the posterior and middle facets and should be suitable for all OCSTs. Both osteotomies are associated with increased subtalar osteoarthritis, indicating iatrogenic damage. Distance mapping (DM) enables visualization of the relative distance between 2 articular surfaces represented by color patterns. This study aims to measure the safe zones for LCL using 3-dimensional (3D) models and DM; we hypothesize that it could be measured with high reproducibility. Two raters categorized 200 feet across 134 patients into OCSTs based on the Bruckner classification. Four angles were measured independently. The proximal and distal extents of the posterior safe zone (PSZ) angles were determined for H-LCL osteotomies; similarly, the proximal and distal extents of the anterior safe zone (ASZ) angles were identified for E-LCL osteotomies. Consequently, the surface available for safe osteotomies were calculated. An interclass correlation was used to assess the agreement between the 2 raters. Additionally, analysis of variance and Mann-Whitney U test were used to compare the safe zones between OCSTs. The mean proximal and distal extents of the PSZ angles were 68 ± 7 and 75 ± 5 degrees from a line parallel to the lateral border of the calcaneus, respectively, and the proximal and distal extent of the ASZ angles were 89 ± 6 and 95 ± 5 degrees, respectively. There were no statistically significant differences between the OCSTs. Two raters measured the angles with good to excellent interrater and intrarater agreement. In 18 cases, we were unable to plan for H-LCL or E-LCL osteotomies. Distance mapping could be used to measure the safe zone, tailor a preoperative plan, and potentially reduce the risk for iatrogenic damage in LCL. 3D models and DM can increase the reliability of preoperative plans in bones with complex 3D structures. Level III, retrospective comparative study.

Three-dimensional reconstruction imaging by C-arm computed tomography accurately visualizes in-stent neointimal formation in patients with stent-assisted coil embolization.

Stent apposition to the vessel wall and in-stent neointimal formation after stent-assisted coil embolization for intracranial aneurysm are important factors associated with postoperative thromboembolic complications. No assessment methods have been established to depict 3-dimensional (3D) all-round in-stent neointimal formation. To demonstrate the superiority of Dyna-3D imaging assessment as a modality for all-round ISNF in comparison with conventional two-dimensional digital subtraction angiography (2D-DSA). Consecutive patients who underwent braided stent-assisted coil embolization for unruptured aneurysm between November 2016 and September 2021 were enrolled. Radiological assessments for stent apposition to the parent vessel after stent deployment and in-stent neointimal formation after 3 months were obtained. Dyna-3D was reconstructed by overlapping a plain image showing stent struts with a rotational DSA image showing the vessel lumen. Reconstructed Dyna-3D images can be rotated to any angle on the screen to evaluate to stent apposition around the vessel and in-stent neointimal formation in 3D, for comparison with 2D-DSA evaluations. Among the 73 patients enrolled, 70 patients (96%) showed complete stent wall apposition on Dyna-3D. Higher intra-rater agreement was confirmed on assessment of in-stent neointimal formation with Dyna-3D (Cohen's κ = 0.811) than with conventional 2D-DSA (Cohen's κ = 0.517). in-stent neointimal formation could not be confirmed on conventional imaging in 9 cases (16%) and on Dyna-3D in 2 cases (3%). The number of in-stent neointimal formations rated as stent wire completely outside the endothelial line was significantly higher with Dyna-3D than with 2D-DSA (p = 0.0001). All-round 3D evaluation by Dyna-3D imaging appears useful for confirming in-stent neointimal formation after braided stent deployment in patients after stent-assisted coil embolization.

Assessment of the added value of intravenous gadolinium for knee osteosarcoma resection planning in pediatric and young adult patients.

To assess the impact of Gadolinium-enhanced magnetic resonance imaging (MRI) sequences on Preoperative imaging evaluation and surgical planning parameters for osteosarcoma (OS) of the knee in pediatric and young adult patients. Thirty MRI scans of patients with OS about the knee were reviewed by five orthopedic oncologists. Key preoperative parameters (neurovascular bundle involvement, intra-articular tumor extension, extent of intramedullary extension) and surgical plans were evaluated based on non-contrast versus Gd contrast enhanced sequences. Assessment agreement, inter-rater agreement, and intrarater agreement between pre and postcontrast images were evaluated via Kappa statistics. Moderate agreement was seen between non and contrast-enhanced assessment of neurovascular involvement and intra-articular tumor extension. Intrarater reproducibility was substantial for neurovascular bundle involvement (precontrast Kappa: 0.63, postcontrast Kappa: 0.69). Intrarater reproducibility was also substantial for precontrast (Kappa: 0.70) and moderate for postcontrast (Kappa: 0.50) assessment of intra-articular tumor extension. Planned resection length and choice of surgical approach were similar between sequences. The addition of Gd-enhanced sequences improved the inter-rater agreement across collected parameters. While some findings suggest that contrast enhanced sequences may not significantly alter the assessment of key preoperative planning parameters by orthopedic oncologists, they may help reduce variability among providers with differing experience levels.

Evaluating the impact of a digitally implemented subjective standard on professional rugby union player management decision-making

Using a pre-post-test design, this study evaluated the impact of implementing a standard on the reliability of player management decision-making within a professional rugby union environment. Five practitioners from a High-Performance Unit (HPU) rated 22 instances of Global Positioning System (GPS)–based external training load information of 14 players across the 2021–2022 season. This rating was whether a peak/trough/normal exposure in load had occurred. The ratings were repeated at four time points (separated by 2 weeks) before (Pre1, Pre2) and after (Post1, Post2) implementing a consensus statement as a subjective standard (using a dashboard) developed previously within the same environment to identify peaks/troughs in player external training loads. Inter-rater agreement between individuals at each voting round was assessed using Light's Kappa, while pre-post-standard intra-rater agreement was determined from Cohen's Kappa (both with 95% confidence intervals). Changes to dashboard usability from implementing the standard were assessed by administering the System Usability Scale to 11 HPU staff at the four time points. Pre-standard moderate inter-rater agreement (Pre1: 0.53 (0.36–0.69), Pre2: 0.60 (0.42–0.77)) increased to almost perfect agreement (Post1: 0.74 (0.57–0.89), Post2: 0.90 (0.79–1)) post-standard. The intra-rater agreement of 2/5 participants was almost perfect post-standard, while it remained within substantial levels for the others. A linear mixed model ( χ2(3) = 8.85, p = 0.03) illustrated a slight increase in dashboard usability after incorporating the standard (Pre1: 84.09, Pre2: 81.36; Post1: 87.73, Post2: 87.27). Overall, the results highlighted that the subjective standard enhanced reliability of practitioner agreement for the selected decision.

Feasibility of software-based assessment for automated evaluation of tooth preparation for dental crown by using a computational geometric algorithm

The purpose of this study was to propose the concept of software-based automated evaluation (SAE) of tooth preparation quality using computational geometric algorithms, and evaluate the feasibility of SAE in the assessment of abutment tooth preparation for single-unit anatomic contour crowns by comparing it with a human-based digitally assisted evaluation (DAE) by trained human evaluators. Thirty-five mandibular first molars were prepared for anatomical contour crown restoration by graduate students. Each prepared tooth was digitized and evaluated in terms of occlusal reduction and total occlusal convergence using SAE and DAE. Intra-rater agreement for the scores graded by the SAE and DAE and inter-rater agreement between the SAE and DAE were analyzed with the significance level (α) of 0.05. The evaluation using the SAE protocol demonstrated perfect intra-rater agreement, whereas the evaluation using the DAE protocol showed moderate-to-good intra-rater agreement. The evaluation values of the SAE and DAE protocols showed almost perfect inter-rater agreement. The SAE developed for tooth preparation evaluation can be used for dental education and clinical skill feedback. SAE may minimize possible errors in the conventional rating and provide more reliable and precise assessments than the human-based DAE.