Intra-rater Agreement Research Articles

Reliability in the assessment of paediatric somatosensory evoked potentials post cardiac arrest

ObjectiveTo measure inter- and intra-rater agreement in the interpretation of cortical somatosensory evoked potential (SSEP) components following paediatric cardiac arrest (CA) in multi-professional neurophysiology teams. MethodsThirteen professionals blinded to patient outcome interpreted 96 SSEPs in paediatric patients 24-/48-/72-hours following CA. Of these, 34 were duplicates used to assess intra-rater agreement. Consistent interpretations (absent/present/indeterminate) between scientists (who record/identify SSEP components) and neurophysiologists (who provide prognostic SSEP interpretation) were expressed as percentages. Rates of agreement were calculated using Fleiss’ kappa coefficient (K). ResultsUnanimous agreement between professionals was present in 40% (95%CI: 28–54%) of the interpreted SSEPs, with a K value of 0.62 (95%CI: 0.55–0.70) based on average agreement. Agreement was similar between neurophysiologists (K = 0.67; 95%CI: 0.57–0.77) and scientists (K = 0.62; 95%CI: 0.54–0.70) but lower in patients < 2 years old (K = 0.23; 95%CI: 0.14–0.33) and in those with poor outcome (K = 0.21; 95%CI: 0.07–0.35). No SSEP was unanimously interpreted as absent and 92% (95%CI: 89–95%) of duplicate SSEPs were interpreted consistently. ConclusionDespite substantial agreement when interpreting prognostic SSEPs, this was significantly lower in children with poor outcome and of younger age. SignificanceClinicians using SSEPs in the intensive care unit should be aware of the inter-rater variability when interpreting SSEPs as absent.

Assessment of Reliability and Validity of the Cochlear Implant Skills Review: A New Measure to Evaluate Cochlear Implant Users' Device Skills and Knowledge.

Purpose The Cochlear Implant Skills Review (CISR) was developed as a measure of cochlear implant (CI) users' skills and knowledge regarding device use. This study aimed to determine intra- and interrater reliability and agreement and establish construct validity for the CISR. Method In this study, the CISR was developed and administered to a cohort of 30 adult CI users. Participants included new CI users with less than 1 year of CI experience and experienced CI users with greater than 1 year of CI experience. The CISR administration required participants to demonstrate skills using the various features of their CI processors. Intra- and interrater reliability were assessed using intraclass correlation coefficients, agreement was assessed using Cohen's kappa, and construct validity was assessed by relating CISR performance to duration of CI use. Results Overall reliability for the entire instrument was 92.7%. Inter- and intrarater agreement were generally substantial or higher. Duration of CI use was a significant predictor of CISR performance. Conclusions The CISR is a reliable and valid assessment measure of device skills and knowledge for adult CI users. Clinicians can use this tool to evaluate areas of needed instruction and counseling and to assess users' skills over time.

Life-threatening danger assessments of penetrating injuries in Eastern Danish clinical forensic medicine

Clinical forensic assessments of injuries’ life-threatening danger may have an impact on the legal aftermath following a violent assault. The pursuit of evidence-based guidelines should ensure a user-independent and reproducible forensic practice. However, does it? The aim of this study was to evaluate the forensic life-threatening danger assessments after a protocol implementation in 2016. The evaluation concerned usability and reproducibility of the protocol, and its influence on assessment severity. We analyzed the level of inter- and intra-rater agreement using 169 blinded, prior-protocol cases that were reassessed by two forensic specialists. We compared assessment made the year before and after protocol implementation (n = 262), and the forensic specialists’ reassessments with the prior-protocol cases’ original assessments (n = 169). Whether to make an assessment, the levels of agreement varied between weak agreement (inter-rater, Κ = 0.43; assessor 1, Κ = 0.57) and strong agreement (assessor 2, Κ = 0.90). Regarding severity, the levels of agreement varied between strong agreement (inter-rater, Κ = 0.87; assessor 1: Κ = 0.90) and almost perfect agreement (assessor 2: Κ = 0.94). The assessments were statistically significant redistributed after the implementation (chi-square test: p < 0.0001). The proportion of cases assessed as having not been in life-threatening danger increased from 9 to 43%, and moderate severity assessments decreased from 55 to 23%. Of the moderate severity assessments, 55% were reassessed as having not been in life-threatening danger. The protocol ensured independent and reproducible assessments when the forensic specialists agreed on making one. The protocol resulted in less severe assessments. Future studies should examine the reliability of the protocol and its consequences for legal aftermaths.

Intestinal Ultrasound to Assess Disease Activity in Ulcerative Colitis: Development of a novel UC-Ultrasound Index.

IntroductionIntestinal ultrasound [IUS] is useful to assess inflammation in ulcerative colitis [UC] patients. We aimed to develop an ultrasonographic activity index using endoscopy as the reference standard.MethodsPatients were included consecutively. IUS was performed within 3 weeks from endoscopy. IUS parameters and endoscopy were compared for each colonic segment [except the rectum]. The best parameters were used to construct a UC-IUS index, which was correlated with endoscopic disease activity using the Spearman’s rank test.ResultsIn 60 patients, 207 colonic segments were evaluated endoscopically. Bowel wall thickness [BWT] > 2.1 mm was optimal to discriminate between Mayo 0 and Mayo 1–3 (sensitivity 82.6%; specificity 93.0%; area under the curve [AUC] 0.910), a cut-off of 3.2 mm was optimal to discriminate between Mayo 0–1 and Mayo 2–3 [sensitivity 89.1%; specificity 92.3%; AUC 0.946] and BWT > 3.9 mm was optimal for detection of Mayo 3 [sensitivity 80.6%; specificity 84.1%; AUC 0.909]. The presence of colour Doppler signal [CDS] predicted active disease, stretches of CDS were associated with Mayo 2–3, lack of haustrations predicted active disease and fat wrapping was associated with severe disease. Inter- and intra-rater intraclass correlation for BWT was substantial. Inter-rater agreement for CDS was substantial and ranged from slight to substantial for haustrations. Intra-rater agreement for CDS was substantial and ranged from moderate to almost perfect for haustrations. The index showed strong correlation with endoscopic disease activity [Mayo: ρ 0.830; p < 0.001, UCEIS: ρ 0.759; p < 0.001].ConclusionWe developed an UC-IUS index which showed strong correlation with endoscopic disease activity using internal validation. It is currently being validated in prospective studies.

Sagittal spine shape literacy in the general adult population, assessed by a novel, simple graphical tool.

[Purpose] The sagittal shape of the spine is associated with back-pain, balance and quality of life. We developed, evaluated and report the responses of a graphical tool to assess sagittal spine shape knowledge (literacy). [Participants and Methods] Two hundred and fifty adults were randomly assigned, in a cross-sectional crossover study, to free-hand draw and select the “ideal” sagittal spine shape. We evaluated the inter and intra-rater reliability and agreement between tests and the sagittal and lordotic spine literacy between the drawing and selection test versions. [Results] Drawing test inter- and intra-rater agreement was 79% and 80% respectively. Drawing vs. selection agreement was 43%. More participants drew than selected the correct spine (30% vs. 21%) (p<0.001) and lumbar lordosis shape (56% vs. 42%) (p<0.001). Test order did not affect spine shape literacy scores. A significantly poorer literacy trend was observed with spine pain presence (p=0.02). [Conclusion] We developed a reliable method to evaluate spine shape literacy and established that only 21% and 42% of our sample demonstrated correct sagittal spine and lordotic spine shape literacy, respectively. The low literacy scores suggests that consideration of including spine shape literacy in health literacy and self-management programs may be warranted, especially in ageing populations.

Ultrasound for diagnosis and follow-up of chronic axillary vasculitis in patients with long-standing giant cell arteritis.

Aims:To assess intima-media thickness (IMT) changes measured by ultrasound in axillary arteries of giant cell arteritis (GCA) patients over time and to calculate an ultrasound cut-off value for the diagnosis of chronic axillary artery involvement in patients with longstanding GCA.Methods:Ultrasound of both axillary arteries was performed in 109 GCA patients at time of diagnosis and at several follow-up visits and in 40 healthy controls (HCs). IMT determined at the prospective follow-up visit was compared between GCA patients with (axGCA) and without (non-axGCA) vasculitis of axillary arteries at baseline, as well as with HCs. Changes in IMT were depicted. Receiver operating characteristics were performed for cut-off calculations. Inter-/intra-rater agreement was evaluated using stored images and intraclass correlation coefficient (ICC).Results:Seventy-three patients were in the axGCA and 36 in the non-axGCA group. Pathological IMT of axillary arteries (axGCA) declined in the first 18 months of treatment by −0.5 mm, (range −2.77 to 0.50), independent of age and gender. Median IMT, after median disease duration of 48 months (16–137), was 0.90 mm (0.46–2.20) in axGCA and 0.60 mm (0.42–1.0) in the non-axGCA group pooled with HCs. An IMT of 0.87 mm was highly specific (specificity 96%, sensitivity 61%) for diagnosis of chronic axGCA. Intra-rater and inter-reader agreement of ultrasound images were good [ICC 0.96–1.0 (three readers) and 0.87, respectively].Conclusion:Pathological IMT of the axillary artery declined under treatment. An IMT of 0.87 mm is highly specific for diagnosis of chronic vasculitis of axillary arteries in long-standing GCA patients.

Validity and reliability of Fried frailty phenotype in Turkish population.

Frailty is an important, multidimensional geriatric syndrome defined as increased vulnerability to stressors. Fried frailty phenotype (FFP) is one of the most widely used models to define physical frailty. The aim of this study is to investigate the cross-cultural validity and reliability of Fried frailty phenotype (FFP) in older Turkish population. A total of 450 patients, aged 59 years and over, were included. FFP translated into Turkish was used. Hand grip strength cut-off values that best predict low skeletal muscle mass index (SMI) for Turkish men and women were calculated. A modified version of FFP was created by rescoring FFP according to these cut-off values applicable to Turkish population. Correlation analysis between the frailty assessment by comprehensive geriatric evaluation of clinician experienced in geriatric medicine, and FFP and modified version of FFP were performed for validation. Thirty-five patients underwent frailty assessment with FFP twice for reliability assessment. Inter-rater and intra-rater agreements were investigated. Clinician's decision of frailty status demonstrated significant agreement with the results of FFP, as well as modified FFP. Interrater and intra-rater compliance were good. Best hand grip strength cut-off values for predicting low SMI in older Turkish population were determined as ≤13.6 kg (AUC: 0.841, p < 0.001) for women and ≤27.7 kg for men (AUC: 0.779; p < 0.001). Modified FFP had a good agreement with the FFP. FFP is a valid and reliable tool for Turkish population.

Glenoid Bone Loss in Shoulder Instability: Superiority of Three-Dimensional Computed Tomography over Two-Dimensional Magnetic Resonance Imaging Using Established Methodology.

BackgroudRecent literature suggests that three-dimensional magnetic resonance imaging (3D MRI) can replace 3D computed tomography (3D CT) when evaluating glenoid bone loss in patients with shoulder instability. We aimed to examine if 2D MRI in conjunction with a validated predictive formula for assessment of glenoid height is equivalent to the gold standard 3D CT scans for patients with recurrent glenohumeral instability.MethodsPatients with recurrent shoulder instability and available imaging were retrospectively reviewed. Glenoid height on 3D CT and 2D MRI was measured by two blinded raters. Difference and equivalence testing were performed using a paired t-test and two one-sided tests, respectively. The interclass correlation coefficient (ICC) was used to test for interrater reliability, and percent agreement between the measurements of one reviewer was used to assess intrarater reliability.ResultsUsing an equivalence margin of 1 mm, 3D CT and 2D MRI were found to be different (p = 0.123). The mean glenoid height was significantly different when measured on 2D MRI (39.09 ± 2.93 mm) compared to 3D CT (38.71 ± 2.89 mm) (p = 0.032). The mean glenoid width was significantly different between 3D CT (30.13 ± 2.43 mm) and 2D MRI (27.45 ± 1.72 mm) (p < 0.001). The 3D CT measurements had better interrater agreement (ICC, 0.91) than 2D MRI measurements (ICC, 0.8). intrarater agreement was also higher on CT.ConclusionsMeasurements of glenoid height using 3D CT and 2D MRI with subsequent calculation of the glenoid width using a validated methodology were not equivalent, and 3D CT was superior. Based on the validated methods for the measurement of glenoid bone loss on advanced imaging studies, 3D CT study must be preferred over 2D MRI in order to estimate the amount of glenoid bone loss in candidates for shoulder stabilization surgery and to assist in surgical decision-making.

Validation of LensHooke® X1 PRO and Computer-Assisted Semen Analyzer Compared with Laboratory-Based Manual Semen Analysis

PurposeTo compare two automated semen quality analysis systems (LensHooke® X1 PRO [X1 PRO]) and IVOS CASA) for accuracy, precision and agreement with laboratory-based manual semen analysis (MSA).Materials and MethodsSemen samples (n=31) were obtained from normozoospermic healthy male volunteers and infertile men with a minimum abstinence period between 2–3 days. After complete liquefaction, 101 seminal aliquots were prepared and tested according to WHO 5th Edition (2010) guidelines. The results obtained by X1 PRO and IVOS CASA were compared with that of MSA. Additionally, 10 samples were used to evaluate the intra- and inter-rater agreement for X1 PRO and MSA.ResultsThe semen parameters (sperm concentration, total, and progressive motility) showed strong correlation and agreement for both automated semen analyzers and MSA (Spearman's rank correlation ≥0.92, p<0.0001). X1 PRO and IVOS CASA were able to differentiate samples with abnormal concentration with a positive predictive value (PPV) of 100%. Furthermore, the PPV for X1 PRO (86.5%) was higher than that for IVOS CASA (71.7%) in differentiating samples with abnormal motility. The X1 PRO device showed a high PPV (97.7%) in identifying normal sperm forms compared to MSA. Semen parameters evaluated showed a high inter-rater (kappa >0.91) and intra-rater (kappa >0.92) agreement for X1 PRO compared with MSA.ConclusionsBoth automated semen analyzers demonstrated a high level of concordance and their performance was comparable with MSA analysis. Furthermore, high-levels of inter-and intra-rater reliability for semen analysis indicate that the new X1 PRO can be used in a clinical laboratory to offer accurate and quick test results.

Success of Biodentine and Ferric Sulfate as Pulpotomy Materials in Primary Molars: A Retrospective Study.

To determine the clinical and radiographic success of Biodentine® (BD) and Ferric Sulfate (FS) as primary molar pulpotomy materials and to compare their outcomes. Retrospective data was obtained from the electronic health records (EHR) of a university-based pediatric dental clinic. Participants were enrolled according to specified inclusion and exclusion criteria. Two trained and calibrated examiners evaluated the EHR using validated criteria for clinical and radiographic outcomes. Study data was numerically coded and analyzed. Cohen's Kappa and Chi-square tests were used (p<0.05). Eighty-three participants (62.7% females, age range two to eight years, average age of 4.5 years) with 102 pulpotomies were enrolled. FS was used in 78% (n=79) and BD in 22% (n=23) of the cases. Follow-up periods ranged from six to 36 months (mean of 17 months). BD showed 100% clinical and radiographic success, while FS demonstrated 84% clinical and 70% radiographic success. The two groups were compared at one year with no statistically significant differences. At 18 months, BD outperformed FS clinically (p=.012) and radiographically (p=.001). Intra-rater and inter-rater agreement were κ>0.88. Both materials can be recommended for clinical practice, however BD may be the preferred choice for its better outcomes at 18 months.

Dental and maxillomandibular incidental findings in panoramic radiography among individuals with mucopolysaccharidosis: a cross-sectional study.

Mucopolysaccharidosis (MPS) is a group of rare and inherited metabolic disorders caused by the accumulation of macromolecule glycosaminoglycans inside lysosomes. Affected individuals may have dental and craniofacial tissue alterations, facilitating the development of several oral diseases. Objectives To assess, with panoramic radiographic images, the frequency of dental and maxillomandibular incidental findings among MPS individuals and compare them with non-MPS individuals.Methodology A cross-sectional study evaluating a sample of 14 MPS individuals and 28 non-MPS individuals aged from 5 to 26 years was carried out. They were matched for sex and age on a 2:1 proportion. Panoramic radiographs were assessed for the presence/absence of the following dental and maxillomandibular alterations: dental anomalies of number (hypodontia/dental agenesis, supernumerary teeth); anomalies of form (microdontia, macrodontia, conoid teeth, taurodontism, and root dilaceration); anomalies of position (impacted tooth, inverted tooth, tooth migration, partially bony teeth, complete bony teeth); periapical alterations (furcation lesion, circumscribed bone rarefaction); other alterations (radiolucent bone lesions, radiopaque bone lesions, radiopacity in the maxillary sinus, condylar hypoplasia). Differences between groups were tested by the Fisher’s exact test and chi-square test (p<0.05).Results For intrarater agreement, Kappa values were 0.76 to 0.85. The presence of supernumerary teeth (p=0.003); conoid teeth (p=0.009); taurodontism (p<0.001); impacted teeth (p<0.001); partial bony teeth (p=0.040); complete bony teeth (p=0.013); and root dilaceration (p=0.047) were statistically more frequent in MPS individuals compared to non-MPS individuals. Bone rarefaction/furcation lesions (p=0.032), condylar hypoplasia (p<0.001), radiolucent bone lesions (p=0.001), and dentigerous cysts (p=0.002) were also more frequent in MPS individuals.Conclusion The presence of specific oral manifestations is more common in MPS individuals than non-MPS individuals.

Assessment of inter-rater and intra-rater reliability of index of orthodontic treatment need index by newly trained orthodontic residents

Introduction: This study aimed to test the reliability of the index of treatment need by newly trained orthodontic residents. Materials and Methods: A total of 100 patients were assessed by the panel of four consultant orthodontists using the index of orthodontic treatment need (IOTN) index, and the agreed category was set as the 'gold standard'. Four residents of the department in the initial stages of formal orthodontic training and lacking the knowledge of using the IOTN index were trained to score the treatment need according to the IOTN index. All four residents were then asked to score the 100 sets of models using both the indexes of IOTN. Results: Kappa scores for inter-rater agreement with the expert panel for the major categories (1–4) demonstrated moderate agreement (kappa: 0.59–0.5623) for all raters. The percentage agreement ranged from 84.03% to 88.10% in all cases. Intra-rater agreement for the major categories was fair to moderate (kappa: 0.53–0.80).Conclusions: The IOTN index is a reliable index to be used for determining the priority of treatment needs in orthodontic treatment. The clarity and simplicity make the index easy to learn and apply with minimal training. The simplicity of the IOTN index makes it easy to learn and apply by novices.

Validation and Cross-cultural Adaptation and Reliability of the Turkish Version of the Michigan Neuropathy Screening Instrument in the Eastern Anatolia Region of Turkey

Aim: Distal symmetric polyneuropathy is a common complication causing foot ulcers and amputations in diabetic patients. The Michigan Neuropathy Screening Instrument (MNSI) is one of the screening methods of diabetic neuropathy, which also provides a comprehensive foot evaluation. The aim of this study was to evaluate the validation, cross-cultural adaptation, and reliability of Turkish Version of the MNSI in the Eastern Anatolia region of Turkey. Materials and Methods: One hundred twenty-six patients with diabetes mellitus were randomly assigned to the study. The questionnaire section of the MNSI was completed by the patients, and the physical examination section was evaluated by health professionals. Nerve conduction studies were performed to 123 patients as the gold standard for diabetic neuropathy. All nerve conduction studies and patients were evaluated by a neurologist. Results: The inter-rater agreement of questionnaire section [ICC: 0.957 (95% CI: 0.940-0.969), p0.001] and physical examination section [ICC: 0.917 (95% CI: 0.884-0.941), p0.001] were excellent. The intra-rater agreement of the questionnaire section [ICC: 0.880 (95% CI: 0.833-0.914), p0.001] and physical examination section [ICC: 0.920 (95% Cl: 0.889-0.943), p0.001] showed a high stability. The area under curve (AUC) for the questionnaire section and physical examination section of the MNSI were 0.588 (p=0.205) and 0.880 (p3, with the sensitivity of 76.2%, specificity of 91.2%, positive predictive value of 64%, negative predictive value of 94.9%.Conclusion: The physical examination section of Turkish version of the MNSI is valid and reliable.

A new guide using CBCT to identify the severity of maxillary canine impaction and predict the best method of intervention.

OBJECTIVE:This study aimed to test the intra and inter-rater reliability, reproducibility, and validity of a new guide called the “Cone Beam Computed Tomography-Maxillary Canine Impaction (CBCT-MCI),” designed to assess the position, severity, and predictability of the maxillary canine impaction (MCI) treatment intervention using Cone Beam Computed Tomography (CBCT).MATERIALS AND METHODS:This study is a retrospective radiographic review of 44 patients with unilateral or bilateral MCI. A total of 56 maxillary impacted canines’ CBCT radiographs were analyzed using the new CBCT-MCI guide, with each of its 10 items scored. The total scores of the 10 items were then compared to a scale to predict the best treatment intervention of MCI: normal spontaneous eruption, surgical-orthodontic traction, or surgical extraction. Radiologists and orthodontists have developed, tested, and retested the CBCT-MCI guide on the same 56 maxillary impacted canines using CBCT radiographs to check its reliability and reproducibility using the Kappa coefficient. Furthermore, the validity of this guide was tested by comparing the predicted best treatment intervention with the actual treatment administered to the assessed impacted maxillary canine using the Kappa coefficient and percentage of agreement using cross-tabulation.RESULTS:The result of this study showed significantly strong Kappa values of intra-rater agreement (k = 0.91, (P < 0.0001) and inter-rater agreement (k = 0.84, P < 0.0001). Furthermore, testing the relationship between the two MCI treatment interventions using cross-tabulation, the agreement percentages between the predicated and actual treatment plans of the assessed MCI ranged between 70% and 95.5% with a significantly strong Kappa value (k = 0.82, P < 0.0001).CONCLUSIONS:This study suggests that the CBCT-MCI guide is capable of producing accurate, reliable, and reproducible results in assessing and predicting the type of orthodontic treatment intervention of MCI in a simple, quick, and efficient way.

Knee Extensor Strength Measurement in Patients With Limited Physical Activity Using a Supine Dynamometer Anchoring Frame.

Objective To investigate the reliability of knee extensor strength measurements using a supine hand-held dynamometer (HHD) anchoring frame in patients with limited physical activity. Although an HHD is suitable for bedside use, its inter-rater reliability is low because measurements can be influenced by tester strength.MethodsMaximal knee extensor isometric strength was measured using an HHD anchored to the supine frame. Three trials of three maximal contractions were assessed by two raters.ResultsA total of 33 inpatients who were non-ambulatory due to acute illness participated in the study. The intraclass correlation coefficients were 0.974 (inter-rater) and 0.959 (intra-rater). The minimal detectable changes in intra- and inter-observer measurements were 29.46 N (24.10%) and 36.73 N (29.26%), respectively. The limits of agreement ranged from -19.79% to 24.81% for intra-rater agreement and from -21.45% to 37.07% for inter-rater agreement.ConclusionThe portable dynamometer anchoring system can measure the isometric strength of the knee extensor reliably in the supine position, and could be used for measurements in patients who have difficulty visiting the laboratory and maintaining a seated posture.

Evaluation of anatomical landmark position differences for head computed tomography: A reliability study among technologists

IntroductionIn computed tomography (CT) imaging protocols, lack of practice standards and variability in head positioning may all yield substantial inter-study image variance in the clinical setting which may limit the diagnostic and comparative value of subsequent scans. We aimed to evaluate repeatability of multiplanar reformatting of head CT based on the tuberculum sella (TS) to internal occipital protuberance (IOP) reference line and reduce variance. MethodsReference lines that correspond to the TS-IOP plane on high-resolution CT scans were reviewed by technologists manually to calculate Yaw (z-rotation, rotation along the superoinferior direction), Pitch (x-rotation, rotation along the left-right direction), and Roll (y-rotation, rotation along the anteroposterior direction) angles in this pre-post design intervention study. The Yaw, Pitch, and Roll angles deviating from the reference TS-IOP in the head CT images before and after technologist training were measured with the technologists’ actual graphical prescriptions, and their differences were calculated with t-tests. The intra-rater agreement was calculated using the intraclass correlation coefficient (ICC). ResultsMean pitch, yaw, and roll before technologist training was 6.7° ± 5.4°, 0.9° ± 1.5°, and 1.1° ± 1.2° and after training were 3.2° ± 2.6°, 0.6° ± 1.1°, and 0.6° ± 1.1°, respectively. Technologist training resulted in a significant decrease in pitch (p < 0.001) and roll (p = 0.001) inter-subject variability with respect to the TS-IOP line, however no significant difference for the yaw correction (p = 0.065) was noted. Intra-rater agreement regarding the reproducibility of TS-IOP reformation was excellent (ICC>0.950). ConclusionTS-IOP reference line corrected for direct roll, yaw, and pitch can be readily achieved by trained technologists. Implications for practiceAdoption of the TS-IOP reference line should facilitate intra- and intermodality comparisons, leading to more reproducible and readily interpretable CT images.

Is This Contrast? Is This Blood? An Agreement Study on Post-thrombectomy Computed Tomography Scans

Background: Hemorrhagic transformation after acute ischemic stroke is a dreaded and severe complication of thrombolysis and thrombectomy. However, its detection on post-thrombectomy conventional non-contrast computed tomography (CT) scan can be complicated by the frequent (and sometimes concomitant) presence of contrast, resulting in changes in management.Aims: Our objective was to assess the inter- and intra-rater reliability for the detection of blood and/or contrast on day-1 post-thrombectomy CT scans.Methods: A total of 18 raters across 3 different specialties independently examined 30 post-thrombectomy CT scans selected from the Aspiration vs. STEnt-Retriever (ASTER) trial. They were asked to judge the presence of blood and contrast. Thirty days later, the same 18 raters again independently judged the 30 scans, in randomized order. Agreement was measured with Fleiss' and Cohen's K statistics.Results: Overall agreement on blood and/ or contrast presence was only fair, k = 0.291 (95% CI = 0.273–0.309). There were 0 scans with consensus among the 18 readers on the presence of blood and/or contrast. However, intra-rater global agreement across all 18 physicians was relatively high, with a median kappa value of 0.675. This intra-rater consistency was seen across all specialties, regardless of level of training.Conclusion: Physician judgment for the presence of blood and/or contrast on day-1 post-thrombectomy non-contrast CT scan shows limited inter-observer reliability. Advanced imaging modalities may then be warranted for challenging clinical cases.

The inter- and intrarater reliability and feasibility of dietetic assessment of sarcopenia and frailty in potential liver transplant recipients: A mixed-methods study.

Sarcopenia and frailty are associated with poorer outcomes in potential liver transplant (LT) recipients. We examined the reliability and feasibility of dietitians assessing sarcopenia and frailty. Seventy-five adults referred for LT underwent assessments of muscle mass (abdominal CTs), physical function (handgrip strength; HGS, short physical performance battery; SPPB), and frailty (Liver Frailty Index; LFI). Inter- and intrarater reliability and agreement were assessed in subsets of patients using intraclass correlation coefficients (ICCs) and Bland-Altman plots. CTs were analyzed by a dietitian and two independent experts, two dietitians assessed function and frailty. Feasibility assessed system, patient, and profession factors (staff survey). Inter- and intrarater reliability for CT-defined low muscle were excellent (ICCs>0.97). Reliability between dietitians was excellent for HGS (0.968, 95% CI,0.928-0.986), SPPB (0.932, 95% CI,0.798-0.973), and LFI (0.938, 95% CI 0.861-0.973). Bland-Altman analysis indicated excellent agreement for HGS. All transplant clinicians valued sarcopenia and frailty in LT assessments and considered the dietitian appropriate to perform them. Seven saw no barriers to implementation into practice, while five queried test standardization, learning from repeat testing, and resource cost. Dietetic assessments of sarcopenia and frailty are reliable, feasible, and valued measures in the assessment of potential LT recipients.

Bone age estimation with the Greulich-Pyle atlas using 3T MR images of hand and wrist

The age estimation of the hand bones by means of X-ray examination is a pillar of the forensic age estimation. Since the associated radiation exposure is controversial, the search for ionizing radiation-free alternatives such as MRI is part of forensic research. The aim of the current study was to use the Greulich-Pyle (GP) atlas on MR images of the hand and wrist to provide reference values for assessing the age of the hand bones. 3T hand MR images of 238 male participants between the ages of 13 and 21 were acquired using 3D gradient echo sequences (VIBE, DESS). Two readers rated the images using the X-ray-based GP atlas method. A descriptive analysis and a transitional analysis were used for the statistical processing of the data. The agreement between and within the raters was assessed. In addition, a comparison was made with the chronological age and with X-ray studies. The descriptive analysis and the transition analysis showed similar results. Both evaluations showed good agreement with X-ray studies. The comparison with the chronological age showed a difference of 0.37 and 0.54 years for the two readers. The age estimate based on the cross-validated transition analysis showed a mean error of −0.28 years. Inter- and intra-rater agreement were good. In summary, it can be concluded that age estimation of hand bones with MR images is routinely applicable with the GP atlas as an alternative without ionizing radiation. However, in order to reduce the estimation error, a multi-factorial assessment based on examinations of several body regions is still recommended.

Is MRI a viable alternative to CT/CBCT to identify the course of the inferior alveolar nerve in relation to the roots of the third molars?

ObjectivesTo assess the reliability of judging the spatial relation between the inferior alveolar nerve (IAN) and mandibular third molar (MTM) based on MRI or CT/CBCT images.MethodsAltogether, CT/CBCT and MRI images of 87 MTMs were examined twice by 3 examiners with different degrees of experience. The course of the IAN in relation to the MTM, the presence/absence of a direct contact between IAN and MTM, and the presence of accessory IAN were determined.ResultsThe IAN was in > 40% of the cases judged as inferior, while an interradicular position was diagnosed in < 5% of the cases. The overall agreement was good (κ = 0.72) and any disagreement between the imaging modalities was primarily among the adjacent regions, i.e., buccal/lingual/interradicular vs. inferior. CT/CBCT judgements presented a very good agreement for the inter- and intrarater comparison (κ > 0.80), while MRI judgements showed a slightly lower, but good agreement (κ = 0.74). A direct contact between IAN and MTM was diagnosed in about 65%, but in almost 20% a disagreement between the judgements based on MRI and CT/CBCT was present resulting in a moderate overall agreement (κ = 0.60). The agreement between the judgements based on MRI and CT/CBCT appeared independent of the examiner’s experience and accessory IAN were described in 10 cases in MRI compared to 3 cases in CT/CBCT images.ConclusionsA good inter- and intrarater agreement has been observed for the assessment of the spatial relation between the IAN and MTM based on MRI images. Further, MRI images might provide advantages in the detection of accessory IAN compared to CT/CBCT.Clinical relevanceMRI appears as viable alternative to CT/CBCT for preoperative assessment of the IAN in relation to the MTM.