Agreement Intraclass Correlation Research Articles

What are the minimum requirements to establish proficiency in lung ultrasound training for quantifying B-lines?

AimsThe goal of this study was to determine the number of scans needed for novice learners to attain proficiency in B‐line quantification compared with expert interpretation.Methods and resultsThis was a prospective, multicentre observational study of novice learners, physicians and non‐physicians from three academic institutions. Learners received a 2 h lung ultrasound (LUS) training session on B‐line assessment, including lecture, video review to practice counting and hands‐on patient scanning. Learners quantified B‐lines using an eight‐zone scanning protocol in patients with suspected acute heart failure. Ultrasound (US) machine settings were standardized to a depth of 18 cm and clip length of 6 s, and tissue harmonics and multibeam former were deactivated. For quantification, the intercostal space with the greatest number of B‐lines within each zone was used for scoring. Each zone was given a score of 0–20 based on the maximum number of B‐lines counted during one respiratory cycle. The B‐line score was determined by multiplying the percentage of the intercostal space filled with B‐lines by 20. We compared learner B‐line counts with a blinded expert reviewer (five US fellowship‐trained faculty with > 5 years of clinical experience) for each lung zone scanned; proficiency was defined as an intraclass correlation of > 0.7. Learning curves for each learner were constructed using cumulative sum method for statistical analysis. The Wilcoxon rank‐sum test was used to compare the number of scans required to reach proficiency between different learner types.Twenty‐nine learners (21 research associates, 5 residents and 3 non‐US‐trained emergency medicine faculty) scanned 2629 lung zones with acute pulmonary oedema. After a mean of 10.8 (standard deviation 14.0) LUS zones scanned, learners reached the predefined proficiency standard. The number of scanned zones required to reach proficiency was not significantly different between physicians and non‐physicians (P = 0.26), learners with no prior US experience vs. > 25 prior patient scans (P = 0.64) and no prior vs. some prior LUS experience (P = 0.59). The overall intraclass correlation for agreement between learners and experts was 0.74 and 0.80 between experts.ConclusionsOur results show that after a short, structured training, novice learners are able to achieve proficiency for quantifying B‐lines on LUS after scanning 11 zones. These findings support the use of LUS for B‐line quantification by non‐physicians in clinical and research applications.

Differences in Lung and Lobe Volumes between Supine and Standing Positions Scanned with Conventional and Newly Developed 320-Detector-Row Upright CT: Intra-Individual Comparison

Background: No clinical studies to date have compared unilateral lung or lobe volumes between the supine and standing positions. Objectives: To compare lung/lobe volumes on computed tomography (CT) between these two positions and evaluate the correlation between the total lung volume and total lung capacity (TLC) on pulmonary function tests (PFTs). Methods: Thirty-two asymptomatic volunteers underwent both conventional CT (supine position) and upright CT (standing position), during deep inspiration breath-hold, and PFTs on the same day. We measured lung/lobe volumes on CT in each position. Paired t tests were used for statistical analysis. Results: The volumes of the total lung (10.9% increase), right lung (10.3% increase), right upper lobe (8.6% increase), right lower lobe (14.6% increase), left lung (11.6% increase), left upper lobe (7.1% increase), and left lower lobe (16.0% increase) were significantly greater in the standing position than in the supine position (all p < 0.0001). The right middle lobe volume was similar between the two positions (p = 0.16). Intraclass correlation coefficients for agreement between total lung volumes on CT in the supine/standing positions and the TLC on PFT were 0.891/0.938, respectively. Conclusions: While the volumes of the bilateral upper and lower lobes and bilateral lungs were significantly greater in the standing than in the supine position, with lower lobes showing larger changes, the right middle lobe volume did not change significantly between positions. The total lung volume on upright CT in the standing position was more similar to TLC on PFT than that in the supine position.

The Pediatric-Specific American Society of Anesthesiologists Physical Status Score: A Multicenter Study.

When applied to the pediatric population, the American Society of Anesthesiologists physical status (ASA-PS) classification has exhibited poor reliability due to its subjective and adult-focused definitions. This study was done to measure interrater agreement of a pediatric-adapted ASA-PS classification and to solicit multicenter perspectives to optimize the pediatric ASA-PS classification. A prospective, mixed-methods study of 197 pediatric anesthesiologists from 13 academic pediatric hospitals in the United States, Europe, and Australia surveyed in May and July 2019. Participants assigned ASA-PS scores (I to V) for 15 pediatric cases with a heterogeneous mix of acute and chronic health conditions undergoing a variety of surgical and related procedures. Pediatric-adapted definitions of ASA-PS were provided. The intraclass correlation coefficient (ICC) was used to assess interrater reliability of ASA-PS scores. The ICC was estimated using 2-way mixed-effects modeling, accounting for multiple raters assigning scores for the same set of cases. Qualitative feedback on the pediatric-adapted ASA-PS classification was analyzed with line-by-line coding. The survey response rate was 83.8% (165 of 197). The ICC agreement among participants on ASA-PS scoring across all 15 clinical cases was 0.58 (95% confidence interval [CI], 0.42-0.77). ICC did not vary significantly by years of anesthesiology practice. ICC varied across hospitals (range: 0.34; 95% CI, 0.12-0.63 to 0.79; 95% CI, 0.66-0.91). The highest level of agreement occurred with cases most often scored as ASA-PS I, IV, and V; the lowest agreement occurred with cases most often scored ASA-PS II and III. Clarification of how well a chronic condition was controlled and presence of an acute illness were 2 common themes suggested to optimize the validity of the pediatric-adapted ASA-PS definitions. The pediatric-adapted ASA-PS classification had moderate interrater reliability among pediatric anesthesiologists. The lower reliability of scoring for ASA-PS II and III cases, in particular, supports the need for further ASA-PS definition refinement for pediatric populations.

Imaging Pulmonary Blood Flow Using Pseudocontinuous Arterial Spin Labeling (PCASL) With Balanced Steady-State Free-Precession (bSSFP) Readout at 1.5T.

Quantitative assessment of pulmonary blood flow and visualization of its temporal and spatial distribution without contrast media is of clinical significance. To assess the potential of electrocardiogram (ECG)-triggered pseudocontinuous arterial spin labeling (PCASL) imaging with balanced steady-state free-precession (bSSFP) readout to measure lung perfusion under free-breathing (FB) conditions and to study temporal and spatial characteristics of pulmonary blood flow. Prospective, observational. Fourteen volunteers; three patients with pulmonary embolism. 1.5T, PCASL-bSSFP. The pulmonary trunk was labeled during systole. The following examinations were performed: 1) FB and timed breath-hold (TBH) examinations with a postlabeling delay (PLD) of 1000 msec, and 2) TBH examinations with multiple PLDs (100-1500 msec). Scan-rescan measurements were performed in four volunteers and one patient. Images were registered and the perfusion was evaluated in large vessels, small vessels, and parenchyma. Mean structural similarity indices (MSSIM) was computed and time-to-peak (TTP) of parenchymal perfusion in multiple PLDs was evaluated. Image quality reading was performed with three independent blinded readers. Wilcoxon test to compare MSSIM, perfusion, and Likert scores. Spearman's correlation to correlate TTP and cardiac cycle duration. The repeatability coefficient (RC) and within-subject coefficient of variation (wCV) for scan-rescan measurements. Intraclass correlation coefficient (ICC) for interreader agreement. Image registration resulted in a significant (P < 0.05) increase of MSSIM. FB perfusion values were 6% higher than TBH (3.28 ± 1.09 vs. 3.10 ± 0.99 mL/min/mL). TTP was highly correlated with individuals' cardiac cycle duration (Spearman = 0.89, P < 0.001). RC and wCV were better for TBH than FB (0.13-0.19 vs. 0.47-1.54 mL/min/mL; 6-7 vs. 19-60%). Image quality was rated very good, with ICCs 0.71-0.89. ECG-triggered PCASL-bSSFP imaging of the lung at 1.5T can provide very good image quality and quantitative perfusion maps even under FB. The course of labeled blood through the lung shows a strong dependence on the individuals' cardiac cycle duration. 2 TECHNICAL EFFICACY STAGE: 2 J. MAGN. RESON. IMAGING 2020;52:1767-1782.

Incidence and Location of Atelectasis Developed During Bronchoscopy Under General Anesthesia: The I-LOCATE Trial

Despite the many advances in peripheral bronchoscopy, its diagnostic yield remains suboptimal. With the use of cone-beam CT imaging we have found atelectasis mimicking lung tumors or obscuring them when using radial-probe endobronchial ultrasound (RP-EBUS), but its incidence remains unknown. What are the incidence, anatomic location, and risk factors for developing atelectasis during bronchoscopy under general anesthesia? We performed a prospective observational study in which patients undergoing peripheral bronchoscopy under general anesthesia were subject to an atelectasis survey carried out by RP-EBUS under fluoroscopic guidance. The following dependent segments were evaluated: right bronchus 2 (RB2), RB6, RB9, and RB10; and left bronchus 2 (LB2), LB6, LB9, and LB10. Images were categorized either as aerated lung ("snowstorm" pattern) or as having a nonaerated/atelectatic pattern. Categorization was performed by three independent readers. Fifty-seven patients were enrolled. The overall intraclass correlation agreement among readers was 0.82 (95%CI, 0.71-0.89). Median time from anesthesia induction to atelectasis survey was 33min (range, 3-94 min). Fifty-one patients (89%; 95%CI, 78%-96%) had atelectasis in at least one of the eight evaluated segments, 45 patients (79%) had atelectasis in at least three, 41 patients (72%) had atelectasis in at least four, 33 patients (58%) had atelectasis in at least five, and 18 patients (32%) had atelectasis in at least six segments. Right and left B6, B9, and B10 segments showed atelectasis in > 50%of patients. BMI and time to atelectasis survey were associated with increased odds of having more atelectatic segments (BMI: OR, 1.13 per unit change; 95%CI, 1.034-1.235; P= .007; time to survey: OR, 1.064 per minute; 95%CI, 1.025-1.105; P= .001). The incidence of atelectasis developing during bronchoscopy under general anesthesia in dependent lung zones is high, and the number of atelectatic segments is greater with higher BMI and with longer time under anesthesia. ClinicalTrials.gov; No.: NCT03523689; URL: www.clinicaltrials.gov.

Four-dimensional Flow Magnetic Resonance Imaging Quantification of Blood Flow in Bicuspid Aortic Valve.

Four-dimensional (D) flow magnetic resonance imaging (MRI) is limited by time-consuming and nonstandardized data analysis. We aimed to test the efficiency and interobserver reproducibility of a dedicated 4D flow MRI analysis workflow. Thirty retrospectively identified patients with bicuspid aortic valve (BAV, age=47.8±11.8 y, 9 male) and 30 healthy controls (age=48.8±12.5 y, 21 male) underwent Aortic 4D flow MRI using 1.5 and 3 T MRI systems. Two independent readers performed 4D flow analysis on a dedicated workstation including preprocessing, aorta segmentation, and placement of four 2D planes throughout the aorta for quantification of net flow, peak velocity, and regurgitant fraction. 3D flow visualization using streamlines was used to grade aortic valve outflow jets and extent of helical flow. 4D flow analysis workflow time for both observers: 5.0±1.4 minutes per case (range=3 to 10 min). Valve outflow jets and flow derangement was visible in all 30 BAV patients (both observers). Net flow, peak velocity, and regurgitant fraction was significantly elevated in BAV patients compared with controls except for regurgitant fraction in plane 4 (91.1±29.7 vs. 62.6±19.6 mL/s, 37.1% difference; 121.7±49.7 vs. 90.9±26.4 cm/s, 28.9% difference; 9.3±10.1% vs. 2.0±3.4%, 128.0% difference, respectively; P<0.001). Excellent intraclass correlation coefficient agreement for net flow: 0.979, peak velocity: 0.931, and regurgitant fraction: 0.928. Our study demonstrates the potential of an efficient data analysis workflow to perform standardized 4D flow MRI processing in under 10 minutes and with good-to-excellent reproducibility for flow and velocity quantification in the thoracic aorta.

Assessing the Validity of the Past-Month, Online Canadian Diet History Questionnaire II Pre and Post Nutrition Intervention.

Dietary intake tools are used in epidemiological and interventional studies to estimate nutritional intake. The past-month Canadian Diet History Questionnaire II (CDHQII) has not yet been validated. This study aimed to assess the validity of the CDHQII in adults by comparing dietary results from the CDHQII to the same participants’ 24-h recalls consisting of two weekdays and one weekend day. The recalls were collected using the validated multiple-pass method. Participants were asked to complete both tools at baseline, and again at 3-month follow-up. The study further aimed to determine which dietary intake tool was preferred by study participants by comparing completion rates. Data collection occurred at baseline (pre-intervention) and 3-month follow-up (post-intervention). Paired sample t-tests were conducted to compare means for the following nutrients (grams and %kcal): calories, protein, carbohydrates, total fat, saturated fat, unsaturated fat and sodium. Intraclass correlation coefficients of agreement and coefficients of variation were further calculated. Chi-square tests were used to determine the dietary assessment method with the greatest participant completion rate. At baseline (n = 104), there were no significant differences between the results of the CDHQII and three 24-h recalls (averaged), with overall moderate correlation coefficients. At 3-months (n = 53), there were significant differences (p < 0.05) between dietary intake collection methods for all nutrients assessed in this study, except for saturated fat (%kcal), unsaturated fat (%kcal), protein (%kcal) and sodium (mg). Correlation coefficients were moderate. A significantly greater proportion of participants completed the three 24-h recalls compared to the CDHQII after 3 months (completion rates of 67.2% vs. 50.8% of the sample, respectively). The CDHQII provided estimates of mean nutritional intake (calories, macronutrients and sodium) that were comparable to mean intake established from three 24-h recalls, at baseline and was validated in a sample of primarily middle-aged, college-educated, Caucasian female adults with overweight and obesity for mean baseline or cross-sectional measurement only but not for assessing individual/patient dietary intake in clinical practice (r = 0.30–0.68). This tool was not validated at 3-month follow-up. Additionally, participants preferred the three 24-h recalls to the online, past-month CDHQII.

A wavelet-based algorithm for automated analysis of external tocography: How does it compare to human interpretation?

BackgroundStudies which use external tocography to explore the relationship between increased intrapartum uterine activity and foetal outcomes are feasible because the technology is safe and ubiquitous. However, periods of poor signal quality are common. We developed an algorithm which aims to calculate tocograph summary variables based on well-recorded contractions only, ignoring artefact and excluding sections deemed uninterpretable. The aim of this study was to test that algorithm's reliability. MethodsWhole recordings from labours at ≥35 weeks of gestation were randomly selected without regard to quality. Contractions and rest intervals were measured by two humans independently, and by the algorithm using two sets of models; one based on a series of pre-defined thresholds, and another trained to imitate one of the human interpreters. The absolute agreement intraclass correlation coefficient (ICC) was calculated using a two-way random effects model. ResultsThe training dataset included data from 106 tocographs. Of the tested algorithms, AdaBoost showed the highest initial cross-validated accuracy and proceeded to optimization. Forty tocographs were included in the validation set. The ICCs for the per tocograph mean contraction rates were; human B to human A: 0.940 (0.890–0.968), human A to initial models: 0.944 (0.898–0.970), human A to trained models 0.962 (0.927–0.980), human B to initial models: 0.930 (0.872–0.962), human B to trained models: 0.948 (0.903–0.972). ConclusionsThe algorithm described approximates interpretation of external tocography performed by trained humans. The performance of the AdaBoost trained models was marginally superior compared to the initial models.

The Global Assessment of School Functioning (GASF): Criterion validity and interrater reliability

AbstractThe Global Assessment of School Functioning (GASF) provides a robust estimate of a student's overall level of functioning within the school environment. It is intended to capture a global metric reflecting academic, social and general behavioral functioning within the school. It is a modification of the Global Assessment of Functioning and reflects functioning across academics, interpersonal relationships, school behavior, and school participation. It was developed to allow school personnel a means to communicate the general level of student functioning without reverting to specific issues or immediate concerns. This paper reports on the scale's criterion validity and interrater reliability. Confirmations of the scale structure and descriptors were obtained using subject matter experts, who confirmed descriptor's criterion validity. Vignettes were developed and then rated by 64 educators to establish interrater reliability. Strong intraclass correlations (ICC) were obtained supporting the GASF reliability (single measure absolute agreement ICC = 0.998, 95th percentile confidence interval = 0.994 to 1.00). With appropriate use, this tool has value for all school personnel as a general indicator of student functioning and as a point of student reference in school team considerations. Anecdotal evidence indicates it can be used for overall progress monitoring as well.

Improving measurement of harms from others' drinking: A key informant study on type and severity of harm.

Aims:Survey items for measuring harms experienced from others' drinking (AHTO) have been developed primarily to measure type of harm and not severity. However, some type of harms may produce more negative effects than others. We aimed to compare the perceived severity of a comprehensive list of AHTO items to assess consistency in subjective ratings of severity, facilitate a more nuanced analysis and identify strategies to improve measurement of AHTO in epidemiological surveys.Methods:Thirty-six leaders of national alcohol surveys (conducted between 1997 and 2016) from 23 countries rated the typical severity of negative effects on the victim of each of 48 types of AHTO using a scale from zero (no negative effect) to 10 (very severe negative effect). The survey leaders were also asked to provide open-ended feedback about each harm and the severity-rating task generally.Results:Of 48 harm items, five were classified as extreme severity (mean rating ≥ 8), 17 as high (≥ 6 < 8), 25 as moderate (≥ 4 < 6), and one as low (≤ 4). We used two-way random effects models to estimate absolute agreement intraclass correlation coefficients (AA-ICC) and consistency of agreement intraclass correlation coefficients (CA-ICC). Results showed that there was fair to excellent absolute agreement and consistency of agreement among experts’ ratings of the severity of harms from others’ drinking (single measures CA-ICC = 0.414, single measures AA-ICC = 0.325; average CA-ICC = 0.940, average AA-ICC = 0.914). Harms to children, and harms causing physical, financial, practical, or severe emotional impacts were rated most severe.Conclusions:When designing new AHTO surveys and conducting analyses of existing data, researchers should pay close attention to harms with high perceived severity to identify effective ways to prevent severe AHTO and reduce the negative health and social impacts of AHTO. By inquiring into experts' views on survey items, this analysis involves a first scoping of the sort of questions that should be taken into consideration. In-depth analyses of specific sub-sets of harms and qualitative interviews with victims of severe AHTO are likely to help along this work in the future.

Measurement of midshaft clavicle vertical displacement is not influenced by radiographic projection

BackgroundMeasured shortening of midshaft clavicle fracture fragments is known to be influenced by multiple factors. The influence of radiographic projection on vertical displacement is unclear. The aims of this study were (1) to quantify the difference in measurements of vertical displacement in an absolute, relative, and categorical manner between 5 different projections; (2) to quantify the differences in interobserver and intraobserver agreement using a standardized method for measuring vertical displacement; and (3) to assess the association between categorical and continuous descriptions of vertical displacement.Materials and methodsA clinical measurement study was conducted on 31 sets of digitally reconstructed radiographs in 5 different projections (15° and 30° caudocranial, anteroposterior, and 15° and 30° craniocaudal views). Categorical data on vertical displacement in quartiles from 0%-200% were obtained followed by measurements using a standardized method by 3 observers at 2 points in time. Interobserver and intraobserver agreement for each of the 5 views was calculated.ResultsThe absolute and relative vertical displacement showed no statistically significant difference between any of the caudocranial, anteroposterior, and craniocaudal views. Intraclass correlation coefficients for intraobserver and interobserver agreement were good to excellent. The correlation between categorical outcomes and both absolute and relative vertical displacement was very strong.ConclusionUnlike shortening, absolute and relative vertical displacement of the midshaft clavicle fracture is not significantly influenced by radiographic projection. Standardized measurements of vertical displacement may not be necessary for clinical use because the correlation between categorical and continuous measurements was found to be very strong.

Validation of a Sagittal Section Technique for Measuring Clitoral Blood Flow. Volume Flow: A New Parameter in Clitoral Artery Doppler

BackgroundClitoral artery Doppler has been used as an objective technique to measure changes in genital women response. However, the technique has not been fully validated, and arterial volume flow has never been used as an outcome measure. AimsTo validate the technique clitoral artery Doppler measured in a sagittal section and explore arterial volume flow as a new parameter in clitoral Doppler. MethodsWe examined 90 healthy volunteers by clitoral artery Doppler using the sagittal section approach described by Battaglia et al in 2008. We calculated intraobserver, interobserver, and intraobserver intersession variability and reliability for all Doppler parameters and described and validated arterial volume flow as a new parameter in clitoral artery Doppler. OutcomesWe calculated peak systolic velocity (PSV), time-averaged maximum velocity, time-averaged mean velocity, end-diastolic velocity, pulsatility index, resistance index, and volume flow (v-flow) in all groups. We conducted reliability analyses using the intraclass correlation coefficient for agreement. We explored differences between and within observers and calculated agreement limits using the Bland-Altman test. ResultsThe intraclass correlation coefficient analysis showed correlation values higher than 0.75 (good reliability) for most of the variables and higher than 0.60 (moderate reliability) for the remaining ones. There were statistically significant differences between PSV and time-averaged maximum velocity in the intraobserver intersession measurements. For the remaining groups and variables, no statistically significant differences were observed. Bland-Altman analyses showed that the limits of agreement were acceptable and the regressions were not significant. The v-flow parameter also showed good reliability and low variability between groups. Clinical ImplicationsWe found that PSV was not a good outcome measure because of its high intraobserver and intersession variability. Moreover, it is possible to measure v-flow in the clitoral artery using the sagittal technique described by Battaglia et al, and it seems that this measure is reliable and reproducible. This could be the best parameter to assess clinical changes. Strengths & LimitationsThis study provided full validation of the sagittal section approach and of a new parameter, v-flow, which could beuseful for assessing clitoral blood flow. The main limitation of the study is its retrospective nature for validating v-flow. ConclusionWe found that clitoral artery Doppler measured using a sagittal approach is a valid and reliable technique for studying clitoral blood flow in women. The v-flow variable is a promising and reliable parameter for measuring changes in clitoral blood flow.Pérez MF, Agís IF, La Calle Marcos P, et al. Validation of a Sagittal Section Technique for Measuring Clitoral Blood Flow: Volume Flow – A New Parameter in Clitoral Artery Doppler. J Sex Med 2020;17:1109–1117.

Cochlear Implant Receiver Location and Migration: Experimental Validation Pilot Study of a Clinically Applicable Screening Method.

Objectives: Postoperative follow-up after cochlear implantation lacks a reliable screening method to detect cochlear implant receiver device migration. This study aims to validate a clinically applicable method to assess the position and migration of the cochlear implant receiver device.Study design: Validation study.Setting: Tertiary university medical center.Participants and method: To assess the cochlear implant receiver device location, round markers representing the external magnet were placed on both sides of the head of volunteers. Four independent clinicians took measurements of the distances between reference points on the head and the center of the marker. The reference points were: the lateral canthus (LC), tragus tip (TT), the mastoid angle (MA), and the mandibular angle (AM).Main outcome measures: The inter-clinician reliability was determined by calculating the intraclass correlation coefficient (ICC) and confidence interval (CI) with a two-way mixed model and both consistency and absolute agreement types for each distance.Results: Eight volunteers were included resulting in 16 individual cases. The consistency type ICC's for each reference point were: LC 0.90 (CI = 0.80, 0.96), TT 0.83 (CI = 0.69, 0.93), MA 0.75 (CI = 0.56, 0.89), and AM 0.29 (CI = 0.05, 0.59). The absolute agreement ICC's were: LC 0.87 (CI = 0.73, 0.95), TT 0.83 (CI = 0.68, 0.93), MA 0.68 (CI = 0.42, 0.86), and AM 0.18 (CI = 0.01, 0.46). The inter-clinician reliability was good to excellent for the lateral canthus and tragus tip reference points.Conclusions: The cochlear receiver device location can be assessed reliably by measuring the distance between the LC, TT, and the external magnet. This method can be used to registrate implant receiver location after implantation and detect implant migration postoperatively.

Reliability of international hip dysplasia institute classification for the developmental dysplasia of the hip among different medical personnel in Iraq

Background: The international hip dysplasia institute (IHDI) classification is a new method for quantifying the severity of the developmental dysplasia of the hip (DDH). Objectives: This study aimed to compare the reliability of this classification between different medical personnel such as pediatricians, general practitioners, and family doctors in addition to orthopedic surgeons and radiologists. Methods: Hundred pelvic radiographic films (with 200 hips) were randomly selected from the files of children already diagnosed and treated as DDH cases. These films were analyzed by 12 independent observers of four different specialties: three orthopedic surgeons (Ortho Group), three radiologists (Radio Group), three pediatricians (Pediat Group), and three general practitioners (GP Group). Results: The average measures (Cronbach's alpha) for the intraclass correlation coefficient (ICC) for absolute agreement between all observers was 0.874 (with 95% confidence intervals between 0.780 and 0.925). This was considered as having a good level of reliability and agreement between all observers. The ICC for agreement between the observers of radio group showed the highest score (0.904) while that between those of GP Group had the lowest one (0.826). However, during the comparison between the mean score of each group with that of the other groups by the one-way ANOVA method, there was no statistically significant difference between all groups (P values were 0.563, 0.415, 0.399, and 0.291 respectively). Conclusion: The IHDI classification method for cases of DDH has a good level of reliability among different medical personnel regardless of their specialties.

The Ability of Different Observers in Measuring Dimensions of Objects and Cavities in Cone Beam-CT Images

Background: Accuracy of measurements obtained from cone-beam computed tomography (CBCT) images, which is a diagnostic tool in dentistry, is an important issue. The aim of this study was to compare the ability of different operators in measuring dimensions using CBCT software. Methods: In this experimental study, 35 different areas using opaque objects and drilling cavities were prepared on 3 phantoms which were made from fresh beef ribs. Then each phantom was scanned by CBCT Promax 3D. The mentioned areas were measured on CBCT images 2 times with one week interval by four observer groups consisting two radiologists, two periodontists, two maxillofacial surgeons, and two general dentists. Obtained measurements from each group of observers were compared with those of other groups and also with measurements of a digital caliper as a gold standard by intra-class correlation coefficient (ICC). Then the measured dimensions, with respect to their application, were divided into three clusters including cluster 1: 2-7 mm, cluster 2: 7-16 mm, and cluster 3: more than 16 mm. T test was used to compare the mean value of each cluster with the mean value of the gold standard. Results: In general, based on ICC, inter- and intra-observer agreement, agreement between observer groups, and agreement between each group and the gold standard were significant. The results of t test showed a significant difference between the mean value of data and that of gold standard in clusters 1 and 3. Conclusions: Generally, high accuracy and reliability were reported for different specialists of dentistry and general dentists in measuring the dimensions of objects and cavities in CBCT images.

Determination of the Pretibial Soft Tissue Thickness in Children: Are Intraosseous Infusion Needles Long Enough?

The EZ-IO intraosseous (IO) needle is available in 2 needle sizes for children based on the patient weight. To date, there is no published evidence validating the use of weight-based scaling in children. We hypothesized that pretibial subcutaneous tissue thickness (PSTT) does not correspond with patient weight but rather with age and body mass index (BMI). Our objective was to describe the relationship of a patient's PSTT to their weight, age, and BMI in children less than 40 kg. One hundred patients who weighed less than 40 kg were recruited prospectively from October 2013 to April 2015 at a tertiary care pediatric emergency department. All sonographic assessments were performed by 1 of 2 emergency physicians certified in point-of-care ultrasound. A single sonographic image was taken over the proximal tibia corresponding to the site of IO insertion. In patients where both sonographers performed independent measurements, a Pearson correlation coefficient was determined. Univariate linear regression was performed to determine the relationship between age, weight, and BMI with PSTT. One hundred participants were recruited and ranged in age from 10 days to 14 years (mean [SD], 5.01 [3.14] years). Fifty-seven percent of participants were male. Patients' weights ranged from 3.5 to 39.3 kg (mean [SD], 21.42 [9.12] kg), and BMI ranged from 12.1 to 45.0 kg/m (mean [SD], 17.31 [4.00]). The mean (SD) PSTT across participants was 0.68 (0.2) cm. The intraclass correlation coefficient for agreement between the 2 sonographers was moderate (intraclass correlation coefficient, 0.602 [confidence interval, 0.385-0.757]). There were significant positive correlations between BMI and PSTT (r = 0.562, P = <0.001) as well as weight and PSTT (r = 0.293, P < 0.003). There was a weak correlation between age and PSTT (0.065, P = 0.521). Pretibial subcutaneous tissue thickness correlates most strongly with BMI, followed by weight, and weakly with age. Our findings suggest that current IO needle length recommendations should be based on BMI rather than weight. This would suggest that clinicians need to be aware that young patients in particular with large BMIs may pose problems with current weight-based needle length recommendations.

Validity of Magnetic Resonance Imaging Measurement of Hip Labral Width Compared With Intraoperative Assessment

To determine if magnetic resonance angiography (MRA) and/or magnetic resonance imaging (MRI) could accurately determine the width of the labrum. Consecutively enrolled patients between the ages of 18 and 65 indicated for hip arthroscopy for femoroacetabular impingement were included between December 2017 and June 2018. Inclusion criteria for preoperative MRIs included: MRI availability in picture archiving and communication system; performance on a 1.5T or 3T MRI or 3T MRA; and adequate quality and lack of labrum ossification. Intraoperative labral width measurements were taken at standardized locations using an established acetabular "clockface" paradigm. Measurement was performed using a calibrated probe. The labral width was defined as the distance from the labrum extended laterally from the acetabular rim. MRI measurements were taken by 2 blinded musculoskeletal fellowship-trained radiologists at the same positions. Measurements were made at the 11:30 o'clock position (indirect rectus) on coronal proton density (PD) sequence, at 3 o'clock position (psoas-U) on axial oblique PD sequence, and at 1:30 (a point halfway between the 2) on sagittal fat-suppressed PD. The surgeons were blinded to the radiologists' measurements and vice versa. Intraoperative and radiographic labral width measurements were compared using an intraclass correlation coefficients (ICC), absolute agreement, and 2-way random effects model. The 2 radiologists' measurements were compared for interrater reliability using the same ICC model. Fifty-one patients were included (30 females, 26 right hips). Average labrum width at the 3:00, 11:30, and 1:30 o'clock positions by arthroscopic measurement were 5.8 mm (range; standard deviation, 2-8; ±1.4), 6.3 mm (2-10; ±1.5) and 6.0 mm (2-9; ±1.5), and by MRI were 6.3 mm (2-10; ±1.5), 6.7 mm (3-10; ±1.4), and 6.1 mm (2-9; ±1.6), respectively. When including all MRI modalities, ICC agreement between intraoperative assessment, and radiologist assessment at the 3:00 o'clock, 11:30, and point halfway between was 0.82 (P<.001), 0.78 (P < .001), 0.84 (P < .001), respectively. Radiologist interrater ICC agreement at the same points was 0.88 (P < .001), 0.93 (P < .001), and 0.88 (P < .001). Strong agreement was found between radiologic and arthroscopic measurement of labrum width when using MRI, suggesting MRI is an accurate way to measure labral width. There was not a significant difference between different MRI modalities. Accurately measuring labral width preoperatively with MRI may aid in surgical decision making. Level II, diagnostic study.

Abstract 240: Smartphone Application to Provide Real-Time Cardiopulmonary Resuscitation Quality Feedback

Introduction: Quality of cardiopulmonary resuscitation (CPR) contributes significantly to morbidity and mortality in both in-hospital and out-of-hospital cardiac arrest. Key parameters that determine the CPR quality are compression rate, compression depth, duration of interruptions, chest recoil factor and respiratory rate. Several studies have demonstrated that real-time audiovisual feedback improves CPR quality in both bystanders and hospital staff. This study aims to develop and validate a smart device (phones and wearable technology) application to provide real-time audiovisual and haptic feedback to optimize CPR quality, by calculating aforementioned chest compression parameters. Hypothesis: A mobile application using acceleration sensor data from smart devices can provide accurate real time CPR quality feedback. Methods: A mobile application was developed to track the compression depth, compression rate and pause duration in real time using the data captured from the on-device accelerometer. The mobile device was placed on an adult manikin’s chest along the midline close to the point of compressions. Data from the application was compared directly to data obtained from a validated clinical standard CPR quality tool. Results: CPR quality parameters were obtained from the app and the standard for 60, 10-second-long sessions. Bland-Altman plot analysis for compression depth showed agreement between the app measurements and standard within +/-3.5mm (Figure 1). The intraclass correlation for agreement in the measurement of compression count was 0.92 (95% CI: 0.88-0.95), indicative of very strong agreement. Conclusions: Smart device (phones and wearable technology) applications using acceleration sensor data can accurately provide real-time CPR quality feedback. With further development and validation they can provide a ubiquitous CPR feedback tool valuable for out of hospital arrests and in under-privileged areas worldwide.

Validation and psychometric evaluation of the Italian version of the Spinal Cord Injury Secondary Conditions Scale.

Validation cross-sectional study. To adapt the Spinal Cord Injury Secondary Conditions Scale (SCI-SCS) to Italian and to assess the validity and reliability of this instrument. Multicentre study in outpatient clinics of three urban spinal units across Italy. After a five-step translation/validation process, the Italian SCI-SCS was administered in a toolset composed of a sociodemographic questionnaire, the Modified Barthel Index, the Short-Form 8, the Patient Health Questionnaire 9, and the General Anxiety Disorder 7. The Italian SCI-SCS construct validity was assessed through exploratory factor analysis (EFA). The internal consistency and test-retest reliability of the instrument were evaluated using Cronbach's α and the intraclass correlation coefficient (ICC) for the total scale and its subscales. Pearson's correlation coefficient with all administered instruments was calculated to evaluate the concurrent validity. One-hundred fifty-six participants were recruited from February to October 2018. EFA suggested a three-factor structure explaining 45% of the total variance. After experts' consideration about the clinical relevance of its components, a final version of the Italian SCI-SCS with four different subscales and 15 items was proposed. The total scale Cronbach's α was 0.73. The ICC agreement for test-retest reliability was 0.91. Correlations of the Italian SCI-SCS with the administered instruments were statistically significant (p < 0.05), highlighting congruent hypothesized relations. Findings of this study provided a first psychometric evaluation of the SCI-SCS. The modified Italian version of this tool may represent a valuable instrument for the longitudinal assessment of the impact of secondary conditions in people with SCI.

Analysis of the reliability of a multidimensional complexity scale instrument (COMID) for home care nurses

Introduction: The increasingly frequent mention of complexity by different health care actors challenges the measurement of this construct. The COMID, a tool that helps home nurses to identify complex situations, provides a multidimensional and operational definition of complexity.Context: While an acceptability study showed that nurses took a keen interest in the COMID, its psychometric properties have not yet been examined.Objective: This article reports on two studies testing the reliability of the scale.Method: Study 1 focuses on 5,401 COMIDs completed by home care nurses in their usual practice. The internal consistency was estimated using Cronbach's alpha. Study 2 focuses on 38 COMIDs, completed by home care nurses (rater group 1) and specialized nurses (rater group 2). Inter-rater agreement was examined using an intraclass correlation coefficient (ICC).Results: The COMID has an acceptable internal consistency α = 0.797 and an excellent inter-rater agreement ICC = 0.839.Discussion: The metrological properties of the COMID will need to be complemented by an analysis of its validity. Conclusion: The COMID has good measurement accuracy and therefore has good potential for identifying complexity in nursing practice.