Weighted Kappa Values Research Articles

Test-retest reliability of Brazilian version of Memorial Symptom Assessment Scale for assessing symptoms in cancer patients.

ABSTRACTObjective To assess the test-retest reliability of the Memorial Symptom Assessment Scale translated and culturally adapted into Brazilian Portuguese.Methods The scale was applied in an interview format for 190 patients with various cancers type hospitalized in clinical and surgical sectors of the Instituto Nacional de Câncer José de Alencar Gomes da Silva and reapplied in 58 patients. Data from the test-retest were double typed into a Microsoft Excel spreadsheet and analyzed by the weighted Kappa.Results The reliability of the scale was satisfactory in test-retest. The weighted Kappa values obtained for each scale item had to be adequate, the largest item was 0.96 and the lowest was 0.69. The Kappa subscale was also evaluated and values were 0.84 for high frequency physic symptoms, 0.81 for low frequency physical symptoms, 0.81 for psychological symptoms, and 0.78 for Global Distress Index.Conclusion High level of reliability estimated suggests that the process of measurement of Memorial Symptom Assessment Scale aspects was adequate.

Development of a Standardized Kalamazoo Communication Skills Assessment Tool for Radiologists: Validation, Multisource Reliability, and Lessons Learned.

The purpose of this study was to develop and test a standardized communication skills assessment instrument for radiology. The Delphi method was used to validate the Kalamazoo Communication Skills Assessment instrument for radiology by revising and achieving consensus on the 43 items of the preexisting instrument among an interdisciplinary team of experts consisting of five radiologists and four nonradiologists (two men, seven women). Reviewers assessed the applicability of the instrument to evaluation of conversations between radiology trainees and trained actors portraying concerned parents in enactments about bad news, radiation risks, and diagnostic errors that were video recorded during a communication workshop. Interrater reliability was assessed by use of the revised instrument to rate a series of enactments between trainees and actors video recorded in a hospital-based simulator center. Eight raters evaluated each of seven different video-recorded interactions between physicians and parent-actors. The final instrument contained 43 items. After three review rounds, 42 of 43 (98%) items had an average rating of relevant or very relevant for bad news conversations. All items were rated as relevant or very relevant for conversations about error disclosure and radiation risk. Reliability and rater agreement measures were moderate. The intraclass correlation coefficient range was 0.07-0.58; mean, 0.30; SD, 0.13; and median, 0.30. The range of weighted kappa values was 0.03-0.47; mean, 0.23; SD, 0.12; and median, 0.22. Ratings varied significantly among conversations (χ26 = 1186; p < 0.0001) and varied significantly by viewing order, rater type, and rater sex. The adapted communication skills assessment instrument is highly relevant for radiology, having moderate interrater reliability. These findings have important implications for assessing the relational competencies of radiology trainees.

Diagnostic performance and reproducibility of T2w based and diffusion weighted imaging (DWI) based PI-RADSv2 lexicon descriptors for prostate MRI

PurposeTo examine the diagnostic performance of PI-RADSv2 T2w and diffusion weighted imaging (DWI) based lexicon descriptors, inter-observer agreement for descriptor assignment and diagnostic accuracy of the PI-RADSv2 assessment categories for multiparametric prostate MRI. Materials and methods176 lesions in 79 consecutive patients are analyzed, lesions are histopathologically verified by MRI-ultrasound fusion biopsy. All lesions are rated according to the PI-RADSv2 lexicon, descriptors for T2w and DWI sequences and resulting assessment categories are assigned by two independent blinded radiologists. We perform receiver-operating-characteristic analysis using the assessment categories. To analyze inter-observer agreement, we calculate weighted kappa values for assessment category assignment and unweighted kappa values for descriptor assignment. ResultsPI-RADSv2 assessment categories yield an area under the curve of 0.76/0.74 (radiologist 1/radiologist 2), P >0.05. Weighted kappa for agreement is 0.601 in the peripheral zone and 0.580 in the transition zone. We detect a difference in the cancer rate for PI-RADSv2 category 3 between peripheral zone (32%) and transition zone (12%), P <0.05. We obtain moderate agreement at most for descriptor assignment with kappa values ranging from 0.082 (T2w shape in the transition zone) to 0.407 (T2w signal intensity in the peripheral zone) and 0.493 (ADC pattern in the peripheral zone). Our analysis corroborates typical descriptors for benign/malignant lesions, but also reveals insights into potential pitfalls − T2w wedge shaped lesions in the peripheral zone have a considerable cancer rate, despite being labelled category 2 in the lexicon. ConclusionAgreement for descriptor assignment in the PI-RADSv2 lexicon is at most moderate in our study. Typical descriptors for benign and malignant lesions are validated, whereas the discriminatory power of some descriptors is challenged. The difference in the cancer rate for PI-RADSv2 category 3 between peripheral zone and transition zone should be considered when management recommendations are linked to assessment categories in the future.

Reliability in cardiotocography interpretation - impact of extended on-site education in addition to web-based learning: an observational study.

Previous studies have shown poor reproducibility in cardiotocography (CTG) interpretation. Studies evaluating the Swedish web-based CTG-education program have not proven to increase accurate CTG assessments. The aim of this study was to evaluate whether an extended education can improve inter- and intra-observer reliability in CTG interpretation. Six obstetricians from two different departments interpreted 106 CTG tracings on two occasions. Both departments used a Swedish national web-based CTG education and test for training. One department had, in addition, an extended education program consisting of on-site lectures and oral examinations. Inter- and intra-observer agreements were calculated by simple or weighted kappa (κ) values for the five parameters assessed on CTG. In both departments inter-observer and intra-observer κ showed moderate to excellent agreement (ranges for κ 0.41-0.76 and 0.65-0.93, respectively). Obstetricians at the department with extended CTG education had better inter-observer reliability for variability and accelerations. This was also the case for intra-observer reliability with the addition of baseline frequency. Both inter- and intra-observer agreement increased from moderate to substantial in both departments when decelerations were dichotomized into harmless (including early and simple variable decelerations) or hypoxic (including late, severe variable, prolonged and combined decelerations) (κ 0.63-0.78) compared with the current sub-classification of decelerations (κ 0.42-0.65). Agreement in CTG interpretation was better than expected in both departments, especially when divided into harmless/hypoxic changes. Combination of different learning methods (web-based, on-site lectures and case discussion) might result in a better CTG interpretation agreement compared with web-based learning solely.

Concordance between the TIRADS ultrasound criteria and the BETHESDA cytology criteria on the nontoxic thyroid nodule

BackgroundThyroid nodule is a common disorder of the thyroid. Despite their benign nature, they can be associated with multiple pathologic conditions, including thyroid cancer.MethodsThis cross-sectional study determined the concordance of Ultrasound (TIRADS criteria) and Fine Needle Aspiration Biopsy (FNA-BETHESDA system) in the assessment of the nontoxic thyroid nodule. A total of 180 subjects 18 years old or older underwent the two diagnostic tests and their results were compared using kappa index.ResultsParticipants were mostly women, with average age of 57 years. The frequency of BETHESDA II was 65/180 versus 45/180 in TIRADS 2. In contrast, the highest frequency in category 4-IV was 62/180 for TIRADS 4 versus 41/180 for BETHESDA IV. The highest concordance was found among the category 2-II classification. The observed agreement was 87.2% with a linear weighted kappa of 0.69 (95% CI: 0.59-0.79). The heterogeneity analysis showed a trend towards a higher weighted kappa value in nodules ≥4 cm in males and individuals aged ≥50 years, with accelerated nodular growth, binding to adjacent structures, vocal folds paralysis, urban origin, and a history of head and neck radiation therapy.ConclusionsThe TIRADS criteria has a good concordance with the Bethesda system. The ultrasound findings of benign pathology are aligned with the cytology results. The correct interpretation of the two findings helps the clinician to reduce the risk of unnecessary invasive procedures in patients with a low probability of presenting thyroid cancer, while facilitating the identification of patients at higher risk of cancer.

Poorly differentiated clusters as a prognostic marker at the invasive front of colon cancer.

621 Background: Histology at the invasive front of colon cancer can predict malignant potential. However, the optimal histological marker is yet to be established. This study compares the various invasive front histologic markers. Methods: A single-institution prospective database was queried for consecutive patients who underwent curative resection for Stage I-III colon adenocarcinoma from 2007-14. Histologic features were reviewed by a pathologist, including poorly differentiated clusters (PDC), tumor budding (BD), perineural invasion (PN), desmoplastic reaction (DR) and Crohn’s like reaction (CLR) at the invasive front, and WHO grade of the whole tumor. PDC was defined as cancer clusters of ≥ 5 cancer cells that lack a gland-like structure, and was graded into G1 ( &lt; 5), G2 (5-9) and G3 ( ≥ 10) by the highest number of the clusters /HPF. Clinical outcome included recurrence free survival (RFS) and peak hazard function of recurrence and death identified using the kernel-smoothing method. Predictive accuracy was measured with concordance probability estimate (CPE) for proportional hazards regression. Inter-observer agreement was assessed by weighted kappa values on diagnoses rendered by 3 pathologists on 50 randomly selected cases. Results: The study cohort consisted of 851 patients with a median follow up of 36 months. PDC, BD, PN, DR and CLR at the invasive front were significantly associated with RFS. When analyzed by stage, PDC, BD and PN were associated with RFS both in Stage II and Stage III, while the others were prognostic only in Stage III. CPE was the highest in PDC (0.642), indicating the best predictive accuracy, while it was the lowest in WHO grade (0.526). Weighted kappa was also the highest for PDC, indicating the best inter-observer agreement (PDC: 0.824, WHO grade: 0.568). The smoothed graph of the hazard function showed that the risk of recurrence was not only the highest but peaked earlier for PDC G3 (between0 and 12 months) than PDC G2 (between12 and 24 months) and G1 (no evident peak). Conclusions: Of the commonly evaluated histologic markers at the invasive front, PDC grade is the most predictive and reproducible. Further confirmatory investigations are warranted to determine if PDC can replace WHO grade.

Uso da radiografia transcraniana para detectar alterações morfológicas no côndilo mandibular

RESUMO Objetivo: o objetivo deste estudo foi avaliar a acurácia das radiografias transcranianas (TRANS) convencionais na identificação das alterações morfológicas nos côndilos mandibulares. Métodos: a amostra consistiu em 36 côndilos mandibulares, obtidos a partir de 18 crânios secos humanos, aleatoriamente selecionados, sem identificação de idade, gênero ou etnia. Três especialistas em radiologia oral examinaram as TRANS para identificar possíveis alterações nos côndilos. Um quarto examinador realizou o exame macroscópico, que foi considerado o padrão ouro do estudo. As imagens das TRANS e os exames macroscópico foram classificados como (1) côndilos com alteração ou (0) côndilos sem alteração. A análise estatística foi realizada através do teste X 2 e da curva ROC (receiver operator characteristic). O teste Kappa intra e interexaminadores foi realizado para os examinadores 1 a 3. Resultados: o teste X2 mostrou uma associação estatisticamente significativa entre as alterações no côndilo vistas nas imagens TRANS e a presença de alterações macroscópicas (p ( 0,05). A área sob a curva ROC foi de 0,83, com 96% de sensibilidade e 70% de especificidade. O valor Kappa para a concordância intraobservador foi de 0,78, enquanto que a concordância interexaminador foi de 0,71. Conclusão: o uso de radiografias transcranianas apresentou-se como método eficaz para a detecção de alterações morfológicas no côndilo mandibular.

Intertester and intratester reliability of movement control tests on the hip for patients with hip osteoarthritis

BackgroundHip joint complaints are a problem associated with increasing age and impair the mobility of a large section of the elderly population. Reliable and valid tests are necessary for a thorough investigation of a joint. A fundamental function of the hip joint is movement control and a test of this function forms a part of the standard examination. Until now there have been few scientific studies which specifically investigate the reliability of measurement tests of movement control of the hip joint. The aim of this study was to examine the intratester and intertester reliability of the movement control tests of the hip joint which are in use in current clinical practice.MethodsSixteen participants with hip joint complaints and 14 without hip joint impairment were recruited. All participants performed five active movement control tests for the hip joint and were video filmed whilst performing these tests. These films formed the basis for the evaluation and were assessed by two independent physiotherapists. For the intertester and intratester reliability calculations specially set weighted kappa values and the calculated percentages were used.ResultsThe intertester reliability of the five examined movement control tests of the hip joint showed good to almost perfect values (weighted kappa (wk) = 0.56–0.87). The intratester reliability of the more experienced evaluator A was better in regards to the less experienced evaluator B (average wk = 0.62 vs 0.38).ConclusionThe visual evaluation of movement control tests of the hip joint is especially reliable when carried out by an experienced evaluator. 4 out of 5 tests also showed good results for intertester reliability and support their use in clinical practice.

Plus Disease in Retinopathy of Prematurity: Diagnostic Trends in 2016 Versus 2007

To identify any temporal trends in the diagnosis of plus disease in retinopathy of prematurity (ROP) by experts. Reliability analysis. ROP experts were recruited in 2007 and 2016 to classify 34 wide-field fundus images of ROP as plus, pre-plus, or normal, coded as "3," "2," and "1," respectively, in the database. The main outcome was the average calculated score for each image in each cohort. Secondary outcomes included correlation on the relative ordering of the images in 2016 vs 2007, interexpert agreement, and intraexpert agreement. The average score for each image was higher for 30 of 34 (88%) images in 2016 compared with 2007, influenced by fewer images classified as normal (P < .01), a similar number of pre-plus (P= .52), and more classified as plus (P < .01). The mean weighted kappa values in 2006 were 0.36 (range 0.21-0.60), compared with 0.22 (range 0-0.40) in 2016. There was good correlation between rankings of disease severity between the 2 cohorts (Spearman rank correlation ρ= 0.94), indicating near-perfect agreement on relative disease severity. Despite good agreement between cohorts on relative disease severity ranking, the higher average score and classifications for each image demonstrate that experts are diagnosing pre-plus and plus disease at earlier stages of disease severity in 2016, compared with 2007. This has implications for patient care, research, and teaching, and additional studies are needed to better understand this temporal trend in image-based plus disease diagnosis.

Evaluation of dental arch relationship of patients with bilateral cleft lip and palate applying bilateral yardstick

Aims: This study aims to verify the applicability and reliability of the Bilateral yardstick on the assessment of interarch relationship in patients with bilateral cleft lip and palate (BCLP) through three-dimensional (3D) virtual casts. Setting and Design: A total of 112 individuals with BCLP, aging 6–12 years old, with no associated syndromes, free from previous orthodontic treatment and from secondary bone grafting. Methods: Plaster casts from the 112 individuals were obtained, randomly numbered and scanned, generating a 3D digital image. Three calibrated orthodontists used the Bilateral yardstick to classify, in two rounds, the interarch relationship on the virtual casts. Descriptive statistics were employed to describe the frequencies of the scores of the Bilateral yardstick. Weighted Kappa statistics were calculated to determine intra- and inter-rater reliability. Results: Raters reported no difficulties in the employment of the Bilateral yardstick on 3D virtual casts. Good occlusal relationship or minor deviation was observed in 60 (53.6%) individuals. No more than 13 (11.6%) patients were classified as having a poor arch form. Intraexaminer kappa values were higher than 0.93 (confidence interval [CI] 0.88–0.98), and interexaminer agreement was higher than 0.78 (CI 0.69–0.87). Conclusion: Bilateral yardstick proved to be applicable to the assessment of dental arch relationship of patients with BCLP through 3D virtual casts. Weighted kappa values indicated good intrarater and good-to-very good agreement, supporting the reliability of this yardstick when employed to virtual casts. Further studies should be encouraged to face the actual lack of evidence in this field.

Interobserver Variability of Breast Ultrasound Categorization Modified by the Abcs-K for the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (Must Be) Trial

To evaluate interobsever variability of breast ultrasound categorization based on the Breast Imaging Reporting and Data system (BI-RADS) and modified by the Alliance for Breast Cancer Screening in Korea (ABCS-K). Ten breast radiologists with 3-16 years of experience participated in a quality control workshop in March 2016 for the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST BE) trial. Two investigators selected 125 sets of breast lesions, those were pathologically proven to be malignant or clinically proven to be benign showing stability for at least 2-years, and prepared power point slides showing 2 representative orthogonal images per each lesion. After a brief lecture about the modified categorization, 10 radiologists independently categorized the lesions blinding to mammographic images and pathologic results. The interobserver variability were measured using kappa statistics. The overall and overall weighted kappa values for the modified categorization (2, 3, 4, and 5) were 0.52 and 0.72, respectively. The overall kappa value was 0.66 when dichotomizing the interpretation into benign (BI-RADS 1, 2, and 3) or suspicious (BI-RADS 4, 5). However, those for the subdividing category 4 (a, b, and c) were 0.37 and 0.56, respectively. The overall kappa value was increased up to 0.48 when dichotomizing the interpretation into low suspicion (BI-RADS 4a) or over moderate suspicion (BI-RADS 4b and 4c). In the modified categorization, ABCS-K radiologists showed moderate interobserver agreements for the decision of biopsy (category 2, 3 vs. 4, 5) and fair agreements for the subdividing category 4. More clear guidance for the modified categorization and further effort to improve interobserver agreements are needed for successful performance of MUST BE trial.

A Retrospective Analysis of the Effectiveness of MRI and Ultrasound in Identifying Rotator Cuff Tears

Magnetic Resonance Imaging (MRI) and Ultrasound (US) imaging are both routinely used in the assessment of rotator cuff pathology. Factors influencing the frequency of use of the respective technologies include access to equipment, provider preference, and cost. The purpose of our study was to compare the accuracy of in clinic ultrasound with that of MRI in diagnosing pathology of the rotator cuff in a large sample size with limited exclusionary criteria. 500 patient profiles assessed by each imaging type, MRI and ultrasound, who then proceeded to arthroscopic surgery were gathered and analyzed for interobserver agreement between the image interpretation and the surgical observations. While ultrasound displayed slightly higher sensitivity and specificity ratings in the diagnosis of full tears (0.90 and 0.92 vs. 0.86 and 0.91), MRI had a higher sensitivity (0.87 vs. 0.80) and Ultrasound had a higher specificity (0.86 vs. 0.76) for general cuff damage. The Weighted Kappa Values for both MRI (0.699) and Ultrasound (0.668) both indicate a substantial strength of agreement between the image interpretation and surgical findings. While there was a balanced distribution of errors observed in the MRI category, the most common error made in the Ultrasound assessment was a false negative assessment of a partial tear. The data indicate that in a clinical setting Ultrasound imaging is a cost-effective and accurate alternative to MRI and can be a valuable addition to the diagnostic assessment of rotator cuff injury and pathology.

Hip Preservation Surgery Expectations Survey: A New Method to Measure Patients' Preoperative Expectations

To develop a patient-derived expectations survey for hip preservation surgery. Patients were eligible if they were undergoing primary hip surgery and were recruited in person or by telephone. The survey was developed in 3 phases. During phase 1, 64 patients were interviewed preoperatively and asked open-ended questions about their expectations of surgery; a draft survey was assembled by categorizing responses. During phase 2, the survey was administered twice to another group of 50 patients preoperatively to assess test-retest reliability and concordance was measured with weighted kappa values and intraclass correlations. All patients also completed valid standard hip surveys electronically. During phase 3, final items were selected, factor analysis was performed, and a scoring system was developed. In phase 1, 509 expectations were volunteered from which 21 distinct categories were discerned and became the items for the draft survey. In phase 2, the draft survey was completed twice, 4days apart. In phase 3, all 21 items were retained for the final survey addressing pain, mobility, sports, resumption of active lifestyles, future function, and psychological well-being. An overall score is calculated from the number of items expected and the amount of improvement expected, and ranges from 0 to 100; higher is more expectations. For phase 2 patients, mean scores for both administrations were 82, Cronbach alpha coefficients were 0.88 and 0.91, and the intraclass correlation was 0.92. A higher score (i.e., greater expectations) was associated with worse hip condition measured by standard hip surveys (P≤ .05). We developed a patient-derived survey that is valid, reliable, and addresses a spectrum of expectations. The survey generates an overall score that is easy to calculate and interpret and offers a practical and comprehensive way to record patients' preoperative expectations. Level II, prognostic study, prospective sample.

Which Diet-Related Behaviors in Childhood Influence a Healthier Dietary Pattern? From the Ewha Birth and Growth Cohort.

This study was performed to examine how childhood dietary patterns change over the short term and which changes in diet-related behaviors influence later changes in individual dietary patterns. Using food frequency questionnaire data obtained from children at 7 and 9 years of age from the Ewha Birth and Growth Cohort, we examined dietary patterns by principal component analysis. We calculated the individual changes in dietary pattern scores. Changes in dietary habits such as eating a variety of food over two years were defined as “increased”, “stable”, or “decreased”. The dietary patterns, termed “healthy intake”, “animal food intake”, and “snack intake”, were similar at 7 and 9 years of age. These patterns explained 32.3% and 39.1% of total variation at the ages of 7 and 9 years, respectively. The tracking coefficient of snack intake had the highest coefficient (γ = 0.53) and that of animal food intake had the lowest (γ = 0.21). Intra-individual stability in dietary habits ranged from 0.23 to 0.47, based on the sex-adjusted weighted kappa values. Of the various behavioral factors, eating breakfast every day was most common in the “stable” group (83.1%), whereas consuming milk or dairy products every day was the least common (49.0%). Moreover, changes in behavior that improved the consumption of milk or dairy products or encouraged the consumption of vegetables with every meal had favorable effects on changes in healthy dietary pattern scores over two years. However, those with worsened habits, such as less food variety and more than two portions of fried or stir-fried food every week, had unfavorable effects on changes in healthy dietary pattern scores. Our results suggest that diet-related behaviors can change, even over a short period, and these changes can affect changes in dietary pattern.

Cone-beam Computed Tomography Uses in Clinical Endodontics: Observer Variability in Detecting Periapical Lesions

IntroductionThe accurate interpretation of a cone-beam computed tomographic (CBCT) volume is critical in identifying the presence of disease correctly and consistently. The aim of this clinical study was to determine the effect of experience level on the detection of periapical lesions in CBCT volumes. MethodsCBCT volumes of 22 maxillary molars were interpreted by 3 endodontic faculty, 3 endodontic residents, and 3 dental students. These groups were compared with the consensus opinion of 2 experienced oral and maxillofacial radiologists. The observers determined the presence or absence of apical radiolucencies for each root using a 5-point Likert scale. ResultsCompared with the radiologists, the average weighted kappa value for endodontic faculty was 0.49, for endodontic residents it was 0.35 and for dental students it was 0.32. Intrarater reliability for each group showed endodontic faculty having the highest average weighted kappa value of 0.68 followed by endodontic residents (0.48) and dental students (0.28). ConclusionsClinicians' experience level appears to be correlated with their ability to correctly diagnose periapical disease in CBCT volumes. In addition, experience leads to better inter-rater reliability. In neither of these 2 categories was agreement found to be excellent, suggesting that more can be done to improve the CBCT interpretation skills of clinicians at various levels of experience.

The use of the Core Outcome Measures Index (COMI) in patients undergoing total knee replacement

BackgroundThe Core Outcome Measure Index (COMI) is a very short outcome instrument used in spine patients. The aim of this study was to examine the utility of a knee version of the COMI in patients undergoing total knee arthroplasty (TKA) by assessing the reproducibility, construct and discriminant validity, and responsiveness. MethodsPreoperatively, 224 patients completed the Oxford Knee Score (OKS), EuroQoL (EQ-5D) and the COMI-Knee; 189 (84) % also completed the questionnaires at follow-up and 73 patients completed preoperatively the COMI-knee twice. ResultsThe weighted kappa values for the COMI-knee single items ranged from 0.80 to 0.89 and the ICC for the COMI-knee (composite score), 0.86. The absolute SEM for COMI-knee was 0.4 points, i.e. four percent of the maximum value (10 points) and six percent of the average value (6.6 points). The Area Under the Curve derived from the Receiver Operating Characteristic method for the COMI-knee was 0.97 (95% CI, 0.93 to 0.99), with a cut-off value for indicating a “good” result of 2.3 (100% specificity, 87% sensitivity). Correlations between the COMI-knee and the OKS were −0.72 at baseline and −0.87 at six months. The correlations between the change scores for the COMI-knee and the change scores for the OKS and EQ5D index were 0.77 and 0.69, respectively. ConclusionsThe measurement properties of the COMI-knee satisfy international quality criteria and hence support its use in assessing patients undergoing TKA.

The Genovese grading scale is not reliable for MR assessment of collagen meniscus implants

BackgroundThe purpose of the study was to evaluate the intra- and inter-observer reliabilities of the Genovese grading on MRI in patients after collagen meniscus substitution. Methods84 MRI images of 74 consecutive patients who underwent partial meniscus substitution using collagen meniscus implant (CMI) were assessed. MRIs were evaluated using the Genovese grading system. Furthermore, meniscal extrusion was assessed. Two observers performed the grading twice, blinded to each other and to the previous results, with a six weeks interval. The inter- and intra-observer reliabilities were assessed using kappa and weighted kappa values. ResultsThe criterion “morphology/size” showed a weighted kappa value inter-observer reliability of 0.069 (rater 1)/0.352 (rater 2) and intra-observer reliability of 0.170 (1st rating)/0.582 (2nd rating).The criterion “signal intensity” showed a weighted kappa value inter-observer reliability of 0.175/0.284 and intra-observer reliability of 0.294/0.458. The criterion “cartilage lesions” showed a kappa value inter-observer reliability of 0.091/0.525 and intra-observer reliability of 0.409/0.413. The criterion “bone marrow edema” showed a kappa value inter-observer reliability of 0.667/0.808 and intra-observer reliability of 0.702/0.715. The criterion “cartilage lesions” showed a kappa value inter-observer reliability of 0.091/0.525 and intra-observer reliability of 0.409/0.413. Regarding meniscal extrusion kappa values for the inter-observer reliability were 0.625/0.940 and 0.625/0.889 for intra-observer reliability. ConclusionsThree of the four Genovese grading items showed only slight to moderate inter- and intra-observer reliabilities in evaluating CMI on MRI. Hence, such grading results need to be considered with all due care. Only the criteria “bone marrow edema” and “meniscal extrusion” showed a good agreement for both inter- and intra-observer reliabilities.

Reliability and Validity of a Simplified Comprehensive Assessment Tool for Feeding Support: Kuchi-Kara Taberu Index.

To verify the reliability and validity and develop an English version of an instrument (Kuchi-Kara Taberu Index (KT Index)) to comprehensively assess and intervene in problems with eating and swallowing. Multicenter cross-sectional study. Nursing homes. Individuals aged 65 and older (mean age 88.3 ± 6.8; 80.0% female) who had lived in a nursing home for longer than 1 month (N = 115). The KT index consisted of 13 items: desire to eat, overall condition, respiratory condition, oral condition, cognitive function while eating, oral preparatory and propulsive phases, dysphagia severity, position and endurance while eating, eating, daily life, food intake level, food modification, and nutrition. Weighted kappa coefficients, Cronbach alpha, and Spearman rank correlation coefficients were determined. Weighted kappa values in the inter- and intrarater reliability tests ranged from 0.54 to 0.96 and 0.68 to 0.98, respectively. Cronbach alpha was 0.892. Spearman rank correlation coefficients (r) between the total KT index and external criteria were determined (Functional Oral Intake Scale, r = 0.790; Barthel Index, r = 0.830; Mini Nutritional Assessment Short Form, r = 0.582; Cognitive Performance Scale, r = -0.673; all P < .001). Similar correlations were observed when some items related to each external criterion were removed from the total KT index. Translation-retranslation procedures were conducted to develop an English version of the KT index. The study provided evidence of the reliability and validity of the KT index and developed an English version. Future studies regarding validation of health-related quality of life indices and their effect on clinical courses of eating and swallowing conditions are needed.

Accuracy of Liver Fat Quantification With Advanced CT, MRI, and Ultrasound Techniques: Prospective Comparison With MR Spectroscopy.

The purpose of this study was to prospectively evaluate the accuracy of proton-density fat-fraction, single- and dual-energy CT (SECT and DECT), gray-scale ultrasound (US), and US shear-wave elastography (US-SWE) in the quantification of hepatic steatosis with MR spectroscopy (MRS) as the reference standard. Fifty adults who did not have symptoms (23 men, 27 women; mean age, 57 ± 5 years; body mass index, 27 ± 5) underwent liver imaging with un-enhanced SECT, DECT, gray-scale US, US-SWE, proton-density fat-fraction MRI, and MRS for this prospective trial. MRS voxels for the reference standard were colocalized with all other modalities under investigation. For SECT (120 kVp), attenuation values were recorded. For rapid-switching DECT (80/140 kVp), monochromatic images (70-140 keV) and fat density-derived material decomposition images were reconstructed. For proton-density fat fraction MRI, a quantitative chemical shift-encoded method was used. For US, echogenicity was evaluated on a qualitative 0-3 scale. Quantitative US shear-wave velocities were also recorded. Data were analyzed by linear regression for each technique compared with MRS. There was excellent correlation between MRS and both proton-density fat-fraction MRI (r2 = 0.992; slope, 0.974; intercept, -0.943) and SECT (r2 = 0.856; slope, -0.559; intercept, 35.418). DECT fat attenuation had moderate correlation with MRS measurements (r2 = 0.423; slope, 0.034; intercept, 8.459). There was good correlation between qualitative US echogenicity and MRS measurements with a weighted kappa value of 0.82. US-SWE velocity did not have reliable correlation with MRS measurements (r2 = 0.004; slope, 0.069; intercept, 6.168). Quantitative MRI proton-density fat fraction and SECT fat attenuation have excellent linear correlation with MRS measurements and can serve as accurate noninvasive biomarkers for quantifying steatosis. Material decomposition with DECT does not improve the accuracy of fat quantification over conventional SECT attenuation. US-SWE has poor accuracy for liver fat quantification.

Development of an Expectations Survey for Patients Undergoing Foot and Ankle Surgery.

Many authors have reported on patient satisfaction from foot and ankle surgery, but rarely on expectations, which may vary widely between patients and strongly affect satisfaction. In this study, we aimed to develop a patient-derived survey on expectations from foot and ankle surgery. We developed and tested our survey using a 3-phase process. Patients with a wide spectrum of foot and ankle diagnoses were enrolled. In phase 1, patients were interviewed preoperatively with open-ended questions about their expectations from surgery. Major concepts were grouped into categories that were used to form a draft survey. In phase 2, the survey was administered to preoperative patients on 2 occasions to establish test-retest reliability. In phase 3, the final survey items were selected based on weighted kappa values for response concordance and clinical relevance. In phase 1, 94 preoperative patients volunteered 655 expectations. Twenty-nine representative categories were discerned by qualitative analysis and became the draft survey. In phase 2, another 60 patients completed the draft survey twice preoperatively. In phase 3, 23 items were retained for the final survey. For retained items, the average weighted kappa value was 0.54. An overall score was calculated based on the amount of improvement expected for each item on the survey and ranged from zero to 100, with higher scores indicating more expectations. For patients in phase 2, mean scores for both administrations were 65 and 66 and approximated normal distributions. The intraclass correlation coefficient between scores was 0.78. We developed a patient-derived survey specific to foot and ankle surgery that is valid, reliable, applicable to diverse diagnoses, and includes physical and psychological expectations. The survey generates an overall score that is easy to calculate and interpret, and thus offers a practical and comprehensive way to record patients' expectations. We believe this survey may be used preoperatively by surgeons to help guide patients' expectations and facilitate shared decision making. Level II, cross-sectional study.