Krippendorf's Alpha Research Articles

Assessing Eye Clinic Accessibility: A Study Validating and Applying the SiteWise Survey.

To validate the SiteWise survey as a reliable tool for assessing the accessibility of outpatient ophthalmology clinics for visually impaired patients and to compare accessibility between hospital-based and satellite clinics. This quality improvement study, conducted from January to December 2023, used the SiteWise survey to assess design features in seven satellite and two hospital-based clinics within the Wilmer Eye Institute network. Independent surveyors evaluated elements such as parking, sidewalks, entrances, and interior areas. Reliability was measured using Krippendorf's alpha, and accessibility scores were compared using generalized estimated equations, analyses of variance, and t tests. The SiteWise survey demonstrated high reliability with a Krippendorf's alpha of 0.99. Hospital-based clinics had higher accessibility scores (mean 78.9%) compared to satellite clinics (mean 71.3%, P < 0.05). Areas such as hallways (mean 89%) and waiting areas (mean 87%) scored highest, whereas parking lots/sidewalks (mean 61%) and stairways (mean 61%) scored lowest, indicating significant room for improvement in these areas. The SiteWise tool is reliable and effective in identifying accessibility deficiencies in outpatient ophthalmology clinics. Although indoor areas generally scored well, outdoor and transitional spaces require significant enhancements to improve accessibility for visually impaired patients. This study bridges the gap between basic research and clinical care by providing a validated tool to assess and improve the accessibility of eye care facilities, ensuring they meet the needs of visually impaired patients.

The Japanese Esophageal Society classification for prediction of superficial esophageal squamous cell neoplasia invasion depth: Validation in a Western population.

The Japan Esophageal Society proposed the JES microvessel classification to assess eligibility of early esophageal squamous cell neoplasia (ESCN) for endoscopic resection based on intrapapillary capillary loop assessment. We aimed to assess its diagnostic reproducibility and accuracy in Western ESCN patients. Intrapapillary capillary loops on endoscopic images of Western ESCN lesions (n=113) collected between 2010 and 2022 were assessed by nine endoscopists, including three Japanese expert endoscopists, three Western expert endoscopists, and three residents-in-training, and graded according to the JES microvessel classification where microvessel type A corresponds with normality or low-grade intraepithelial neoplasia, and microvessel types B1, B2, and B3 correspond with high-grade intraepithelial neoplasia or invasion into the lamina propria, muscularis mucosae or superficial submucosa, and deep submucosa, respectively. Outcomes included overall accuracy in predicting ESCN invasion depth and interobserver agreement. Good interobserver agreement was observed among expert endoscopists (Krippendorf's alpha 0.64, 95% CI 0.57-0.70), while agreement was moderate among residents-in-training (Krippendorf's alpha 0.58, 95% CI 0.52-0.72). Overall accuracy of the JES microvessel classification was 53% (95% CI 42-63), 52% (95% CI 41-62), and 44% (95% CI 34-55) for Japanese endoscopists, Western endoscopists, and residents-in-training, respectively. Sensitivity and specificity for vessel type A, B1, B2, and B3 across assessors were 0%-50% and 89%-100%, 55%-64% and 66%-77%, 42%-71% and 60%-76%, and 10%-24% and 92%-97%, respectively. Negative predictive value ranged between 80% and 85% for B3 vessels. Overall accuracy of the JES microvessel classification in Western ESCN patients is low, though absence of B3 vessels as assessed by experienced endoscopists may predict superficial ESCN amenable to endoscopic resection. www.trialregister.nl; NL8897 (6-9-2020).

Variations in the Evaluation and Management of Vascular Rings: A Survey of American Clinicians.

Vascular rings are arterial malformations that lead to the compression of the trachea and/or esophagus. While "tight" rings often produce symptoms and require surgery, "loose" rings rarely produce symptoms. Given advances in fetal echocardiography, this diagnosis is now more often made prenatally. This poses a new conundrum in the management of asymptomatic patients, leading to practice variation and creating a target for clinical system improvement. Hence, we conducted this survey aiming to demonstrate the practice variation existing in current evaluation and management of these patients. An anonymous web-based survey was distributed to several listservs for pediatric cardiologists and pediatric cardiothoracic surgeons. Survey questions targeted respondent practice characteristics, testing obtained, and indications for testing or surgical referral. In total 61 responses were received, predominantly from pediatric cardiologists (95%) in the United States (97%). About 60% of clinicians reported frequently diagnosing patients with vascular rings by fetal echocardiogram, with only about 20% diagnosing them frequently on evaluation of symptoms. Computed tomography angiography and echocardiogram were the most common imaging modalities employed. Most clinicians obtained cross-sectional imaging at the time of diagnosis and referred to surgery once patients had at least occasional symptoms. Respondents demonstrated a low degree of agreement (Krippendorf's alpha 0.48). Few statistically significant patterns were identified between respondents based on their practice characteristics. This study identified significant variation between clinicians regarding the evaluation and management of vascular rings. Further research or expert opinions may help to standardize practice, saving costs and improving the quality of care for affected patients.

NeuroMotion smartphone application for remote General Movements Assessment: a feasibility study in Nepal

ObjectivesTo evaluate the feasibility of using the NeuroMotion smartphone application for remote General Movements Assessment for screening infants for cerebral palsy in Kathmandu, Nepal.MethodThirty-one term-born infants at risk of cerebral...

Third Molar Eruption in Dental Panoramic Radiographs as a Feature for Forensic Age Assessment-Presentation of a New Non-Staging Method Based on Measurements.

The evaluation of third molar eruption in dental panoramic radiographs (DPRs) constitutes an evidence-based approach for forensic age assessment in living individuals. Existing methodologies involve staging morphological radiographic findings and comparing them to reference populations. Conversely, the existing literature presents an alternative method where the distance between third molars and the occlusal plane is measured on dental plaster models. The aim of this study was to adapt this measurement principle for DPRs and to determine correlation between eruption and chronological age. A total of 423 DPRs, encompassing 220 females and 203 males aged 15 to 25 years, were examined, including teeth 38 [FDI] and 48. Two independent examiners conducted the measurements, with one examiner providing dual assessments. Ultimately, a quotient was derived by comparing orthogonal distances from the mesial cementoenamel junctions of the second and third molars to a simplified radiological occlusal plane. This quotient was subsequently correlated with the individual's age. We estimated correlations between age and quotients, as well as inter- and intra-rater reliability. Correlation coefficients (Spearman's rho) between measurements and individuals' ages ranged from 0.555 to 0.597, conditional on sex and tooth. Intra-rater agreement (Krippendorf's alpha) ranged from 0.932 to 0.991, varying according to the tooth and sex. Inter-rater agreement ranged from 0.984 to 0.992, with distinctions drawn for different teeth and sex. Notably, all observer agreement values fell within the "very good" range. In summary, assessing the distance of third molars from a simplified occlusal plane in DPRs emerges as a new and promising method for evaluating eruption status in forensic age assessment. Subsequent reference studies should validate these findings.

Outcomes and potential impact of a virtual hands-on training program on MRI staging confidence and performance in rectal cancer

ObjectivesTo explore the potential impact of a dedicated virtual training course on MRI staging confidence and performance in rectal cancer.MethodsForty-two radiologists completed a stepwise virtual training course on rectal cancer MRI staging composed of a pre-course (baseline) test with 7 test cases (5 staging, 2 restaging), a 1-day online workshop, 1 month of individual case readings (n = 70 cases with online feedback), a live online feedback session supervised by two expert faculty members, and a post-course test. The ESGAR structured reporting templates for (re)staging were used throughout the course. Results of the pre-course and post-course test were compared in terms of group interobserver agreement (Krippendorf’s alpha), staging confidence (perceived staging difficulty), and diagnostic accuracy (using an expert reference standard).ResultsThough results were largely not statistically significant, the majority of staging variables showed a mild increase in diagnostic accuracy after the course, ranging between + 2% and + 17%. A similar trend was observed for IOA which improved for nearly all variables when comparing the pre- and post-course. There was a significant decrease in the perceived difficulty level (p = 0.03), indicating an improved diagnostic confidence after completion of the course.ConclusionsThough exploratory in nature, our study results suggest that use of a dedicated virtual training course and web platform has potential to enhance staging performance, confidence, and interobserver agreement to assess rectal cancer on MRI virtual training and could thus be a good alternative (or addition) to in-person training.Clinical relevance statementRectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training/teaching. This study shows promising results for a virtual web-based training program, which could be a good alternative (or addition) to in-person training.Key Points• Rectal cancer MRI reporting quality is highly dependent on radiologists’ expertise, stressing the need for dedicated training and teaching.• Using a dedicated virtual training course and web-based platform, encouraging first results were achieved to improve staging accuracy, diagnostic confidence, and interobserver agreement.• These exploratory results suggest that virtual training could thus be a good alternative (or addition) to in-person training.

Differences between patients in whom physicians agree versus disagree about the preoperative diagnosis of heart failure

Study objectiveTo quantify preoperative heart failure (HF) diagnostic agreement and identify characteristics of patients in whom physicians agreed versus disagreed about the diagnosis. DesignObservational cohort study. SettingPatients undergoing major non-cardiac surgery at an academic center between 2015 and 2019. Patients40,659 patients undergoing major non-cardiac surgery, among which a stratified subsample of 1018 patients with and without documented HF was reviewed. InterventionsVia a panel of physicians frequently managing patients with HF (cardiologists, cardiac anesthesiologists, intensivists), detailed chart reviews were performed (two per patient; median review time 32 min per reviewer per patient) to render adjudicated HF diagnoses. MeasurementsAdjudicated diagnostic agreement measures (percent agreement, Krippendorf's alpha) and univariate comparisons (standardized differences) between patients in whom physicians agreed versus disagreed about the preoperative HF diagnosis. Main resultsAmong patients with documented HF, physicians agreed about the diagnosis in 80.0% of cases (consensus positive), disagreed in 13.8% (disagreement), and refuted the diagnosis in 6.3% (consensus negative). Conversely, among patients without documented HF, physicians agreed about the diagnosis in 88.0% (consensus negative), disagreed in 8.4% (disagreement), and refuted the diagnosis in 3.6% (consensus positive). The estimated agreement for the 40,659 cases was 91.1% (95% CI 88.3%–93.9%); Krippendorff's alpha was 0.77 (0.75–0.80). Compared to patients in whom physicians agreed about a HF diagnosis, patients in whom physicians disagreed exhibited fewer guideline-defined HF diagnostic criteria. ConclusionsPhysicians usually agree about HF diagnoses adjudicated via chart review, although disagreement is not uncommon and may be partly explained by heterogeneous clinical presentations. Our findings inform preoperative screening processes by identifying patients whose characteristics contribute to physician disagreement via chart review.Clinical Trial Number / Registry URL: Not applicable.

Predicting response to chemoradiotherapy in rectal cancer via visual morphologicassessmentand staging on baseline MRI: a multicenter and multireader study.

Pre-treatment knowledge of the anticipated response of rectal tumors to neoadjuvant chemoradiotherapy (CRT) could help to further optimize the treatment. Van Griethuysen et al. proposed a visual 5-point confidence score to predict the likelihood of response on baseline MRI. Aim wasto evaluatethis scorein a multicenter and multireader study setting and compare it to two simplified (4-point and 2-point) adaptations in terms of diagnostic performance, interobserver agreement (IOA), and reader preference. Twenty-two radiologists from 14 countries (5 MRI-experts,17 general/abdominal radiologists) retrospectively reviewed 90 baseline MRIs to estimate if patients would likely achieve a (near-)complete response (nCR); first using the 5-point score by van Griethuysen (1=highly unlikely to 5=highly likely to achieve nCR), second using a 4-point adaptation (with 1-point each for high-risk T-stage, obvious mesorectal fascia invasion, nodal involvement, and extramural vascular invasion), and third using a 2-point score (unlikely/likely to achieve nCR). Diagnostic performance was calculated using ROC curves and IOA using Krippendorf's alpha (α). Areas under the ROC curve to predict the likelihood of a nCR were similar for the three methods (0.71-0.74). IOA was higher for the 5- and 4-point scores (α=0.55 and 0.57 versus 0.46 for the 2-point score) with best results for the MRI-experts (α=0.64-0.65). Most readers (55%) favored the 4-point score. Visual morphologic assessment and stagingmethods can predictneoadjuvant treatment response with moderate-good performance. Compared to a previously published confidence-based scoring system, study readers preferred a simplified 4-point risk score based on high-risk T-stage, MRF involvement, nodal involvement, and EMVI.

Evaluating a 3D deep learning pipeline for cerebral vessel and intracranial aneurysm segmentation from computed tomography angiography-digital subtraction angiography image pairs.

Computed tomography angiography (CTA) is the most widely used imaging modality for intracranial aneurysm (IA) management, yet it remains inferior to digital subtraction angiography (DSA) for IA detection, particularly of small IAs in the cavernous carotid region. The authors evaluated a deep learning pipeline for segmentation of vessels and IAs from CTA using coregistered, segmented DSA images as ground truth. Using 50 paired CTA-DSA images, the authors trained (n = 27), validated (n = 3), and tested (n = 20) a deep learning model (3D DeepMedic) for cerebrovasculature segmentation from CTA. A landmark-based coregistration algorithm was used for registration and upsampling of CTA images to paired DSA images. Segmented vessels from the DSA were used as the ground truth. Accuracy of the model for vessel segmentation was evaluated using conventional metrics (dice similarity coefficient [DSC]) and vessel segmentation-specific metrics, like connectivity-area-length (CAL). On the test cases (20 IAs), 3 expert raters attempted to detect and segment IAs. For each rater, the authors recorded the rate of IA detection, and for detected IAs, raters segmented and calculated important IA morphology parameters to quantify the differences in IA segmentation by raters to segmentations by DeepMedic. The agreement between raters, DeepMedic, and ground truth was assessed using Krippendorf's alpha. In testing, the DeepMedic model yielded a CAL of 0.971 ± 0.007 and a DSC of 0.868 ± 0.008. The model prediction delineated all IAs and resulted in average error rates of < 10% for all IA morphometrics. Conversely, average IA detection accuracy by the raters was 0.653 (undetected IAs were present to a significantly greater degree on the ICA, likely due to those in the cavernous region, and were significantly smaller). Error rates for IA morphometrics in rater-segmented cases were significantly higher than in DeepMedic-segmented cases, particularly for neck (p = 0.003) and surface area (p = 0.04). For IA morphology, agreement between the raters was acceptable for most metrics, except for the undulation index (α = 0.36) and the nonsphericity index (α = 0.69). Agreement between DeepMedic and ground truth was consistently higher compared with that between expert raters and ground truth. This CTA segmentation network (DeepMedic trained on DSA-segmented vessels) provides a high-fidelity solution for CTA vessel segmentation, particularly for vessels and IAs in the carotid cavernous region.

Qualitative analysis of telephonic comprehensive medication review content and delivery.

Comprehensive medication reviews (CMRs) are offered to eligible Medicare beneficiaries to improve patient medication knowledge, identify, and address medication concerns, and empower medication self-management. However, the specific content of real-world CMRs is unclear. To qualitatively assess CMR content and delivery among telephonic CMR providers. This qualitative thematic analysis used transcriptions of audio-recorded patient interactions during CMRs from 3 telephonic medication therapy management provider organizations. Data were qualitatively analyzed using the inductive saturation model to code emergent themes by independent reviewers who met to agree themes through consensus. Intercoder reliability was calculated using Krippendorf alpha. Overall, 32 CMR transcripts from 3 organizations were analyzed in 13 rounds of coding. Intercoder reliability was >95%. A total of 21 themes were identified across 4 stages: call opening (4 themes), medication reconciliation (5 themes), clinical assessments and guidance (8 themes), and call closing (4 themes). The call opening stage included: service explanation; insurance coverage/cost; identity/privacy/recording; and patient's medication management. Medication reconciliation included: drug name, dose, frequency, and indication; medication deletion and addition; over-the-counter and vaccination assessment; drug efficacy assessment; and prescribing provider assessment. Clinical assessments and guidance included 4 core clinical assessments: allergy assessment; drug therapy problem assessment; drug-related adverse events; and medication modification; and 4 additional assessments: clinical/therapeutic guidance; cost savings guidance; diet/exercise/lifestyle guidance; and optional clinical and behavioral assessments. Call closing included: documentation; primary care provider confirmation; patient satisfaction; and call transfer. There were variations among organizations in the depth that CMR components were covered. These findings suggest provider organizations are including components that meet Centers for Medicare and Medicaid Services goals for CMRs. Yet, variations among organizations indicate a need for standardization and patient-centered measures to ensure appropriate CMR components are covered, while maintaining flexibility for pharmacists to provide patient-oriented CMRs that meet patients' clinical needs.

Remote administration of physical performance tests among persons with and without a cancer history: Establishing reliability and agreement with in-person assessment

ObjectivesTo assess the reliability of using videoconference technology to remotely administer the Short Physical Performance Battery (SPPB), including the 5-time sit-to-stand (5XSTS) and usual 4-m walk (4mWT), and the Timed Up and Go (TUG) tests and agreement with in-person administration among adults with and without cancer. MethodsParticipants from two ongoing clinical exercise trials in cancer survivors, one that included partners without cancer, comprised the available sample (n = 176; mean age 62.5 ± 11.5 years.). Remote tests were administered on two separate days by either the same or a different assessor to determine intra-rater and inter-rater reliability, respectively. We also compared tests conducted remotely and in-person using the same assessor and the same participant. Intraclass correlation coefficients (ICC) and 95% confidence intervals (95% CI) were used for all comparisons, except for the SPPB score, which used Cohen's kappa and Krippendorf's alpha for intra- and inter-rater reliability, respectively. ResultsRemote assessment of the TUG test had excellent intra-rater reliability (0.98, 95% CI 0.93–0.99), inter-rater reliability (ICC = 0.96, 95% CI 0.90–0.99), and good agreement with in-person tests (ICC = 0.88, 95% CI 0.74–0.94). The 5XSTS and 4mWT showed excellent (ICC = 0.92, 95% CI 0.84–0.96) and good (ICC = 0.87, 95% CI 0.71–0.94) intra-rater reliability, respectively, but somewhat lower inter-rater reliability (5XSTS: ICC = 0.65, 95% CI 0.34–0.83 and 4mWT: ICC = 0.62, 95% CI 0.30–0.81). Remote 5XSTS had moderate agreement (ICC = 0.72, 95% CI 0.62–0.80) and 4mWT had poor agreement (ICC = 0.48, 95% CI -0.07-0.76) with in-person tests. ConclusionsRemote assessment of common physical function tests in older adults, including those who have cancer, is feasible and highly reliable when using the same assessor. TUG may be the most methodologically robust measure for remote assessment because it is also highly reliable when using different assessors and correlates strongly with in-person testing. Adapting administration of objective measures of physical function for the remote environment could significantly expand the reach of research and clinical practice to assess populations at risk of functional decline.

Features of Visually AcceSAble Rembrandt Images: Interrater Reliability in Pediatric Brain Tumors.

At present, no evidence-based lexicon exists for pediatric intracranial tumors. The Visually AcceSAble Rembrandt Images terminology describes reproducible MR imaging features of adult gliomas for prediction of tumor grade, molecular markers, and survival. Our aim was to assess the interrater reliability of the pre-resection features of Visually AcceSAble Rembrandt Images in pediatric brain tumors. Fifty consecutive pre-resection brain MR imaging examinations of pediatric intracranial neoplasms were independently reviewed by 3 neuroradiologists. The intraclass correlation coefficient for continuous variables and the Krippendorf alpha were used to evaluate the interrater agreement. Subgroup analysis was performed for 30 gliomas. Parameters with almost perfect agreement (α > .8) included tumor location (F1) and proportion of enhancing tumor (F5). Parameters with substantial agreement (α = .61-.80) were side of tumor epicenter (F2), involvement of eloquent brain (F3), enhancement quality (F4), proportion of non-contrast-enhancing tumor (F6), and deep white matter invasion (F21). The other parameters showed either moderate (α = .41-.60; n = 11), fair (α = .21-.40; n = 5), or slight agreement (α = 0-.20; n = 1). Subgroup analysis of 30 gliomas showed almost perfect agreement for tumor location (F1), involvement of eloquent brain (F3), and proportion of enhancing tumor (F5); and substantial agreement for side of tumor epicenter (F2), enhancement quality (F4), proportion of noncontrast enhancing tumor (F6), cysts (F8), thickness of enhancing margin (F11), and deep white matter invasion (F21). The intraclass correlation coefficient for measurements in the axial plane was excellent in both the main group (0.984 [F29] and 0.982 [F30]) and the glioma subgroup (0.973 [F29] and 0.973 [F30]). Nine features of Visually AcceSAble Rembrandt Images have an acceptable interrater agreement in pediatric brain tumors. For the subgroup of pediatric gliomas, 11 features of Visually AcceSAble Rembrandt Images have an acceptable interrater agreement. The low degree of reproducibility of the remainder of the features necessitates the use of features tailored to the pediatric age group and is likely related to the more heterogeneous imaging morphology of pediatric brain tumors.

Developing and Validating the International Social and Emotional Learning Assessment: Evidence from a Pilot Test with Syrian Refugee Children in Iraq

The growing focus on social and emotional learning (SEL) for children of primary grade age in conflict-affected and fragile contexts necessitates an understanding of the effects these programs have. However, the dearth of valid and reliable measures of SEL skills in low-resource and crisis contexts has constrained the generation of this evidence. The few tools that have robust psychometric properties were developed for use in high-resource contexts; they often have usage costs, limit adaptations, and focus on adults as respondents. To address this gap, we developed the International Social and Emotional Learning Assessment (ISELA), an adaptable, cost-free, open-source, performance-based measure of self-concept, stress management, perseverance, empathy, and conflict resolution in children between ages 6 and 12. In this study, we focused on establishing the validity and reliability of the ISELA when used with Syrian refugee children in Iraq. We tested the latent structure, criterion validity, internal consistency reliability, and interrater reliability of the ISELA with 620 Syrian children. We were able to establish a theoretically grounded factor structure for all of the skills except perseverance. The ISELA can be used reliably by groups of assessors (Krippendorf's alpha&gt;.86) with strong internal consistency (KR-20&gt;.70). Our findings for criterion validity were promising but preliminary; grade and exposure to interpersonal threats demonstrated a positive association with SEL skills.

From bad to worse II: Risk amplification of the HPV vaccine on Facebook

BackgroundThe HPV vaccine is seen by many audiences as a health risk, but this perspective has seen little analysis. This study is the continuation of an analysis of the first decade of public, HPV-vaccine related Facebook posts. For this study, social amplification of risk framework concepts were analyzed to measure their relationships with post characteristics, engagement, and to see how those variables changed over time. MethodsThere were 6,506 public HPV vaccine-related Facebook posts (n = 6,506) within the first ten years after HPV vaccine's FDA approval (June 8, 2006 - June 8, 2016). Post characteristics, engagement, and social amplification of risk framework messages were coded (Krippendorf's alpha range: 0.67–1.00). ResultsHPV vaccine risk amplification messages appeared in 39.5% of posts (n = 2,568), attenuated in 2.9% of post (n = 186), with the remaining 57.7% (n = 3,752) doing neither. Compared to groups, individuals were overrepresented in authoring HPV vaccine risk amplifying messages. Hyperlinks and negative tone towards the HPV vaccine. HPV vaccine risk amplifying messages also received significantly greater reaction (r = 0.050, p < 0.0001), comment (r = 0.030, p < 0.0001), and share counts (r = 0.028, p < 0.0001). The data showed evidence of forward momentum (Durbin-Watson values) of HPV vaccine risk amplification (0.006), related ripples (0.530), and impacts (1.376). ConclusionNearly four out of every ten Facebook posts about the HPV vaccine contained messages that amplified the risk of HPV vaccine and the data suggest that these posts had momentum over time. Research must continue to address the perception of vaccine safety where the vaccine is perceived as the health threat, with deep research into online communities to discover the perceived ripples and impacts.

Lymphangitis associated with herpetic whitlow

The objective was to describe and analyze national network television news framing of contraception, recognizing that onscreen news can influence the public's knowledge and beliefs.We used the Vanderbilt Television News Archives and LexisNexis Database to obtain video and print transcripts of all relevant national network television news segments covering contraception from January 2010 to June 2014. We conducted a content analysis of 116 TV news segments covering contraception during the rollout of the Affordable Care Act. Segments were quantitatively coded for contraceptive methods covered, story sources used, and inclusion of medical and nonmedical content (intercoder reliability using Krippendorf's alpha ranged 0.6–1 for coded categories).Most (55%) news stories focused on contraception in general rather than specific methods. The most effective contraceptive methods were rarely discussed (implant, 1%; intrauterine device, 4%). The most frequently used sources were political figures (40%), advocates (25%), the general public (25%) and Catholic Church leaders (16%); medical professionals (11%) and health researchers (4%) appeared in a minority of stories. A minority of stories (31%) featured medical content.National network news coverage of contraception frequently focuses on contraception in political and social terms and uses nonmedical figures such as politicians and church leaders as sources. This focus deemphasizes the public health aspect of contraception, leading medical professionals and health content to be rarely featured.Media coverage of contraception may influence patients' views about contraception. Understanding the content, sources and medical accuracy of current media portrayals of contraception may enable health care professionals to dispel popular misperceptions.

Multishot Diffusion-Weighted MRI of the Breast With Multiplexed Sensitivity Encoding (MUSE) and Shot Locally Low-Rank (Shot-LLR) Reconstructions.

Diffusion-weighted imaging (DWI) has shown promise to screen for breast cancer without a contrast injection, but image distortion and low spatial resolution limit standard single-shot DWI. Multishot DWI methods address these limitations but introduce shot-to-shot phase variations requiring correction during reconstruction. To investigate the performance of two multishot DWI reconstruction methods, multiplexed sensitivity encoding (MUSE) and shot locally low-rank (shot-LLR), compared to single-shot DWI in the breast. Prospective. A total of 45 women who consented to have multishot DWI added to a clinically indicated breast MRI. Single-shot DWI reconstructed by parallel imaging, multishot DWI with four or eight shots reconstructed by MUSE and shot-LLR, 3D T2 -weighted imaging, and contrast-enhanced MRI at 3T. Three blinded observers scored images for 1) general image quality (perceived signal-to-noise ratio [SNR], ghosting, distortion), 2) lesion features (discernment and morphology), and 3) perceived resolution. Apparent diffusion coefficient (ADC) of the lesion was also measured and compared between methods. Image quality features and perceived resolution were assessed with a mixed-effects logistic regression. Agreement among observers was estimated with a Krippendorf's alpha using linear weighting. Lesion feature ratings were visualized using histograms, and correlation coefficients of lesion ADC between different methods were calculated. MUSE and shot-LLR images were rated to have significantly better perceived resolution (P < 0.001), higher SNR (P < 0.005), and a lower level of distortion (P < 0.05) with respect to single-shot DWI. Shot-LLR showed reduced ghosting artifacts with respect to both MUSE (P < 0.001) and single-shot DWI (P < 0.001). Eight-shot DWI had improved perceived SNR and perceived resolution with respect to four-shot DWI (P < 0.005). Multishot DWI enables increased resolution and improved image quality with respect to single-shot DWI in the breast. Shot-LLR reconstructs multishot DWI with minimal ghosting artifacts. The improvement of multishot DWI in image quality increases with an increased number of shots. 2 TECHNICAL EFFICACY STAGE: 2.

Validation and revision of the RANO Leptomeningeal Metastasis Group scorecard for response assessment.

e13546 Background: The Response Assessment in Neuro-Oncology (RANO) group has proposed a scorecard to evaluate response assessed by magnetic resonance imaging (MRI) during treatment of leptomeningeal metastasis (LM). Methods: To validate the LM-RANO scorecard, cerebrospinal MRI of 22 patients with LM from solid tumors were rated by 10 neuro-oncologists and 9 neuroradiologists at baseline and during follow-up after treatment. The original scorecard and its instructions were sent to the raters. The inter-observer agreement for the evaluation of single items was assessed using the Krippendorff alpha coefficient. The agreement between numerical parameters including scores at baseline and at follow-up after treatment and total scores was determined using the intraclass coefficient of correlation (ICC). Results: Instructions of the scorecard were not clear for the majority of raters. The alpha concordance coefficients obtained for the rating of single items at baseline and at follow-up were low (Krippendorf alpha coefficient &lt; 0.61 for all raters). The best concordances were noted for spinal nodules (0.60). The worst concordances were obtained for brain linear leptomeningeal enhancement and cranial nerve enhancement. The concordance was better among neuroradiologists than among neuro-oncologists. A poor agreement was also noted when evaluating changes between baseline and follow-up and for total scores (ICC &lt; 0.65 for the best score for all raters). Conclusions: Assessing response of LM by MRI remains challenging. The definition of a measurable lesion and the determination of response were the most important challenges. A central review is therefore recommended for clinical trials in LM. Based on this study we propose a new scorecard that will require a similar assessment as conducted here.

Determining whether Community Health Workers are ‘Deployment Ready’ Using Standard Setting

Background:Community Health Workers (CHWs) provide basic health screening and advice to members of their own communities. Although CHWs are trained, no CHW programmes have used a formal method to identify the level of achievement on post-training assessments that distinguishes “safe” from “unsafe”.Objectives:The aim of this study was to use Ebel method of standard setting for a post-training written knowledge assessment for CHWs in Neno, Malawi.Methods:12 participants agreed the definitions of a “just-deployment ready” and an “ideal” CHW. Participants rated the importance and difficulty of each question on a three-point scale and also indicated the proportion of “just-deployment ready” CHWs expected to answer each of the nine question types correctly. Mean scores were used to determine the passing standard, which was reduced by one standard error of measurement (SEM) as this was the first time any passing standard had been employed.The level of agreement across participants’ ratings of importance and difficulty was calculated using Krippendorf’s alpha. The assessment results from the first cohort of CHW trainees were analysed using classical test theory.Findings:There was poor agreement between participants on item ratings of both importance and difficulty (Krippendorf’s alphas of 0.064 and 0.074 respectively). The pass mark applied to the assessment, following adjustment using the SEM, was 53.3%. Based on this pass mark, 68% of 129 CHW trainees were ‘clear passes’, 11% ‘borderline passes’, 9% ‘borderline fails’ and 12% ‘clear fails’.Conclusions:Determining whether a CHW is deployment-ready is an important, but difficult exercise, as evidenced by a lack of agreement regarding question importance and difficulty. Future exercises should allow more time for training, discussion and modification of ratings. Based on the assessment, most CHWs trained could be considered deployment-ready, but following-up their performance in the field will be vital to validate the pass mark set.

Fathers' Representation in Observational Studies on Parenting and Childhood Obesity: A Systematic Review and Content Analysis.

The involvement of fathers in caregiving has increased substantially over the past 30 years. Yet in child and adolescent psychopathology, few studies include fathers as research participants and few present results for fathers separate from those for mothers. We test for the first time whether a similar pattern exists in research on parenting and childhood obesity. To conduct a systematic review and quantitative content analysis of observational studies on parenting and childhood obesity to (1) document the inclusion of fathers, relative to mothers, as research participants and (2) examine characteristics of studies that did and did not include fathers. This study presents new data on the number and gender of parent research participants. We searched title, abstract, and Medical Subject Headings term fields in 5 research databases (PubMed, EMBASE, Academic Search Premier, PsycINFO, and CINAHL) using terms combining parents or parenting (e.g., mother, father, caregiver, parenting style, food parenting) and obesity (e.g., obesity, body weight, overweight) or obesity-related lifestyle behaviors (e.g., diet, snacking, physical activity, outdoor play, exercise, media use). We identified and screened studies as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) published between January 2009 and December 2015, examining links between parenting and childhood obesity, including parents or caregivers as research participants, and written in English. We excluded interventions, nonhuman studies, dissertations, conference abstracts, and studies on youths with specific medical conditions. Of 5557 unique studies, 667 studies were eligible. For each of the 667 studies, 4 coders were trained to code characteristics of the study (e.g., publication year, geographic region, journal, study focus) and parent research participants (e.g., parent gender, demographic background, biological relationship with child, and residential status). We established intercoder reliability before coding the full sample of studies (mean Krippendorf's alpha = .79; average percentage agreement = 94%). Of the studies, 1% included only fathers. By contrast, 36% included only mothers. Although slightly more than 50% of studies (n = 347) included at least 1 father, only 57 studies reported results for fathers separate from those for mothers. When we combined them with studies including only fathers, 10% of studies overall reported results for fathers. Samples sizes of fathers were small compared with mothers. Of studies with fathers, 59% included 50 or fewer fathers, whereas 22% of studies with mothers included 50 or fewer mothers. The mean sample size for fathers across all eligible studies was 139, compared with 672 for mothers. Overall, fathers represented 17% of parent participants across all eligible studies. This study unequivocally demonstrates that fathers are underrepresented in recent observational research on parenting and childhood obesity. Public health implications. The underrepresentation of fathers in obesity research compromises the development of effective family interventions for childhood obesity prevention. Targeted opportunities and incentives are needed to support research with fathers.

Community pharmacy owners' views of star ratings and performance measurement: In-depth interviews

ObjectivesThe star rating system implemented by Medicare has the potential to positively affect patient health and may have financial implications for community pharmacies. Learning from owners of community pharmacies with high performance on these quality measures may help us to identify and further understand factors contributing to their success. This study described high-performing community pharmacy owners' current awareness and knowledge of star ratings, attitudes toward star ratings and performance measurement, and initiatives being offered in pharmacies that aim to improve the quality of care. MethodsQualitative interviews with owners of independent community pharmacies were conducted in Spring 2015. Fifteen community pharmacies with high performance on the star rating measures were invited to participate. Recruitment did not end until the saturation point had been reached. All interviews were transcribed verbatim. Interview data were analyzed with the use of ATLAS.ti by 2 coders trained in thematic analysis. Krippendorf's alpha was calculated to assess intercoder reliability. ResultsTen high-performing pharmacy owners participated. Analysis identified 8 themes, which were organized into the following categories: 1) current awareness and knowledge (i.e., superficial or advanced knowledge); 2) attitudes toward star ratings (positive perceptions, skeptical of performance rewards, and lack a feeling of control); and 3) pharmacy initiatives (personal patient relationships, collaborative employee relationships, and use of technology). Intercoder reliability was good overall. ConclusionInterviews with high-performing pharmacies suggested that awareness of the star rating measures, overall positive attitudes toward the star ratings, the relationships that pharmacy owners have with their patients and their employees, and the use of technology as a tool to enhance patient care may contribute to high performance on the star rating measures. Future research is needed to determine if and how these constructs are associated with pharmacy performance in a larger population.