Weighted Kappa Statistics Research Articles

Relative accuracy of emergency CT in adults with non-traumatic abdominal pain.

CT examination prior to emergency laparotomy has become ubiquitous in contemporary clinical practice, but the relative accuracy of CT in this context has not been widely reported. The aim of this study was to determine the accuracy and strength of agreement between the perceived pre-operative CT diagnosis and operative findings. Data from patients undergoing pre-operative CT prior to emergency laparotomy from January 2013 to June 2014 in a large teaching hospital were analysed. The CT diagnosis was compared with operative findings using the χ(2) test and weighted kappa statistic (Kw). Results were further analysed related to the time of day the CT was reported, anatomical location and grade of the reporting radiologist. 361 patients [median age 67 years (18-98 years); 180 males] underwent CT prior to emergency laparotomy. CT reports were deemed accurate in 318 (88.1%) cases and inaccurate in 43 (11.9%) cases, which resulted in 5 negative laparotomies in this latter cohort (11.6%, χ(2) 37.50, df 1; p < 0.0001). Accuracy and strength of agreement varied with anatomical location of the pathology; upper gastrointestinal (UGI) 75.5%, Kw 0.673 (0.531-0.815; p < 0.001); small bowel 89.9%, Kw 0.781 (0.687-0.875, p < 0.001); lower gastrointestinal (LGI) 90.4%, Kw 0.821 (0.749-0.893; p < 0.001). CT examinations reported within normal working hours had higher strength of agreement [Kw 0.832 (0.768-0.896), p < 0.001] than CTs reported out of hours [Kw 0.789 (0.721-0.857), p < 0.001], but there was no significant difference in overall accuracy (89.9 vs 86.0%; χ(2) 1.306, df 1, p = 0.253). Reporter seniority was not associated with improved diagnostic accuracy (χ(2) 1.825, df 1; p = 0.177). CT agreement with emergency operative pathology was good to excellent, but the strength of agreement varied in relation to anatomical location of pathology. Overall accuracy was 88.1% with good to excellent agreement between pre-operative CT and emergency laparotomy findings in adult patients with non-traumatic abdominal pain in the acute setting. Diagnostic accuracy of CT reporting varies with anatomical location of pathology.

Analysis of the reliability of surgeons' ability to differentiate between idiopathic and degenerative spinal deformity in adults radiologically. What descriptive parameters help them decide?

Adult spinal deformity (ASD) may be classified as idiopathic (ID) or degenerative (DD) (or other) based on classifier's perception, the reliability of and factors inherent to which remain unknown. The aim of this study is to evaluate the inter- and intra-observer reliability of surgeons' perception in differentiating ID from DD and to identify the determinants of this differentiation. From a multicentric prospective database of ASD, 179 patients were identified with the diagnosis of ID (n=103) or DD (n=76); without previous surgery; and a lumbar coronal curve larger than 20°. Standing antero-posterior and lateral X-rays of these patients were sent to five experienced spine surgeons to be identified as DD or ID (or other); followed by a second round after reshuffling. Weighted kappa statistics were used, the strength of agreement for the kappa coefficient was considered as; 0.81-1=almost perfect, 0.61-0.8=substantial, 0.41-0.60=moderate, 0.21-0.40=fair, 0.01-0.20=slight, and≤0=poor. Patients were then stratified based on the number of agreements on a total of 10 rounds as excellent (10 out of 10), good (more than 7 out of 10) and fair/poor (7 and less). These excellent and good agreements were further compared for additional radiological parameters. Agreement levels were moderate to substantial for intra but mostly fair for inter-observer comparisons. For ID patients, there were 42 cases with excellent and 38 with very good agreement whereas for DD, there were no excellent and only 17 cases with very good agreement. Upon comparison of these (ID vs DD for at least very good cases), it was seen that they were different for some coronal parameters such as lumbar Cobb angle (larger in ID, p<0.001), central sacral vertical line (CSVL) modifier (C more common in ID, p=0.007) and presence of rotatory subluxation (less common in DD, p=0.017), but very different for sagittal parameters (lumbar lordosis, sagittal vertical axis, T2 sagittal tilt, pelvic tilt, sacral slope, and global tilt; increased sagittal imbalance in DD, all p≤0.001). Surgeons in this study demonstrated reasonable (moderate to substantial) intra-observer agreement, but only fair agreement amongst them. Alarming as it may appear, we should be cautious in interpreting these results based on only radiology and no clinical information. In patients with good agreement, the most consistent radiologic determinant of degenerative ASD appeared to be the presence of sagittal imbalance.

Interobserver reliability of the Australian Spasticity Assessment Scale (ASAS).

The aim of this paper is to present the Australian Spasticity Assessment Scale (ASAS) and to report studies of its interrater reliability. The ASAS identifies the presence of spasticity by confirming a velocity-dependent increased response to rapid passive movement and quantifies it using an ordinal scale. The rationale and procedure for the ASAS is described. Twenty-two participants with spastic CP (16 males; age range 1y 11mo-15y 3mo) who had not had botulinum neurotoxin-A within 4 months, or bony or soft tissue surgery within 12 months, were recruited from the spasticity management clinic of a tertiary paediatric teaching hospital. Fourteen muscles in each child were assessed by each of three experienced independent raters. ASAS was recorded for all muscles. Interrater reliability was calculated using the weighted kappa statistic (quadratic weighting; κqw) for individual muscles, for upper limbs, for lower limbs, and between raters. The weighted kappa ranged between 0.75 and 0.92 for individual muscle groups and was 0.87 between raters. The ASAS complies with the definition of spasticity and is clinically feasible in paediatric settings. Our estimates of interrater reliability for the ASAS exceed that of the most commonly used spasticity scoring systems.

Sodium glucose co-transporter 2 inhibitors for glycemic control in type 2 diabetes mellitus: Quality of reporting of randomized controlled trials.

Background:Sodium glucose co-transporter 2 inhibitors represent a novel class of antidiabetic drugs. The reporting quality of the trials evaluating the efficacy of these agents for glycemic control in type 2 diabetes mellitus has not been explored. Our aim was to assess the reporting quality of such randomized controlled trials (RCTs) and to identify the predictors of reporting quality.Materials and Methods:A systematic literature search was conducted for RCTs published till 12 June 2014. Two independent investigators carried out the searches and assessed the reporting quality on three parameters: Overall quality score (OQS) using Consolidated Standards of Reporting Trials (CONSORT) 2010 statement, Jadad score and intention to treat analysis. Inter-rater agreements were compared using Cohen's weighted kappa statistic. Multivariable linear regression analysis was used to identify the predictors.Results:Thirty-seven relevant RCTs were included in the present analysis. The median OQS was 17 with a range from 8 to 21. On Jadad scale, the median score was three with a range from 0 to 5. Complete details about allocation concealment and blinding were present in 21 and 10 studies respectively. Most studies lacked an elaborate discussion on trial limitations and generalizability. Among the factors identified as significantly associated with reporting quality were the publishing journal and region of conduct of RCT.Conclusions:The key methodological items remain poorly reported in most studies. Strategies like stricter adherence to CONSORT guidelines by journals, access to full trial protocols to gain valuable information and full collaboration among investigators and methodologists might prove helpful in improving the quality of published RCT reports.

Staging laparoscopy improves treatment decision-making for advanced gastric cancer

To evaluate the clinical value of staging laparoscopy in treatment decision-making for advanced gastric cancer (GC). Clinical data of 582 patients with advanced GC were retrospectively analyzed. All patients underwent staging laparoscopy. The strength of agreement between computed tomography (CT) stage, endoscopic ultrasound (EUS) stage, laparoscopic stage, and final stage were determined by weighted Kappa statistic (Kw). The number of patients with treatment decision-changes was counted. A χ(2) test was used to analyze the correlation between peritoneal metastasis or positive cytology and clinical characteristics. Among the 582 patients, the distributions of pathological T classifications were T2/3 (153, 26.3%), T4a (262, 45.0%), and T4b (167, 28.7%). Treatment plans for 211 (36.3%) patients were changed after staging laparoscopy was performed. Two (10.5%) of 19 patients in M1 regained the opportunity for potential radical resection by staging laparoscopy. Unnecessary laparotomy was avoided in 71 (12.2%) patients. The strength of agreement between preoperative T stage and final T stage was in almost perfect agreement (Kw = 0.838; 95% confidence interval (CI): 0.803-0.872; P < 0.05) for staging laparoscopy; compared with CT and EUS, which was in fair agreement. The strength of agreement between preoperative M stage and final M stage was in almost perfect agreement (Kw = 0.990; 95% CI: 0.977-1.000; P < 0.05) for staging laparoscopy; compared with CT, which was in slight agreement. Multivariate analysis revealed that tumor size (≥ 40 mm), depth of tumor invasion (T4b), and Borrmann type (III or IV) were significantly correlated with either peritoneal metastasis or positive cytology. The best performance in diagnosing P-positive was obtained when two or three risk factors existed. Staging laparoscopy can improve treatment decision-making for advanced GC and decrease unnecessary exploratory laparotomy.

Process Monitoring in the Intensive Care Unit: Assessing Patient Mobility Through Activity Analysis with a Non-Invasive Mobility Sensor.

Throughout a patient's stay in the Intensive Care Unit (ICU), accurate measurement of patient mobility, as part of routine care, is helpful in understanding the harmful effects of bedrest [1]. However, mobility is typically measured through observation by a trained and dedicated observer, which is extremely limiting. In this work, we present a video-based automated mobility measurement system called NIMS: Non-Invasive Mobility Sensor . Our main contributions are: (1) a novel multi-person tracking methodology designed for complex environments with occlusion and pose variations, and (2) an application of human-activity attributes in a clinical setting. We demonstrate NIMS on data collected from an active patient room in an adult ICU and show a high inter-rater reliability using a weighted Kappa statistic of 0.86 for automatic prediction of the highest level of patient mobility as compared to clinical experts.

Agreement between circulating IGF-I, IGFBP-1 and IGFBP-3 levels measured by current assays versus unavailable assays previously used in epidemiological studies

ObjectiveLevels of insulin-like growth factor (IGF) proteins are associated with the risk of cancer and mortality. IGF assays produced by Diagnostic Systems Laboratories (DSL) were widely used in epidemiological studies, were not calibrated against recommended standards and are no longer commercially available. DesignIn a split sample study among 1471 adults participating in the Cardiovascular Health Study, we compared values obtained using DSL assays with alternative assays for serum IGF-I (Immunodiagnostic Systems, IDS), IGFBP-1 (American Laboratory Products Company, ALPCO) and IGFBP-3 (IDS). ResultsResults were compared using kernel density estimation plots, quartile analysis with weighted kappa statistics and linear regression models to assess the concordance of data from the different assays. Participants had a mean age of 77years. Results between alternative assays were strongly correlated (IGF-I, r=0.93 for DSL versus IDS; log-IGFBP-1, r=0.90 for DSL versus ALPCO; IGFBP-3, r=0.92 for DSL versus IDS). Cross tabulations showed that participants were usually in the same quartile categories regardless of the assay used (overall agreement, 74% for IGF-I, 64% for IGFBP-1, 71% for IGFBP-3). Weighted kappa also showed substantial agreement between assays (kw, 0.78 for IGF-I, 0.69 for IGFBP-1, 0.76 for IGFBP-3). Regressions of levels obtained with DSL assays (denoted X) to alternative assays were, IGF-I: 0.52X+15.2ng/ml, log-IGFBP-1: 1.01X−1.73ng/ml IGFBP-3: 0.87X+791.1ng/ml. Serum values of IGF-I, IGFBP-1 and IGFBP-3 measured using alternative assays are moderately correlated. ConclusionsCare is needed in the interpretation of data sets involving IGF analytes if assay methodologies are not uniform.

Fiabilidad y validez de la versión española de la escala de evaluación de la ansiedad prequirúrgica pediátrica modified Yale Preoperative Anxiety Scale

Introduction and objectiveTo minimise preoperative stress and increase child cooperation during induction of anaesthesia is one of the most important perioperative objectives. The modified Yale Preoperative Anxiety Scale was developed to evaluate anxiety. The aim of this study was to translate into Spanish, and validate the psychometric properties of the Spanish version of this scale. Material and methodsThe Spanish translation of the scale was performed following the World Health Organisation guidelines. During induction of anaesthesia, 81 children aged 2 to 12 years were recorded. Two observers evaluated the recordings independently. Content validity index of modified Yale Preoperative Anxiety Scale Spanish version was assessed. Weighted Kappa was calculated to measure interobserver agreement, and the Pearson correlation between the Induction Compliance Checklist and the modified Yale Preoperative Anxiety Scale was determined. ResultsThe Spanish version obtained high content validity (0.91 to 0.98). Reliability analysis using weighted Kappa statistics revealed that interobserver agreement ranged from 0.54 to 0.75. Concurrent validity was high (r=0.94; P<.001). ConclusionsValidated assessment tools are needed to evaluate interventions to reduce child preoperative anxiety. The Spanish version of the modified Yale Preoperative Anxiety Scale evaluated in this study has shown good psychometric properties of reliability and validity.

TRPM4 protein expression in prostate cancer: a novel tissue biomarker associated with risk of biochemical recurrence following radical prostatectomy.

Transient receptor potential cation channel, subfamily M, member 4 (TRPM4) messenger RNA (mRNA) has been shown to be upregulated in prostate cancer (PCa) and might be a new promising tissue biomarker. We evaluated TRPM4 protein expression and correlated the expression level with biochemical recurrence (BR) following radical prostatectomy (RP). The study included 614 patients who had undergone RP. TRPM4 immunohistochemical staining was performed on samples of benign tissue, tissue containing PIN glands and PCa tissue using a commercially available polyclonal antibody. Staining intensity was recorded by two independent observers using a four-tired semi-quantitative grading system (0, 1+, 2+, 3+) converted into H-scores. Interobserver agreement was calculated by linear weighted kappa statistics. The association between staining intensity and BR was analysed using the Kaplan-Meier estimator and uni- and multiple Cox proportional hazard regression models. Significantly higher staining intensity was found in PCa glands compared to benign glands (p < 0.001). The concordance rate in TRPM4 staining intensities for benign, PIN and PCa tissue ranged from 86.0 to 91.5 %, corresponding to linear weighted kappa values of 0.566-0.789. After adjusting for patient and tumour characteristics, patients with a higher staining intensity in PCa glands compared to matched benign glands and an H-score equal to or above the median had an increased risk of BR (HR 1.79-2.62; p = 0.01-0.03 for the two observers) when compared to patients with a lower staining intensity. TRPM4 protein expression is widely expressed in benign and cancerous prostate tissue, with highest staining intensities found in PCa. Overexpression of TRPM4 in PCa (combination of high staining intensity and a high H-score) is associated with increased risk of BR after RP.

Feasibility and clinical impact of sharing patient-reported symptom toxicities and performance status with clinical investigators during a phase 2 cancer treatment trial.

Clinicians can miss up to half of patients' symptomatic toxicities in cancer clinical trials and routine practice. Although patient-reported outcome questionnaires have been developed to capture this information, it is unclear whether clinicians will make use of patient-reported outcomes to inform their own toxicity documentation, or to prompt symptom management activities. 44 lung cancer patients that participated in a phase 2 treatment trial self-reported 13 symptomatic toxicities derived from the National Cancer Institute's Common Terminology Criteria for Adverse Events and Karnofsky Performance Status via tablet computers in waiting areas immediately preceding scheduled visits. During visits, clinicians viewed patients' self-reported toxicity and performance status ratings on a computer interface and could agree or disagree/reassign grades ("shared" reporting). Agreement of clinicians with patient-reported grades was tabulated, and compared using weighted kappa statistics. Clinical actions in response to patient-reported severe (grade 3/4) toxicities were measured (e.g. treatment discontinuation, dose reduction, supportive medications). For comparison, 45 non-trial patients with lung cancer being treated in the same clinic by the same physicians were simultaneously enrolled in a parallel cohort study in which patients also self-reported toxicity grades but reports were not shared with clinicians ("non-shared" reporting). Toxicities and performance status were reported by patients and reviewed by clinicians at (780/782) 99.7% of study visits in the phase 2 trial which used "shared" reporting. Clinicians agreed with patients 93% of the time with kappas 0.82-0.92. Clinical actions were taken in response to 67% of severe patient-reported toxicities. In the "non-shared" reporting comparison group, clinicians agreed with patients 56% of the time with kappas 0.04-0.48 (significantly worse than shared reporting for all symptoms), and clinical actions were taken in response to 44% of severe patient-reported toxicities. Clinicians will frequently agree with patient-reported symptoms and performance status, and will use this information to guide documentation and symptom management. (ClinicalTrials.gov: NCT00807573).

Anomalous Aortic Origin of Coronary Arteries in the Young: Echocardiographic Evaluation With Surgical Correlation

ObjectivesThis study sought to compare findings from institutional echocardiographic reports with imaging core laboratory (ICL) review of corresponding echocardiographic images and operative reports in 159 patients with anomalous aortic origin of a coronary artery (AAOCA). The study also sought to develop a “best practice” protocol for imaging and interpreting images in establishing the diagnosis of AAOCA. BackgroundAAOCA is associated with sudden death in the young. Underlying anatomic risk factors that can cause ischemia-related events include coronary arterial ostial stenosis, intramural course of the proximal coronary within the aortic wall, interarterial course, and potential compression between the great arteries. Consistent protocols for diagnosing and evaluating these features are lacking, potentially precluding the ability to risk stratify patients based on evidence and plan surgical strategy. MethodsFor a prescribed set of anatomic AAOCA features, percentages of missing data in institutional echocardiographic reports were calculated. For each feature, agreement among institutional echocardiographic reports, ICL review of images, and surgical reports was evaluated using the weighted kappa statistic. An echocardiographic imaging protocol was developed heuristically to reduce differences between institutional reports and ICL review. ResultsA total of 13%, 33%, and 62% of echocardiograms were missing images enabling diagnosis of intra-arterial course, proximal intramural course, and high ostial takeoff, respectively. There was poor agreement between institutional reports and ICL review for diagnosis of origin of coronary artery, interarterial course, intramural course, and acute angle takeoff (kappa = 0.74, 0.11, –0.03, 0.13, respectively). Surgical findings were also significantly different from those of reports, and to a lesser extent ICL reviews. The resulting protocol contains technical recommendations for imaging each of these features. ConclusionsPoor agreement between institutional reports and ICL review for AAOCA suggests need for an imaging protocol to permit evidence-based risk stratification and surgical planning. Even then, delineation of echocardiographic details in AAOCA will remain imperfect.

Hemodynamic safety and efficacy of ferumoxytol as an intravenous contrast agents in pediatric patients and young adults

PurposeTo evaluate the safety and feasibility of off-label use of ferumoxytol as an intravenous MRI contrast agents in pediatric patients and young adults. Materials and methodsWith HIPAA compliance and IRB approval, 86 consecutive patients who had undergone 3T or 1.5T MRI with ferumoxytol were retrospectively identified. The blood pressure and heart rate of patients before and after ferumoxytol injection were compared. The overall image quality was evaluated independently by two radiologists with a four-point scale. Interobserver agreement was calculated using weighted kappa statistics. ResultsThe mean±standard deviation (SD) pre and post-contrast systolic blood pressures (SBP) were 101±18 and 95±20, respectively. There was a statistically significant difference between pre-SBP and post-SBP (P=0.003). The pre-contrast diastolic blood pressure (DBP) and the post-contrast diastolic blood pressure (DBP) were 60±14 and 51±17, respectively. There was a statistically significant difference between pre-DBP and post-DBP (P<0.001). The number of patients with SBP and DBP increase, SBP increase and DBP decrease, SBP decrease and DBP increase, SBP and DBP decrease, SBP increase and DBP unchanged were 14 (16%), 9 (10%), 6 (7%), 56 (65%), 1 (1%), respectively. There was moderate agreement on all individual assessments of image quality (kappa=0.45). Eighty-two of 86 (95.4%) studies were scored 3 or above (at least diagnostic quality) by both readers, with 90% confidence interval of 92–99%. ConclusionFerumoxytol is effective as an MR contrast agent. In our sample, there was on average a small but clinically insignificant drop in SBP and DBP post-contrast injection. Large, randomized, controlled trials are needed to establish optimal dosing, imaging procedures, and safety monitoring.

Agreement between physician and patient performance status ratings in an outpatient setting.

66 Background: Performance status (PS) scores are generally completed by physicians, although patient PS measures are increasingly available. The objective of this study was to assess agreement between physician-recorded Eastern Cooperative Oncology Group (ECOG) PS and a patient-rated measure of performance status based on the ECOG measure in an outpatient oncology palliative care clinic. Methods: Physicians recorded ECOG PS for every patient as part of routine clinical practice. Patients recorded their PS using a measure based on the ECOG, where 0 = normal with no limitations; 1 = not my normal self, but able to be up and about with fairly normal activities; 2 = not feeling up to most things, but in bed or chair less than half the day; 3 = able to do little activity and spend most of the day in bed or chair; and 4 = pretty much bedridden, rarely out of bed. Patients also completed the ESAS-CS measure. Medical and demographic data were abstracted from the patients’ charts. We examined correlation between physician and patient PS measures as well as factors associated with a difference in patient versus physician measures for 949 patients with a visit between August 1, 2013 and December 31, 2014. Results: Weighted Kappa statistics indicated moderate inter-rater agreement at 0.32 (95%CI: 0.28-0.36). On average, patients rated their ECOG higher by 0.31 (95%CI: 0.25-0.37, p &lt; 0.0001); 40.7% of patients rated their PS worse, 41.9% the same, and 17.3% better than did physicians. Worst agreement was for ECOG 0 (5 of 25 patients rated 0 by physicians also rated 0 themselves, 20% agreement); the highest agreement was in those with physician-rated ECOG 3 (87/136 patients, 64% agreement). Older patients reported better PS than physicians (p = 0.002) while those with worse ESAS distress scores reported worse ECOG than physicians (p &lt; .0001). Conclusions: Patients tend to rate their PS as worse than rated by physicians, particularly those with greater symptom burden. However, older patients tend to rate their PS as better. This could be due to age bias of physicians or due to older patients assessing their PS optimistically. Future research will assess the survival data of participants to assess correlation of PS assessments of each group with prognosis.

ALARA: Impact of Practice Quality Improvement Initiative on Dose Reduction in Pediatric Voiding Cystourethrogram

This practice quality improvement study of pediatric voiding cystourethrogram (VCUG) investigated the adequacy of substituting last-image capture for digital-spot images and dose reduction when this substitution was implemented and determined correlations between dose-area products (DAPs), patient ages, and fluoroscopy times. The study consisted of three phases: phase 1 documented baseline data and evaluated diagnostic accuracy between last-image capture and digital-spot images. Phase 2 documented the change in dose after substituting last-image capture for digital-spot images. Phase 3 measured doses 3 years later. Each phase-1 VCUG study was segregated into two image sets: last-image capture and digital-spot images. Three radiologists graded vesicoureteral reflux on each side using the international grading scale. Weighted kappa statistics assessed grading differences between image sets. Patient age, fluoroscopy time, and DAP were assessed with parametric and nonparametric statistics. Seventy-seven, 65, and 71 VCUGs were assessed for phases 1, 2, and 3, respectively. Weighted κ = 0.94-0.99 indicated nearly perfect agreement between last-image-capture and digital-spot-image interpretations. For phase 2, last-image capture was substituted for digital-spot images for early-filling and voiding images. DAP decreased for all three radiologists (p ≤ 0.01). Five of six (83%) correlations between DAP and age were higher than the correlations between DAP and fluoroscopy time. The dose remained significantly lower in phase 3. This project changed practice by substituting last-image capture for digital-spot images without affecting vesicoureteral reflux grading while reducing radiation exposure. Monitoring DAP is a better assessment of radiation exposure than is fluoroscopy time.

Inter-rater agreement of an alternative guideline for the assessment of the activities of daily living in home nursing

Method A quantitative comparative field study in a stratified random sample of 612 patients receiving home nursing for ADL deficiencies. A proportional stratification according to mutuality membership, region (Flanders, Brussels and the Walloon region) and the patient’s level of ADLdependency in 5 categories: minor dependency (T2 en T7), level A, level B, level C (which is the highest level) was performed. Home care nurses were invited by the ‘National College of Advising Physicians (NCAPh) and the Belgian sickness funds, to participate in the study and to perform ADL assessments according to two guidelines: the current guideline of the Belgian Evaluation Scale (BES) and an alternative guideline which was written by a workgroup of the Agreement Commission for home care nursing of the National Institute for Health and Disability Insurance. The weighted kappa statistic (κ) (and its 95% confidence interval) and the proportion agreement were the main outcome measures.

Reliability of Canadian Emergency Department Triage and Acuity Scale (CTAS) in Saudi Arabia.

BackgroundThe Canadian Emergency Department Triage and Acuity Scale (CTAS) is an integral part of the Canadian emergency medicine triaging system. There is growing interest and implementation of CTAS worldwide. However, little is known about its reliability outside Canada. The aim of this study was to determine the reliability agreement of CTAS in a tertiary care emergency center in Saudi Arabia.MethodsTen triage nurses (five senior and five junior nurses) utilized CTAS guidelines to independently assign a triage level for 160 real case-based scenarios. Quadratic weighted kappa statistics were used to measure raters’ agreements.ResultsRaters provided 1600 triage category assignments to case scenarios for analysis. Intra-rater agreement was similar for both senior and junior nurses; for senior nurses (SN1) kappa 0.871 95 % CI (0.840–0.897), and for junior nurses (SN2) kappa 0.871 95 % CI (0.839–0.898). Inter-rater agreement for the SN1 versus SN2 nurses had statistically meaningful agreement across different triage levels (weighted kappa = 0.770) 95 % CI (0.742–0.797).ConclusionsCTAS has good reliability among emergency department (ED) triage nurses in King Abdulaziz Medical City (KAMC), Saudi Arabia. The findings suggest that CTAS might be a reliable instrument when applied in countries outside Canada.

Translation and psychometric properties of the Chinese version of the Leeds Attitudes to Concordance II scale.

BackgroundConcordance is characterised as a negotiation-like health communication approach based on an equal and collaborative partnership between patients and health professionals. The Leeds Attitudes to Concordance II (LATCon II) scale was developed to measure the attitudes towards concordance. The purpose of this study was to translate the LATCon II into Chinese and psychometrically test the Chinese version of LATCon II (C-LATCon II).MethodsThe study involved three phases: i) translation and cross-cultural adaptation; ii) pilot study; and iii) a cross-sectional survey (n = 366). Systematic random sampling was used to recruit hypertensive patients from nine communities covering around 78,000 residents in China. Tests of psychometric properties included content validity, construct validity, criteria-related validity (correlation between the C-LATCon II and the Therapeutic Adherence Scale for Hypertensive Patients (TASHP)), internal reliability, and test-retest reliability (n = 30).ResultsThe study found that the C-LATCon II had a satisfactory content validity (item-level Content Validity Index (CVI) = 0.83-1, scale-level CVI/universal agreement = 0.89, and scale-level CVI/averaging calculation = 0.98), construct validity (four components extracted explained 56.66 % of the total variance), internal reliability (Cronbach’s alpha of overall scale and four components was 0.78 and 0.66-0.84, respectively), and test-retest reliability (Pearson’s correlation coefficient = 0.82, p < 0.001; interclass correlation coefficient = 0.82, p < 0.001; linear weighted kappa statistic for each item = 0.40-0.65, p < 0.05). Criteria-related validity showed a weak association (Pearson’s correlation coefficient = 0.11, p < 0.05) between patients’ attitudes towards concordance during health communication and their health behaviours for hypertension management.ConclusionsThe C-LATCon II is a validated and reliable instrument which can be used to evaluate the attitudes to concordance in Chinese populations. Four components (health professionals’ attitudes, partnership between two parties, therapeutic decision making, and patients’ involvement) describe the attitudes towards concordance during health communication.Electronic supplementary materialThe online version of this article (doi:10.1186/s12911-015-0184-0) contains supplementary material, which is available to authorized users.

The Functionality Assessment Flowchart (FAF): a new simple and reliable method to measure performance status with a high percentage of agreement between observers.

BackgroundPerformance status (PS) assessment is an integral part of the decision-making process in cancer care. Karnofsky Performance Status (KPS) and Eastern Cooperative Oncology Group (ECOG) PS are the most widely used tools. In some studies, the absolute agreement rate of these tools between observers has been moderate to low. The present study aimed to evaluate the inter-observer reliability and construct validity of the new Functionality Assessment Flowchart (FAF) and compare it with ECOG PS and KPS in a sample of cancer patients.MethodsThe patients were recruited by convenience from the waiting rooms of the Breast and Gynecology Ambulatory in a cross-sectional study. Two trained medical students (observer A) and five medical oncologists (observers B) independently rated women according to the ECOG PS, KPS and FAF. After the determining the PS scores, observer A administered the Functional Assessment of Cancer Therapy-Fatigue (FACT-F) questionnaire to the participants. The agreements between observers A and B were investigated using the absolute agreement rate (%), weighted and unweighted kappa and Spearman’s correlation test. For construct validity, the PS scores were correlated with functional and fatigue scores by performing correlation analysis.ResultsEighty women with a median age of 57 years were included in the study (86 % accrual rate). Among these women, 39 (48.8 %) had advanced cancer. The overall absolute agreement rate between observers was 49.4 % for KPS, 67 % for ECOG PS, and 78.2 % for FAF. When using unweighted kappa values, the inter-observer reliability was “fair”, “moderate” and “substantial” for KPS, ECOG PS and FAF, respectively. However, when using weighted kappa statistics, “substantial” agreement was observed for KPS and ECOG PS and “nearly perfect” agreement was observed for FAF. All of the PS scales correlated very well with the functional and fatigue scores.ConclusionsWe present a new instrument with moderate to high inter-observer agreement and adequate construct validity to measure PS in cancer patients.Electronic supplementary materialThe online version of this article (doi:10.1186/s12885-015-1526-0) contains supplementary material, which is available to authorized users.

Development of a new scale for dysphagia in patients with progressive neuromuscular diseases: the Neuromuscular Disease Swallowing Status Scale (NdSSS).

Dysphagia is one of the most critical problems in patients with progressive neuromuscular diseases. However, clinically useful and practical scales to evaluate dysphagia are limited. Therefore, the aim of this study was to develop such a scale. An 8-stage Neuromuscular Disease Swallowing Status Scale (NdSSS) was developed and tested for its inter- and intrarater reliabilities, concurrent validity, and responsiveness. The NdSSS was used to evaluate 134 patients with Duchenne muscular dystrophy (DMD) and 84 patients with amyotrophic lateral sclerosis (ALS). Inter- and intrarater reliabilities were examined with weighted kappa statistics. Concurrent validity was assessed by correlating the NdSSS with the existing scales [Functional Oral Intake Scale (FOIS), Functional Intake LEVEL Scales (FILS), and ALS Functional Rating Scale-Revised Swallow (ALSFRS-R Sw)], using Spearman's correlation coefficients. Responsiveness was determined with the standardized response mean (SRM). For inter- and intrarater reliabilities, the weighted kappas were 0.95 and 1.00, respectively, for DMD; and 0.98 and 0.98, respectively, for ALS. The NdSSS showed strong correlations with the FOIS (rs = 0.87 for DMD, rs = 0.93 for ALS, p < 0.001), FILS (rs = 0.89 for DMD, rs = 0.92 for ALS, p < 0.001), and ALSFRS-R SW (rs = 0.93, p < 0.001). SRMs were 0.65 for DMD and 1.21 for ALS. The SRM was higher in DMD patients for the NdSSS than for the other scales, while it was similar in ALS patients and the other scales. Our originally developed NdSSS demonstrated sufficient reliability, validity, and responsiveness in patients with DMD and ALS. It is also useful in evaluating dysphagia in patients with progressive neuromuscular diseases.

Application of the newly developed Japanese adenosine normal database for adenosine stress myocardial scintigraphy.

The currently available Japanese normal database (NDB) in stress myocardial perfusion scintigraphy recommended by the Japanese Society of Nuclear Medicine (JSNM-NDB) is created based on the data from exercise tests. The newly developed adenosine normal database (ADS-NDB) remains to be validated for patients undergoing adenosine stress test. We tested whether the diagnostic accuracy of adenosine stress test is improved by the use of ADS-NDB (Kanazawa University). Of 233 consecutive patients undergoing (99m)Tc-MIBI adenosine stress test, 112 patients were tested. The stress/rest myocardial (99m)Tc-MIBI single-photon emission computed tomography (SPECT) images were analyzed by AutoQUANT 7.2 with both ADS-NDB and JSNM-NDB. The summed stress score (SSS) and summed difference score (SDS) were calculated. The agreements of the post-stress defect severity between ADS-NDB and JSNM-NDB were assessed using a weighted kappa statistic. In all patients, mean SSSs of all, right coronary artery (RCA), left anterior descending (LAD), and left circumflex (LCx) territories were significantly lower with ADS-NDB than those with JSNM-NDB. Mean SDSs in all, RCA, and LAD territories were significantly lower with ADS-NDB than those with JSNM-NDB. In 28 patients with significant coronary stenosis, the mean SSS in the RCA territory was significantly lower with ADS-NDB than that with JSNM-NDB. In 84 patients without ischemia, both mean SSSs and SDSs in all, RCA, LAD, and LCx territories were significantly lower with ADS-NDB than those with JSNM-NDB. Weighted kappa values of all patients, patients with significant stenosis, and patients without ischemia were 0.89, 0.83, and 0.92, respectively. Differences were observed between results from ADS-NDB and JSNM-NDB. The diagnostic accuracy of adenosine stress myocardial perfusion scintigraphy may be improved by reducing false-positive results.