Weighted Kappa Values Research Articles

Cross-cultural Adaptation of the Knowledge and Attitude of Pain into Japanese and Test-retest Reliability in Undergraduate Students.

ABSTRACTObjectives:Pain neuroscience education (PNE) has been shown to be effective in reducing pain in people with chronic musculoskeletal pain. Knowledge of pain physiology is necessary to undertake PNE, and a measure for such knowledge is necessary. The Knowledge and Attitudes of Pain (KNAP), a comprehensive assessment of knowledge, attitudes, and beliefs regarding pain for healthcare practitioners, was developed in 2020 through the assessment of construct validity, reliability, and responsiveness in Dutch and English. This study aimed to conduct cross-cultural adaptation of the KNAP into Japanese and to verify test–retest reliability among Japanese undergraduate physical therapy and occupational therapy students.Methods:Cross-cultural adaptation was performed using Beaton’s five-step process. Subsequently, the KNAP was completed by participants with a 2-week interval. The study included second-, third-, and fourth-year undergraduate physical therapy and occupational therapy students.Results:A total of 50 students participated in the pilot test and a Japanese version of KNAP was created. Thirty-nine students completed the Japanese version of KNAP twice. Of the 30 items on the KNAP, the quadratic weighted kappa value was less than 0.4 for only one item (item 15), but reliability was interpreted as sufficient for the overall score, with an intraclass correlation coefficient (95% confidence interval) for the total score of 0.89 (0.80–0.94).Conclusions:This study has developed the Japanese KNAP, which has shown preliminary evidence of adequate test–retest reliability in Japanese undergraduate physical therapy and occupational therapy students.

Rating criteria to evaluate student performance in digital wax-up training using multi-purpose software.

PURPOSEThe aim of this study was to introduce rating criteria to evaluate student performance in a newly developed, digital wax-up preclinical program for computer-aided design (CAD) of full-coverage crowns and preliminarily investigate the reliability and internal consistency of the rating system.MATERIALS AND METHODSThis study, conducted in 2017, enrolled 47 fifth-year dental students of Okayama University Dental School. Digital wax-up training included a fundamental practice using computer graphics (CG), multipurpose CAD software programs, and an advanced practice to execute a digital wax-up of the right mandibular second molar (#47). Each student’s digital wax-up work (stereolithography data) was evaluated by two instructors using seven qualitative criteria. The total qualitative score (0-90) of the criteria was calculated. The total volumetric discrepancy between each student’s digital wax-up work and a reference prepared by an instructor was automatically measured by the CAD software. The inter-rater reliability of each criterion was analyzed using a weighted kappa index. The relationship between the total volume discrepancy and the total qualitative score was analyzed using Spearman’s correlation.RESULTSThe weighted kappa values for the seven qualitative criteria ranged from 0.62 - 0.93. The total qualitative score and the total volumetric discrepancy were negatively correlated (ρ = -0.27, P = .09, respectively); however, this was not statistically significant.CONCLUSIONThe established qualitative criteria to evaluate students’ work showed sufficiently high inter-rater reliability; however, the digitally measured volumetric discrepancy could not sufficiently predict the total qualitative score.

Role of Advanced MRI Techniques in the Quantitative Assessment of Liver Fat—A Multimodality-Based Comparative Study of Diagnostic Performance in a Tertiary Care Institute

Abstract Objective To evaluate the accuracy of noninvasive imaging methods including gray-scale ultrasound, ultrasound shear wave elastography, unenhanced computed tomography (CT), and proton density fat fraction (PDFF) on magnetic resonance imaging (MRI) using three-dimensional (3D) multiecho multipoint chemical shift–encoded spoiled gradient echo (q-DIXON) sequence in the quantification of hepatic steatosis, with proton MR spectroscopy (H1-MRS) as the reference standard in Indian population. Methods Our study included 100 consecutive adult patients referred to the department of radiology in our hospital for imaging of liver. Fat content of liver was recorded using MRI (H1-MRS and q-DIXON), unenhanced CT (average liver attenuation [ALI] and liver attenuation index [LAI]) and ultrasonography (USG) (gray-scale grading and shear wave elastography [SWE]). Data were analyzed by linear regression and Bland–Altman analysis for each technique compared with H1-MRS. The diagnostic performances of all the methods were compared using DeLong test, for detection of mild and moderate-to-severe hepatic steatosis, separately. Results MRI q-DIXON PDFF showed excellent correlation (r = 0.917, r2 = 0.840) and strong agreement (1.48 ±3.01) with H1-MRS-derived PDFF measurements. Unenhanced CT-based methods showed moderate correlation with modest agreement (r = −0.826, r2 = 0.681, −40.18 ± 16.05 for ALI and r = −0.858, r2 = 0.735, 13.4 ± 15.3 for LAI) whereas USG gray-scale assessment showed low correlation (weighted Kappa value 0.366) with H1-MRS PDFF. No correlation was found between USG-SWE results and PDFF measured with H1-MRS. Comparison of areas under curve (AUCs) using DeLong test revealed that MRI q-DIXON method performed the best for diagnosis of hepatic steatosis compared with rest. For moderate to severe steatosis, MRI q-DIXON and unenhanced CT-based methods had comparable diagnostic performance with AUCs not showing statistically significant differences. Conclusion MRI q-DIXON shows strongest correlation with MRS and should be preferred for estimation of hepatic fat, especially when MRS is not available. Unenhanced CT shows limited diagnostic performance in detecting mild steatosis; however, it certainly has a role in diagnosing moderate-to-severe hepatic steatosis, such as evaluating donor candidates for living donor liver transplantation. USG, using both the traditional four-grade visual assessment and elastography in the present form, appears to have limited role in liver fat quantification.

Reproducibility and Validity of a Food Frequency Questionnaire (FFQ) Developed for Middle-Aged and Older Adults in Semarang, Indonesia.

We assessed the reproducibility and validity of a food frequency questionnaire (FFQ) among middle-aged and older adults in Semarang, Indonesia. A total of 259 subjects aged 40–80 years completed two FFQs (nine-month apart) and nine 24 h dietary recalls (24HDRs, as a reference method). The reproducibility of the FFQ was analyzed using correlation coefficient, intra-class correlation coefficient (ICC), weighted kappa statistics and misclassification analysis. The validity was estimated by comparing the data acquired from FFQ1 and 24HDRs. The crude Pearson’s correlation coefficients and ICC for total energy and nutrients between FFQ1 and FFQ2 ranged from 0.50 to 0.81 and 0.44 to 0.78, respectively. Energy adjustment decreased the correlation coefficients for most nutrients. The crude, energy-adjusted and de-attenuated correlation coefficients for FFQ1 and 24HDRs ranged from 0.41 to 0.70, 0.31 to 0.89 and 0.54 to 0.82, respectively. The agreement rates for the same or adjacent quartile classifications were 81.1–94.6% for two FFQs and 80.7–89.6% for FFQ1 and 24HDRs. The weighted kappa values were 0.21 to 0.42 for two FFQs and 0.20 to 0.34 for FFQ1 and 24HDRs. A positive mean difference was found in the Bland–Altman analyses for energy and macronutrients. The FFQ could be acceptable for nutritional epidemiology study among Indonesians.

Test-Retest Reliability of the Coronary Heart Disease Damp Phlegm and Blood Stasis Pattern Questionnaire: Results from a Multicenter Clinical Trial.

Background Damp phlegm and blood stasis pattern (DPBSP) is the main pattern in coronary heart disease (CHD) patients. To quantify and standardize the diagnosis of DPBSP, questionnaires are usually administered. The CHD Damp Phlegm and Blood Stasis Pattern Questionnaire (CHD-DPBSPQ) is the standard metric for measuring CHD-DPBSP signs and symptoms in practice and clinical research. The CHD-DPBSPQ has moderate diagnostic efficiency, as evidenced by its receiver operating characteristic curves. Furthermore, and high reliability and validity have been shown in some studies but not in a multicenter clinical trial. Our purpose was to evaluate the test-retest reliability of a proprietary CHD-DPBSPQ. Methods The CHD-DPBSPQ uses a standard procedure for measuring symptoms. The (interrater) reliability and validity of this questionnaire have been previously studied. Here, we evaluated the test interval and weighted kappa value of items of test-retest (intrarater) reliability of the CHD-DPBSPQ. The test-retest reliability was evaluated by the intraclass correlation coefficient (ICC) for the total CHD-DPBSPQ score and the phlegm domain and blood stasis domain scores. Weighted kappa statistics were calculated for the individual CHD-DPBSPQ items. Results Using the CHD-DPBSPQ, 79 patients with late-stage CHD who were participating in a multicenter clinical trial were assessed twice. The ICCs for the CHD-DPBSPQ score were as follows: 0.827 for the total CHD-DPBSPQ, 0.778 for the phlegm domain score, and 0.828 for the blood stasis domain score. The reliability was slightly better in patients whose test interval was ≤14 days. The weighted kappa values of individual items showed moderate consistency. Conclusions The CHD-DPBSPQ was found to have excellent test-retest reliability in this sample of patients.

Towards novel osteoarthritis biomarkers: Multi-criteria evaluation of 46,996 segmented knee MRI data from the Osteoarthritis Initiative.

Convolutional neural networks (CNNs) are the state-of-the-art for automated assessment of knee osteoarthritis (KOA) from medical image data. However, these methods lack interpretability, mainly focus on image texture, and cannot completely grasp the analyzed anatomies’ shapes. In this study we assess the informative value of quantitative features derived from segmentations in order to assess their potential as an alternative or extension to CNN-based approaches regarding multiple aspects of KOA. Six anatomical structures around the knee (femoral and tibial bones, femoral and tibial cartilages, and both menisci) are segmented in 46,996 MRI scans. Based on these segmentations, quantitative features are computed, i.e., measurements such as cartilage volume, meniscal extrusion and tibial coverage, as well as geometric features based on a statistical shape encoding of the anatomies. The feature quality is assessed by investigating their association to the Kellgren-Lawrence grade (KLG), joint space narrowing (JSN), incident KOA, and total knee replacement (TKR). Using gold standard labels from the Osteoarthritis Initiative database the balanced accuracy (BA), the area under the Receiver Operating Characteristic curve (AUC), and weighted kappa statistics are evaluated. Features based on shape encodings of femur, tibia, and menisci plus the performed measurements showed most potential as KOA biomarkers. Differentiation between non-arthritic and severely arthritic knees yielded BAs of up to 99%, 84% were achieved for diagnosis of early KOA. Weighted kappa values of 0.73, 0.72, and 0.78 were achieved for classification of the grade of medial JSN, lateral JSN, and KLG, respectively. The AUC was 0.61 and 0.76 for prediction of incident KOA and TKR within one year, respectively. Quantitative features from automated segmentations provide novel biomarkers for KLG and JSN classification and show potential for incident KOA and TKR prediction. The validity of these features should be further evaluated, especially as extensions of CNN-based approaches. To foster such developments we make all segmentations publicly available together with this publication.

ICCMS™ root caries lesions stages and their underlying depth towards the pulp: an in vitro study with histologic evaluation.

To examine the relationship between the ICCMS™ (International Caries Classification and Managing System) features of root caries lesions and the underlying depth of the lesion towards the pulp. In order to control for bias, the study followed the tailored document for risk of bias assessment (RoB-tool) recently published. A pilot study showed that the outline of the pulp was much clearer on horizontal compared to vertical sections through the lesions (p = 0.03) and that the histological stereomicroscopical (SM) assessed lesion depth towards the pulp was not influenced by the cutting direction (p = 0.155). A sample of extracted permanent molar teeth (n = 100) were classifiedindependently by two of the authors according to ICCMS™ as no sign of root caries lesion 0 = sound; 1 = initial lesion (non-cavitated); 2 = moderate lesion (cavity depth ≤ 2mm) and 3 = extensive lesion (cavity depth > 2mm). After horizontal sectioning (HS) through the lesion, the depth of the underlying lesion was SM assessed independently by two of the authors as 0 = no lesion; 1 = lesion in outer 1/3; 2 = middle 1/3; and 3 = inner 1/3 of the dentine towards the pulp. Intra- and inter-reproducibility (weighted kappa values ≥ 0.83); the accuracy (Spearman's rho-values) = 0.94 and 0.95; and specificity/sensitivities/AUC values (three different thresholds) were ≥ 0.91, ≥ 0.93, and ≥ 0.96, respectively. Under the umbrella of the RoB-tool, the validity in terms of the reproducibility and accuracy of the ICCMS™ root caries scoring system was high. By means of the ICCMS™ root caries scoring system, the underlying lesion depth can be estimated, which must be considered when managing the lesion.

Patient-reported outcome measures for clinical decision-making in outpatient follow-up: validity and reliability of a renal disease questionnaire

BackgroundPatient-reported outcome measures are increasingly used by clinicians to support communication in telephone- or face-to-face consultations with patients. A renal disease questionnaire has been developed, but not sufficiently evaluated through clinimetrics in clinical setting. Hence, we aimed to evaluate the content validity, construct validity and the test–retest reliability of a renal disease questionnaire to be used for clinical decision-making.MethodsA content, construct validity and test–retest reliability study was conducted in 3 nephrology outpatient clinics in Central Denmark Region, Denmark. Content validity (face validity, comprehensibility and relevance) was assessed among 8 patients and 6 clinicians. Reliability was assessed by asking outpatients with chronic kidney disease to complete the questionnaire twice. Reliability was assessed by kappa statistics and agreement by percentage. Construct validity was determined using 4 a priori defined hypotheses and comparing 2 known groups.ResultsFive new domains emerged, 6 items were rephrased and 3 items were removed following the content validity test. A total of 160 patients completed the questionnaire with median 8 days (IQR 2 days) between assessments. The test–retest reliability parameters of the single items in the questionnaire were substantial to almost perfect as all the observed weighted kappa values ranged from 0.61 to 0.91, 95% CI (0.34 to 0.95). In total, 61% of the single items showed almost perfect agreement. In total, 3 of the 4 hypotheses were accepted and 44% of the items showed satisfying known-group discriminative validity.ConclusionA renal disease questionnaire used for clinical decision-making in outpatient follow-up showed acceptable content validity and substantial to almost perfect reliability. Sufficient construct validity was not established. Incorporating the questionnaire into routine clinical practice may improve the evaluation of disease burden in patients with chronic kidney disease.Plain English summaryWe ask patients with chronic kidney disease (CKD) in Central Region Denmark to complete a questionnaire before each outpatient visit. The answers they provide are used to support communication with their health care provider. A questionnaire requires testing to ensure it can accurately capture important information about patient’s symptoms and quality of life. When questionnaires are used to support communication between patients and health care professionals, they need to have good measurement properties. This means they need to be: (1) trustworthy, (2) relevant to a patient’s health condition, (3) consistent and produce stable results every time. We explored the measurement properties of a questionnaire designed to be used in the face-to face outpatient visits for patients with CKD. We found that the questionnaire captured consistent and stable results. Using this questionnaire may help health care professionals to assess the patients´ burden of symptoms with a more patient-centered approach. Potentially, the use of the questionnaire will increase the patients´ ability to cope with their symptoms and strengthen patients´ involvement in the clinical decisions concerning their treatment.

Test-retest reliability of physical activity questionnaires in Parkinson\u2019s disease

BackgroundPeople with Parkinson’s disease are less physically active than controls. It is important to promote physical activity, which can be assessed using different methods. Subjective measures include physical activity questionnaires, which are easy and cheap to administer in clinical practice. Knowledge of the psychometric properties of physical activity questionnaires for people with Parkinson’s disease is limited. The aim of this study was to evaluate the test-retest reliability of physical activity questionnaires in individuals with Parkinson’s disease without cognitive impairment.MethodsForty-nine individuals with Parkinson’s disease without cognitive impairment participated in a test-retest reliability study. At two outpatient visits 8 days apart, the participants completed comprehensive questionnaires and single-item questions: International Physical Activity Questionnaire-Short Form (IPAQ-SF), Physical Activity Scale for the Elderly (PASE), Saltin-Grimby Physical Activity Level Scale (SGPALS) and Health on Equal Terms (HOET). Test-retest reliability was evaluated using the intraclass correlation coefficient (ICC), standard error of measurement (SEM), limits of agreement, weighted kappa or the Svensson method.ResultsSeveral of the physical activity questionnaires had relatively low test-retest reliability, including the comprehensive questionnaires (IPAQ-SF and PASE). Total physical activity according to IPAQ-SF had an ICC value of 0.46 (95% confidence interval [CI], 0.21–0.66) and SEM was 2891 MET-min/week. The PASE total score had an ICC value of 0.66 (95% CI, 0.46–0.79), whereas the SEM was 30 points. The single-item scales of SGPALS-past six months (SGPALS-6 m) and HOET question 1 (HOET-q1) with longer time frames (6 or 12 months, respectively) showed better results. Weighted kappa values were 0.64 (95% CI, 0.45–0.83) for SGPALS-6 m and 0.60 (95% CI, 0.39–0.80) for HOET-q1, whereas the single-item questions with a shorter recall period had kappa values < 0.40.ConclusionsSingle-item questions with a longer time frame (6 or 12 months) for physical activity were shown to be more reliable than multi-item questionnaires such as the IPAQ-SF and PASE in individuals with Parkinson’s disease without cognitive impairments. There is a need to develop a core outcome set to measure physical activity in people with Parkinson’s disease, and there might be a need to develop new physical activity questionnaires.

Analytical and clinical performance of the Advansure i3 procalcitonin assay

Procalcitonin (PCT) is a clinically useful biomarker for early diagnosis and subsequent management of sepsis. We evaluated the analytical performance of a new automated chemiluminescent immunoanalyzer-based procalcitonin assay, AdvanSure i3 PCT assay (LG Life Sciences, Korea) on an AdvanSure i3 (LG Life Sciences) and compared it to the Elecsys BRAHMS PCT assay (Roche, Switzerland) on a Cobas e801 (Roche). Analytical performance was performed for the precision, linearity, and method comparison with the Elecsys BRAHMS PCT assay by Clinical and Laboratory Standards Institute guidelines. Clinical evaluations were conducted using 87 residual samples from admitted patients with suspected infection. The patients were classified based on Sepsis-3 classification. The AdvanSure i3 PCT assay exhibited a CV <5.5% for between-run precision and <6.5% for within-laboratory precision. The assay was linear up to 80.32 µg/L (r = 0.990). Statistical analysis showed that the two assays yielded a good correlation (r = 0.996), with a weighted kappa value of 0.94. Median plasma PCT level was significantly different between the non-sepsis and sepsis groups (p < .001) and the non-sepsis and septic shock groups (p < .0018). The AdvanSure i3 PCT assay showed good analytical performance and correlation with the Elecsys BRAHMS PCT assay for the sepsis patients. This new assay can be used as a diagnostic early marker of sepsis in clinical laboratories.

Model-based iterative reconstruction in CT of paranasal sinuses in cystic fibrosis

To assess image quality and dose-reduction efficacy of model-based iterative reconstruction (MBIR) in computed tomography (CT) of the paranasal sinus (CTPNS) compared with adaptive statistical iterative reconstruction (ASIR) in cystic fibrosis (CF) patients. Unenhanced CTPNS studies performed in adult CF patients from 2014 to 2020 were included. MBIR and ASIR were used and compared. Two radiologists assessed the CT images blindly and randomly. Quantitative assessment of noise, signal-to-noise ratio (SNR), and contrast-to-noise ratio (CNR) was performed in the maxillary sinus, sphenoid body, temporalis, and background air. Qualitative assessment performed included image sharpness, noise and contrast. Thirty-seven MBIR and 45 ASIR CT PNS studies were included. MBIR achieved a 74% effective median dose reduction (0.039 mSv) compared with ASIR (0.147 mSv). Measured noise was significantly lower in all regions using MBIR (p<0.001) with superior SNR (p<0.001). MBIR had higher CNR compared to ASIR (4.567 versus 2.03, p<0.001). MBIR images were sharper and less noisy, with equal contrast. Cohen's weighted kappa value was 0.824 for qualitative analysis, indicating good inter-rater agreement. Both methods had 100% diagnostic acceptability. MBIR produces high-quality CTPNS images at a significantly lower dose compared with ASIR. It is the preferred imaging surveillance method in CF patients and may have roles in other patient cohorts.

Cross-sectional and longitudinal reliability of semiquantitative osteoarthritis assessment at 1.0T extremity MRI: Multi-reader data from the MOST study

ObjectiveTo determine reliability among four experienced and calibrated readers in cross-sectional and longitudinal semi-quantitative MRI assessments of knee osteoarthritis (OA) in the Multicenter Osteoarthritis (MOST) study. DesignFrom all MOST participants with at least one knee with readable 60-month and 84-month paired knee MRIs (1.0 ​T extremity systems), we selected 10 subjects having a spectrum of baseline disease severity of cartilage, bone marrow lesions, and meniscal damage and a spectrum of longitudinal changes in severity at 24 months follow-up. MRIs were independently assessed using the WORMS grading system by four musculoskeletal radiologists with the chronological sequence known to the readers. Kappa statistics were used to determine agreement between each pair of readers and Kendall's coefficient of concordance to determine average agreement across readers. ResultsFor most features, cross-sectional reliability was substantial to almost perfect. Regarding longitudinal reliability (detection of longitudinal change), inter-reader reliability as weighted kappa values ranged from 0.62 to 0.78 for cartilage damage, 0.75–0.88 for bone marrow lesions, 0.75–0.92 for meniscal tears, 0.67–0.95 for meniscal extrusion, 0.51–0.77 for bone attrition, 0.43–0.76 for osteophytes, 0.31–0.70 for Hoffa-synovitis, and 0.47–0.85 for effusion-synovitis. Kendall's coefficient ranged from 0.65 to 0.98. ConclusionHigh levels of cross-sectional reliability and moderate to high longitudinal reliability was achieved using four experienced readers in semiquantitative MRI-assessment of most knee OA features.

Clinical assessment of pelvic floor and abdominal muscles 3 months post partum: an inter-rater reliability study

ObjectivesEvaluation of the inter-rater reliability of clinical assessment methods for pelvic floor muscles and diastasis recti abdominis post partum.DesignA multicentre inter-rater reliability study.SettingThree primary care rehabilitation centres in Sweden.ParticipantsA total...

A novel CT-based automated analysis method provides comparable results with MRI in measuring brain atrophy and white matter lesions

PurposeAutomated analysis of neuroimaging data is commonly based on magnetic resonance imaging (MRI), but sometimes the availability is limited or a patient might have contradictions to MRI. Therefore, automated analyses of computed tomography (CT) images would be beneficial.MethodsWe developed an automated method to evaluate medial temporal lobe atrophy (MTA), global cortical atrophy (GCA), and the severity of white matter lesions (WMLs) from a CT scan and compared the results to those obtained from MRI in a cohort of 214 subjects gathered from Kuopio and Helsinki University Hospital registers from 2005 - 2016.ResultsThe correlation coefficients of computational measures between CT and MRI were 0.9 (MTA), 0.82 (GCA), and 0.86 (Fazekas). CT-based measures were identical to MRI-based measures in 60% (MTA), 62% (GCA) and 60% (Fazekas) of cases when the measures were rounded to the nearest full grade variable. However, the difference in measures was 1 or less in 97–98% of cases. Similar results were obtained for cortical atrophy ratings, especially in the frontal and temporal lobes, when assessing the brain lobes separately. Bland–Altman plots and weighted kappa values demonstrated high agreement regarding measures based on CT and MRI.ConclusionsMTA, GCA, and Fazekas grades can also be assessed reliably from a CT scan with our method. Even though the measures obtained with the different imaging modalities were not identical in a relatively extensive cohort, the differences were minor. This expands the possibility of using this automated analysis method when MRI is inaccessible or contraindicated.

Modified Clavien-Dindo-sink classification system for adolescent idiopathic scoliosis.

The Clavien-Dindosink (CDS) classification system provides more treatment-focused granularity than subjective methods of describing surgical complications; however, it has not been validated in posterior spinal fusion (PSF) for adolescent idiopathic scoliosis (AIS). The purpose of this study was to modify the CDS system for application in patients with AIS undergoing PSF to assess its inter- and intra-rater reliability for describing complications faced by this population. A review of all complications specific to patients with AIS captured in a large multicenter international database was performed. All complications were classified according to CDS, modified by addition of "prolonged initial hospital stay" as a criterion for Grade II. A survey of this complication list and an additional 20 clinical vignettes (sent out on two occasions) was sent to nine spinal deformity surgeons. Weighted kappa values were used to determine inter- and intra-rater reliability. The Fleiss κ value for interrater reliability among 5 respondents grading all AIS complications was 0.8 (very good). For each grade, interrater reliability was very good, with an overall range of 0.8-1. The overall kappa value for intrarater reliability among eight respondents grading 20 vignettes was between 0.6 (good) and 0.9 (very good). The modified CDS classification system has very good interrater and intrarater reliability in describing complications following PSF in patients with AIS. This system may be of greater utility for reporting outcomes than a "major" versus "minor" complication system and can serve as a valuable tool for improving surgical practices and patient outcomes in this population. IV case series.

Validation of the psychometric properties of the Malay advance care planning questionnaire

BackgroundThere is a growing interest among the developing countries on advance care planning (ACP) due to the reported benefits of planning ahead in the developed countries. Validated instruments in various languages have been developed to facilitate study on the views of public prior to its implementation. However, instrument to explore the views on ACP in Malay has not been developed and validated yet, even though Malay is spoken extensively by approximately 220 million people in the Malay Archipelago. There is also a need for instrument in Malay language to facilitate the assessment of knowledge, attitude and practice (KAP) of Malaysians regarding ACP. Therefore, the aim of this study was to validate the psychometric properties of the Malay Advance Care Planning Questionnaire (ACPQ-M).MethodsThe ACPQ was translated according to international guidelines. This validation study was conducted from January to June 2018. Participants who were ≥ 21 years old, and able to understand Malay were recruited from an urban primary care clinic and a tertiary education institution in Malaysia. A researcher administered the ACPQ-M to participants via a face-to-face interview at baseline and 2 weeks later. Each interview took approximately 10–20 min.ResultsA total of 222/232 participants agreed to participate (response rate = 96.0%). Exploratory factor analysis and confirmatory factor analysis found that the ACPQ-M was a 4-factor model. The Cronbach’s α values for the four domains ranged from 0.674–0.947. Only 157/222 participants completed the test-retest (response rate = 71%). At test-retest, quadratic weighted kappa values for all domains ranged from 0.340–0.674, except for two domains which ranged from − 0.200-0.467.ConclusionsThe ACPQ-M was found to be a 4-factor model, and a valid and reliable instrument to assess the KAP regarding ACP. This instrument can contribute to profound understanding of the KAP of Malaysians regarding ACP, and assist policy makers in determining the readiness for legislation of ACP in Malaysia.

Assessment of psychometric properties, cross-cultural adaptation, and translation of the Turkish version of the ICU mobility scale

Background/aim The aim of the study was to carry out the cultural adaptation and translation of the ICU mobility scale (IMS) into Turkish and research the psychometric properties.Materials and methods This study was based on methodological design. The IMS was translated from English to the Turkish through a regularised translation process. Two physiotherapists assessed patients independently in the coronary intensive care unit. The measures such as construct validity, intra and interrater reliability, and internal consistency of the IMS Turkish version were assessed. Results A total of 70 intensive care patients were included in the study. The intrarater and interrater reliability of the IMS was excellent. The weighted Kappa value was 0.92 (0.87–0.96) for the intrarater reliability, and 0.87 (0.80–0.93) for the interrater reliability. There were significant correlations between the IMS and functional status score for the intensive care unit (r = 0.83), Perme intensive care unit mobility score (r = 0.84), Katz activities of daily living (r = 0.73), handgrip strength (r = 0.62), knee extension strength (r = 0.46), and age (r = –0.44).Conclusion This study suggests that the IMS Turkish version is a reliable and valid scale for assessing functional status and mobility level in ICU patients.

Chinese registry of rheumatoid arthritis: IV. Correlation and consistency of rheumatoid arthritis disease activity indices in China.

Background:Disease activity indices (DAIs) including disease activity score 28 (DAS28), simplified disease activity index (SDAI), and clinical disease activity index (CDAI) have been widely used in clinical practice and research studies of rheumatoid arthritis (RA). The objective of our study was to evaluate the correlation and concordance among different DAIs in Chinese patients with RA.Methods:A cross-sectional study, including patients enrolled in the Chinese registry of rheumatoid arthritis from November 2016 to August 2018, was conducted. The correlations were evaluated using Spearman correlation coefficient and concordance with Bland-Altman plots, quadratic weighted kappa, and discordance rates in the crosstab. For other indices, the optimal cutoff points corresponding to SDAI remission were explored through receiver operating characteristic curve analysis.Results:A total of 30,501 patients were included, of whom 80.46% were women. Most individuals were with moderate disease activity or high disease activity. High correlations among DAS28-erythrocyte sedimentation rate (ESR) and DAS28-C-reactive protein (CRP), SDAI and CDAI were observed. Similarly, the weighted kappa value among the indices was high. In Bland-Altman plots, a positive difference between DAS28-ESR and DAS28-CRP was observed, with an absolute difference of >1.2 in 3079 (10.09%) patients. In crosstab, approximately 30% of the patients were classified into different groups. Concordance values between SDAI remission and the optimal cutoff points of DAS28-ESR, DAS28-CRP, and CDAI were 3.06, 2.37, and 3.20, respectively.Conclusions:Although DAIs had high correlations and weighted kappa values, the discordance between DAIs was significant in Chinese patients with RA. The four DAIs are not interchangeable.

805 Towards a more perfect union: interrater reliability between telemedicine and in-person evaluators in sleep disordered breathing

Abstract Introduction Telemedicine has rapidly changed the landscape of all of clinical practice, and is now widely employed in sleep medicine. To date, the accuracy of telemedicine in identifying patients at risk for obstructive sleep apnea (OSA) is still unknown. Given differences in technique and fidelity, a perfect correlation between these two types of encounters cannot be assumed. We studied how providers using a telemedicine platform compared to providers using traditional in-person encounters in identifying risk for sleep disordered breathing. Methods 90 participants referred to a comprehensive university sleep program were randomized to this interrater reliability study. Subjects were representative of the gender and ethnic breakdown of the outlying community. The subjects were evaluated by an in-person clinician investigator, then randomized to a second clinician investigator who performed an evaluation online using a common teleconferencing platform. Both types of evaluations included a history and physical exam. The primary outcome was pretest probability for obstructive sleep apnea. Secondary comparators included level of daytime sleepiness, snoring volume, apneas witnessed by a third party, modified Mallampati score, presence/absence of tonsils, degree of overjet bite, and severity of apnea based on home sleep testing. Results Interrater reliability for pretest probability of OSA was reflected in a weighted kappa value of 0.414 (SE 0.090, p=0.002). This suggests moderate agreement between the an in-person and telemedicine evaluator. Kappa values of our secondary outcomes ranged from -0.044 (degree of maxillary overjet) to 0.702 (apneas witnessed by a third party), and were generally higher for historical elements and lower for physical exam findings. Conclusion Evaluation for pretest probability for sleep apnea via telemedicine has a moderate interrater correlation with in-person assessment. A relatively high degree of interrater reliability for historical elements suggests that the accuracy of telemedicine for OSA is tempered by a suboptimal physical exam. Telemedicine evaluations might become more accurate through standardization. For instance, using validated scales for OSA or templated encounter scripts may help with risk-stratification, and ultimately lead to more uniform management. Support (if any) This study was supported by an AASM Foundation Focused Project Award

Validation of the Radiographic Global Impression of Change (RGI-C) score to assess healing of rickets in pediatric X-linked hypophosphatemia (XLH).

Rickets is a primary manifestation of pediatric X-linked hypophosphatemia (XLH) - a rare progressive hereditary phosphate-wasting disease. Severity is quantified from radiographs using the Rickets Severity Scale (RSS). The Radiographic Global Impression of Change (RGI-C) is a complementary assessment in which a change score is assigned based on differences in the appearance of rickets on pairs of radiographs compared side by side. The current study evaluated the reliability, validity, and sensitivity to change of the RGI-C specifically in pediatric XLH. The reliability, validity, and sensitivity to change of the RGI-C were evaluated using data from two studies in pediatric XLH (113 children aged 1-12years) in which burosumab treatment significantly improved rickets severity. Intra-rater and inter-rater reliability were assessed by three pediatric radiologists. Intra-rater reliability for RGI-C global score was >90% for agreement within 1 point, with weighted kappa values >0.5, indicating moderate to almost perfect agreement. Inter-rater reliability was also >90% (0.47-0.52 for all reader pairs; moderate agreement). The RGI-C global score showed significant relationships with changes from baseline to week 64 in serum phosphorus (r=-0.397), alkaline phosphatase (-0.611), total RSS (-0.672), standing height (0.268), and patient-reported global functioning (0.306) and comfort/pain functioning (0.409). Based on standardized response means, RGI-C global scores were sensitive to change in RSS, differentiating between those considered improved and greatly improved. Results for validity and sensitivity to change were similar for the RGI-C wrist, knee, and standing long leg scores. The RGI-C is a reliable, valid, and sensitive measure in pediatric XLH, and complementary to the RSS.