Interrater Reliability Correlation Research Articles

Assessing the reliability and feasibility of frailty screening tools among hospitalised older adults

Background The 29-item Frail-Physical, Psychological and Social (Frail-PPS) and the 14-item Frailty Assessment Measure (FAM) were developed in Singapore to identify risk of frailty among community dwelling older adults and validated for use among hospitalised older adults. Objectives This study aimed to establish the interrater reliability and feasibility of the two screening tools ‒ FAM and Frail-PPS, for assessing frailty among hospitalized older adults. Methods The FAM and Frail-PPS were administered during the initial nursing assessment by nurses to 62 patients aged 65 years and older within 24 h of admission. Interrater reliability, convergent validity and intraclass correlation coefficients (ICCs) were established. Feasibility was determined by the time of administration. Results ICCs for Frail-PPS and FAM were 0.95 and 0.95 respectively. A positive correlation was established (r = 0.97). The administration time for Frail-PPS averaged 6.7 min, and 3.3 min for FAM. Conclusions The FAM, with its high reliability and convergent validity, as well as shorter administration time, may be the preferred screening tool for use in acute care settings.

The Reliability of Common Radiographic Measurements Used to Describe Foot Deformities

Radiographic measurements are frequently used to classify deformity and determine treatment options. Correlation coefficients can be used to determine inter- and intrarater reliability. Reliability is a required feature of any measurement if the measurement is to provide valid information. We calculated correlation coefficients for standard radiographic measurements used to categorize foot deformities: this was done for 52 sets of radiographs assessed by 5 raters. We aimed for generalizability, and kept rater instructions to match what was originally published for each measurement of interest with schematic illustration. Overall, our results mostly showed a lack of inter-rater reliability (correlation coefficients <0.4), and strong intrarater reliability (correlation coefficients >0.6), for 12 forefoot and 12 rearfoot radiographic measurements that are commonly used. The results of this investigation bring into question the routine use of radiographic measurements to categorize deformity, select treatments, and measure surgical outcomes, between surgeons, because the validity of these measurements appears to be threatened by weak inter-rater reliability. In order for these measurements to be considered useful, it may be necessary for surgeons to more rigorously define and practice making standard radiographic measurements.

MRI tagging of colonic chyme mixing in healthy subjects: Inter-observer variability and reliability of the measurement with time.

Magnetic resonance imaging (MRI) tagging techniques have been applied to the GI tract to assess bowel contractions and content mixing. We aimed to evaluate the dependence of a tagging measurement (for assessing chyme mixing) on inter-observer variability in both the ascending colon (AC) and descending colon (DC) and to investigate the temporal variation and hence reliability of the colonic tagging technique by acquiring multiple measurements over time on healthy participants. Two independent datasets of healthy adults were used for the retrospective inter-observer variability (Study 1: 13 datasets and Study 2: 31 datasets), and ten participants were scanned for the prospective temporal variation study following a 1 L mannitol oral preparation. All colonic tagging data were acquired on 3 T MRI scanners. The mean and the standard deviation (SD) maps were generated pixel-by-pixel using custom-written software in MATLAB. The colonic regions of interest were defined using MIPAV software. Bland-Altman plots and scatter plots were used for the inter-observer variability. The mean and SD of all repeated measures for each subject were calculated along with a one-way ANOVA to test for variations with time. Scatter plots and Bland-Altman plots showed a large range of data with low variation and small limits of agreements (<5% CoV). The intraclass correlation coefficient of inter-rater reliability was excellent and 0.97 or above for the AC and DC measurements for both datasets. The temporal variation study shows that there was no significant difference found between the multiple measures with time (p = 0.53, one-way repeated measures ANOVA test). MRI tagging technique can provide an assessment of colonic chyme mixing. The inter-observer study data showed high inter-rater agreement. The temporal variation study showed some individual variations with time suggesting multiple measurements may be needed to increase accuracy.

The use of slice encoding for metal artifact correction (SEMAC) sequencing improves the diagnostic evaluation of graft integrity following anterior cruciate ligament reconstruction

ObjectivesTo determine whether magnetic resonance imaging (MRI) with metal artifact reduction sequencing is superior to conventional knee MRI in the evaluation of an injured anterior cruciate ligament (ACL) graft, where visualisation on conventional MRI can be limited by the metal artifact from fixation devices. MethodsEighteen patients underwent conventional MRI sequence (proton density fat saturated [PDFS]) and two types of metal artifact reduction sequencing MRI (WARP, slice encoding for metal artifact correction (SEMAC); Siemens) following a secondary injury to their ACL reconstructed knee. Six raters with experience in knee MRI evaluation reviewed sagittal PDFS, WARP, and SEMAC sequences, providing semi-quantitative grades for visualisation and diagnostic confidence assessing the ACL, posterior cruciate ligament , menisci, tibial and femoral tunnel margins, and articular cartilage. Intra-class correlation coefficients for inter-rater reliability were evaluated. The 6-rater mean scores for the visualisation and diagnostic confidence derived from each sequence were compared using the Friedman test for multiple paired samples. ResultsNo statistically significant difference in the ACL visualisation among the sequences was found (p ​= ​0.193). Further, a subgroup analysis was performed in cases evaluated as “moderately blurry” or “indistinct ACL visualisation” on PDFS (58% of cases). SEMAC significantly improved diagnostic confidence in ACL visualisation (p ​= ​0.041) and ACL graft rupture (p ​= ​0.044) compared to PDFS.There was no statistically significant difference in the inter-observer reliability between sequences. The WARP sequence added 2.84 ​± ​0.69 ​min, while SEMAC added 2.95 ​± ​0.40 ​min to the standard knee MRI scan time. Conclusionuse of the SEMAC metal reduction sequence significantly improved diagnostic accuracy and confidence in the detection of ACL graft rupture in cases where the ACL was moderately blurry or indistinct on the PDFS sequence. This sequence should be considered as an adjunct to conventional PDFS in cases where graft visualisation is limited by the metal artifact from fixation devices. Level of evidenceIII.

Causes of Rapidly Progressive Dementia in a Prospectively Accrued Cohort (P2-6.009)

Causes of Rapidly Progressive Dementia in a Prospectively Accrued Cohort (P2-6.009)

Tanner–Whitehouse skeletal maturity score derived from ultrasound images to evaluate bone age

ObjectiveThe complexity of radiographic Tanner–Whitehouse method makes it less acceptable by radiologists and endocrinologists to assess bone age. Conventional ultrasound could be used to measure the ratio of the height of the ossification center to the epiphysis of the bone to evaluate maturity of bone. The purpose of this study is to obtain radiographic TW3 skeletal maturity score with ultrasound images.MethodsIn this prospective diagnostic study, participants aged between 1 and 18 years undergoing radiography for bone age evaluation were evaluated from April 2019 to November 2021. Ultrasonic skeletal maturity scores of participants were transformed into radiographic skeletal maturity scores with the fitted formulas established in this study. Diagnostic performances of the transformed scores to diagnose advanced or delayed bone age were confirmed. Ultrasound images of 50 participants in the validation group were re-evaluated to confirm inter-rater reliability.ResultsA total of 442 participants (median age, 9.5 years [interquartile range, 7.8–11.1 years]; 185 boys) were enrolled. Ultrasound determination of bone age had a sensitivity of 97% (34/35, 95% CI: 83, 99) and a specificity of 98% (106/108, 95% CI: 93, 99) to diagnose advanced or delayed bone age. The intra-class correlation coefficient for inter-rater reliability was 0.993 [95% CI: 0.988, 0.996], p < 0.0001.ConclusionsRadiographic Tanner–Whitehouse skeletal maturity score could be obtained from ultrasound images in a simple, fast, accurate, and radiation-free manner.Key Points• The fitting formulas between radiographic TW3 skeletal maturity score and ultrasonic skeletal maturity score were developed.• Through measurement of ossification ratios of bones with ultrasound, TW3 skeletal maturity score was obtained in a simple, fast, and radiation-free manner.

Preoperative Assessment of Bone Density Using MRI-Based Vertebral Bone Quality Score Modified for Patients Undergoing Cervical Spine Surgery.

Diagnostic accuracy study. Previous studies have reported the clinical application of the Vertebral Bone Quality (VBQ) scores for assessing bone density in operative lumbar spine patients. We aim to explore whether the method could be modified and applicable for patients undergoing cervical spine surgery. Adult patients receiving cervical spine surgery for degenerative diseases between September 2020 and March 2022 with non-contrast T1-weighted MRI and DEXA were included. Correlation between cervical VBQ scores and DEXA T-scores was analyzed using Pearson's correlation. Student's t test was used to present the discrepancy between the VBQ of patients with normal bone density (T ≥ -1.0) and patients with osteopenia/osteoporosis (T < -1.0). Statistical significance was set at P < .05. Eighty-three patients (20 patients with T ≥ -1.0 vs 63 patients with T < -1.0 ) were included. Significant difference was found between the cervical VBQ between groups (2.99 ± .79 vs 3.80 ± .81, P < .001). Interclass correlation coefficient for inter-rater reliability was .82 (95% CI: .70-.93) and .91(95% CI: .84-.97) for intra-rater reliability. The area under the ROC curve was .78 (95% CI: .65-.90). The DEXA T-score of the femoral neck, total hip and the lowest DEXA T-score were found to be significantly correlated with the cervical VBQ score according to Pearson correlation analysis (P < .001). This is the first study to apply the VBQ method to assess the bone density in preoperative cervical spine patients. Cervical VBQ scores were significantly correlated with DEXA T-score. With an overall accuracy of .78, the radiation-free and cost-effective method could be a potential tool for screening patients with osteopenia and osteoporosis before surgery.

Correlation between diminished vagal tone and somatic dysfunction severity in very and extremely low birth weight preterm infants assessed with frequency spectrum heart rate variability and salivary cortisol.

Osteopathic manipulative treatment (OMT) is evolving in the neonatal intensive care unit (NICU) setting. Studies showed its efficacy in length of stay and hospitalization costs reduction. Moreover, it was suggested that OMT has a modulatory effect on the preterm infants’ autonomic nervous system (ANS), influencing saturation and heart rate. Even if OMT is based on the palpatory examination of the somatic dysfunctions (SD), there are controversies about its identification and clinical relevance. The objective of this study was to evaluate the inter-rater reliability, clinical characteristics, and functional correlation of the SD Grade score with the heart rate variability (HRV) and the salivary cortisol (sCor) using a multivariate linear model approach. To evaluate those features, we implemented an ad hoc SD examination for preterm infants that was performed by 2 trained osteopaths. It was based on the new variability model of SD that includes an SD Grade assessment procedure. The ANS features were assessed by frequency parameters of HRV studying high frequency (HF), low frequency (LF), and HF/LF, whereas sCor was tested with a radioimmunoassay. The ANS assessment was standardized and performed before SD testing. Sixty-nine premature infants were eligible. SD Grade showed excellent concordance between the blinded raters. Using SD Grade as a grouping variable, the infants presented differences in GA, Apgar, pathological findings, length of stay, and ventilatory assistance. In our multivariate model, HF, LF, and LF/HF resulted linearly correlated with SD Grade. Instead, sCor presented a linear correlation with 5’ Apgar and respiratory distress syndrome but not with SD Grade. SD Grade was in line with the natural history of the underdevelopment due to prematurity. Our models indicate that the cardiac vagal tone is linearly related with SD Grade. This finding may improve the multidisciplinary decision making inside NICU and the management of modifiable factors, like SD, for cardiac vagal tone regulation.

Updated guidelines on selecting an intraclass correlation coefficient for interrater reliability, with applications to incomplete observational designs.

Several intraclass correlation coefficients (ICCs) are available to assess the interrater reliability (IRR) of observational measurements. Selecting an ICC is complicated, and existing guidelines have three major limitations. First, they do not discuss incomplete designs, in which raters partially vary across subjects. Second, they provide no coherent perspective on the error variance in an ICC, clouding the choice between the available coefficients. Third, the distinction between fixed or random raters is often misunderstood. Based on generalizability theory (GT), we provide updated guidelines on selecting an ICC for IRR, which are applicable to both complete and incomplete observational designs. We challenge conventional wisdom about ICCs for IRR by claiming that raters should seldom (if ever) be considered fixed. Also, we clarify how to interpret ICCs in the case of unbalanced and incomplete designs. We explain four choices a researcher needs to make when selecting an ICC for IRR, and guide researchers through these choices by means of a flowchart, which we apply to three empirical examples from clinical and developmental domains. In the Discussion, we provide guidance in reporting, interpreting, and estimating ICCs, and propose future directions for research into the ICCs for IRR. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

A Novel Grading System of Destructive Lumbar Spondyloarthropathy Based on Evaluation of the Facet Joints.

Retrospective cohort study. To develop and evaluate a new grading system for destructive lumbar spondyloarthropathy (DLSA) by assessing bony destruction of the facet joints; to evaluate interrater reliability; and to determine the association between anteroposterior (AP) dural sac diameter at the lumbar level and the new grading. The characteristics of DLSA are unknown, hindering clinical care and research. Imaging to determine the cause of DLSA may positively contribute to patient outcome or well-being by providing prognostic information. In the magnetic resonance images (MRIs), we measured an axial midline AP dural sac diameter and evaluated bone destruction caused by amyloidosis at the level of the center of each lumbar disk of the lumbar spine. Two orthopedic surgeons independently evaluated each case at two-month intervals and assigned the grade by rating bone destruction at each lumbar level. Weighted κ and intraclass correlation coefficients for interrater reliability were calculated. In addition, the correlation between the AP diameter of the spinal dural sac at the lumbar level and the new MRI-based DLSA grade was examined. The sample size of 82 patients was reached by examining records of 118 consecutive patients. The mean (SD) age of the included patients was 65 (7.2) years, and 36 (43.9%) were women. The grading of DLSA showed moderate to good interrater reliability at both assessments (κ, 0.59-0.78). Intraclass correlation coefficient showed substantial to excellent agreement (intraclass correlation coefficient, 0.63-0.86). The AP diameter of the spinal dural sac at the lumbar level showed a significant correlation with the new grading ( P <0.001). The new MRI-based grading system for DLSA has good interrater reliability, although the strength of agreement varies somewhat. The new grading system correlates with AP dural sac diameter. Thus, this classification focused on facet erosion, which leads to functional incompetence may be helpful in surgical decision-making.

Screening for Mild Cognitive Impairment in the Preoperative Setting: A Narrative Review.

Cognitive impairment predisposes patients to the development of delirium and postoperative cognitive dysfunction. In particular, in older patients, the adverse sequelae of cognitive decline in the perioperative period may contribute to adverse outcomes after surgical procedures. Subtle signs of cognitive impairment are often not previously diagnosed. Therefore, the aim of this review is to describe the available cognitive screeners suitable for preoperative screening and their psychometric properties for identifying mild cognitive impairment, as preoperative workup may improve perioperative care for patients at risk for postoperative cognitive dysfunction. Electronic systematic and snowball searches of PubMed, PsycInfo, ClinicalKey, and ScienceDirect were conducted for the period 2015–2020. Major inclusion criteria for articles included those that discussed a screener that included the cognitive domain ‘memory’, that had a duration time of less than 15 min, and that reported sensitivity and specificity to detect mild cognitive impairment. Studies about informant-based screeners were excluded. We provided an overview of the characteristics of the cognitive screener, such as interrater and test-retest reliability correlations, sensitivity and specificity for mild cognitive impairment and cognitive impairment, and duration of the screener and cutoff points. Of the 4775 identified titles, 3222 were excluded from further analysis because they were published prior to 2015. One thousand four hundred and forty-eight titles did not fulfill the inclusion criteria. All abstracts of 52 studies on 45 screeners were examined of which 10 met the inclusion criteria. For these 10 screeners, a further snowball search was performed to obtain related studies, resulting in 20 articles. Screeners included in this review were the Mini-Cog, MoCA, O3DY, AD8, SAGE, SLUMS, TICS(-M), QMCI, MMSE2, and Mini-ACE. The sensitivity and specificity range to detect MCI in an older population is the highest for the MoCA, with a sensitivity range of 81–93% and a specificity range of 74–89%. The MoCA, with the highest combination of sensitivity and specificity, is a feasible and valid routine screening of pre-surgical cognitive function. This warrants further implementation and validation studies in surgical pathways with a large proportion of older patients.

P.006 Etiologic diagnoses of rapidly progressive dementia in a prospective multicenter cohort

Background: Accurate etiologic diagnoses are needed in patients with rapidly progressive dementia (RPD) to ensure access to symptomatic and disease-modifying therapies when available. Methods: Patients with RPD were prospectively enrolled and evaluated at Washington University (Saint Louis, MO; 2016-2019) and Mayo Clinic (Jacksonville, FL; 2020-2021). Etiologic diagnoses were independently assigned by two dementia specialists integrating clinical features and the results of diagnostic tests; disagreements were resolved via blinded review by a third specialist. Results: 160 RPD patients were enrolled and followed. Average age-at-symptom onset was 60.0±15.9 years; 50% were female. Inter-rater reliability (91% agreement; Cohen’s κ=0.88, p&lt;0.001) and clinicopathologic correlation were excellent (100% agreement in 24 patients with neuropathologic data). Autoimmune encephalitis was the leading cause of RPD (39%), followed by Alzheimer disease and related dementias (29%), Creutzfeldt-Jakob disease (15%), and other causes (15%). Patients with potentially treatable causes of RPD were younger (54.5±18.2 than those with neurodegenerative causes (67.3±9.5; p&lt;0.001), and more likely to present with altered levels of consciousness, seizures, or CSF pleocytosis (p&lt;0.05). Conclusions: Etiologic diagnoses can be reliably established in RPD patients using available clinical data. The prevalence of autoimmune encephalitis in this series justifies routine screening for potentially treatment-responsive causes of RPD, particularly in younger patients.

Characterization of Trapezial Pommel in Relation to Radiographic and Wear Patterns in Carpometacarpal Osteoarthritis.

Trapezial pommel, or ulnar osteophyte positioned at the vertex of the saddle-shaped facet, is a consistent structural appearance in osteoarthritis (OA) of the first carpometacarpal. This study investigates its relation to radiographic measures (modified Eaton staging and thumb OA [ThOA] index) and wear patterns (trapezial surface morphology and cartilaginous eburnation). In all, 137 whole trapezia were explanted from 116 patients and evaluated for Eaton staging, morphology (saddle, cirque, or dish), and eburnation (degree of cartilaginous effacement) of the articular surface of the trapezium. In total, 131 Robert's views and 126 stress views were reviewed by 2 blinded senior surgeons for ThOA index and pommel size. Statistical analyses included Spearman correlation and linear regression. Standardized pommel size achieved good intrarater reliability (correlation coefficient: 0.80-0.98) and moderate interrater reliability (correlation coefficient: 0.60-0.67). The ThOA index and pommel size were significantly correlated across Robert's (rs = 0.51) and stress views (rs = 0.64). The ThOA index better distinguished between stages compared with pommel size. All the radiographic measures inversely correlated with preserved cartilage and varied across morphologies. Pommel size differed significantly between dish and saddle, and the ThOA index was significantly different between all morphologies when using stress views. We reliably quantified the pommel feature and demonstrated significant correlations with other radiographic and topologic measures of arthritic disease. If future studies can demonstrate that the pommel is a pathogenic process in ThOA and its correction can curb disease progression, the identification of the pommel feature may help guide targeted intervention.

Neuroforamen stenosis remains a challenge in conventional computed tomography and new dual-energy techniques

Lumbar foraminal stenosis may be caused by osseous and soft tissue structures. Thus, both computed tomography (CT) and magnetic resonance imaging (MRI) play a role in the diagnostic algorithm. Recently, dual-energy CT (DECT) has been introduced for the detection of spinal disorders. Our study’s aim was to investigate the diagnostic accuracy of collagen-sensitive maps derived from DECT in detecting lumbar foraminal stenosis compared with standard CT and MRI. We retrospectively reviewed CT, DECT, and MRI datasets in patients with vertebral fractures between January 2015 and February 2017. Images were scored for presence and type of lumbar neuroforaminal stenosis. Contingency tables were calculated to determine diagnostic accuracy and interrater agreement was evaluated. 612 neuroforamina in 51 patients were included. Intraclass correlation coefficients for interrater reliability in detecting foraminal stenoses were 0.778 (95%-CI 0.643–0.851) for DECT, 0.769 (95%-CI 0.650–0.839) for CT, and 0.820 (95%-CI 0.673–0.888) for MRI. Both DECT and conventional CT showed good diagnostic accuracy in detecting lumbar foraminal stenosis but low sensitivities in detecting discoid stenosis. Thus, even though previous studies suggest that DECT has high diagnostic accuracy in assessing lumbar disc pathologies, we show that DECT does not provide additional information for detecting discoid stenosis compared with conventional CT.

Development and validation of the sitting balance assessment for spinal cord injury (SitBASCI).

Multicentric psychometric study. The aim of this study is to introduce the development of the Sitting Balance Assessment for Spinal Cord Injury (SitBASCI) and assess its inter-rater reliability and internal consistency. The study was developed among the three Spinal Units of San Bortolo Hospital in Vicenza, Niguarda Hospital in Milan and AOU Careggi in Florence. SitBASCI is a 13-item scale developed to evaluate trunk control in individuals with SCI. Subjects were filmed while performing the 13 items of the scale. The videotapes were submitted to 25 examiners who evaluated patients' performances with the scale. The power of the study was estimated. The interclass correlational coefficient (ICC) was used to assess the inter-rater reliability of the examiner's evaluations regarding each item and the total. Cronbach's alpha was used to assess internal consistency of the scale and internal consistency of the scale on the eliminated item. The study showed to have a significant power. The inter-rater reliability for the total score was ptot = 0.997 (item's values were p = 0.876-0.998). The internal consistency of the scale was alpha = 0.925, while the internal consistency of the scale on the eliminated item was alpha = 0.912-0.930. SitBASCI had a high inter-rater reliability and internal consistency. Items had also good inter-rater reliability and item-total correlation. Therefore, SitBASCI could be proposed as a good and reliable instrument for Italian clinicians to evaluate sitting balance and trunk control in patient with SCI despite of aetiology and level of injury.

Inter-rater reliability of Electronic Head Posture Instrument (EHPI) for measuring Cranio-vertebral angle in young adults

Purpose: Forward head posture and degree of anterior translation of head can be assessed using Cranio-vertebral angle (CV angle). Recent literatures use Electronic Head Posture Instrument (EHPI) to measure CV angle without exposing the patient to X-ray. Objective and Study design: This observational study was cross-sectionally designed and aimed to find out the reliability of Electronic Head Posture Instrument (EHPI) in measuring Cranio-Vertebral Angle of young adults. Methods: 100 apparently healthy young adults were assessed for the CV angle by two Physiotherapy student investigators who are skilled in measuring CV angle using EHPI in two separate sessions of 20 minutes gap with the same instrument. The measurements of CV angle by the two investigators were documented and taken for statistical analysis. Results: The mean difference in the Cranio-Vertebral Angle between the two measurements was 0.46 (+/-) 0.79. The inter-class correlation coefficient for inter-rater reliability of Cranio-Vertebral Angle (CV Angle) by Electronic Head Posture Instrument (EHPI) was 0.925, with the corresponding P=0.001. Conclusion: The study results exhibit a significant strong positive correlation between the two measurements supporting a high reliability of EHPI in measuring CV Angle.

Reliability and Validity of the Bipolar Prodrome Symptom Interview and Scale-Full Prospective in Its Turkish Translation.

Editors' Note: The Editors would like to address issues related to the acceptance of this manuscript. The original manuscript referenced the study tool as the Bipolar Prodrome Symptom Interview Scale-Prospective (BPSS-P). After the manuscript's initial acceptance, the authors requested a revision of the tool name to Bipolar Prodrome Symptom Interview Scale-Full Perspective (BPSS-FP). When this request was made, the original acceptance was rescinded, and the authors were asked to formally revise and resubmit the manuscript with an explanation for the change. This revision and subsequent review led to the final acceptance of the manuscript. The authors have assured us that the tool used in the manuscript was the BPSS-FP (version 5) as opposed to abbreviated forms of this tool that are also used in research (e.g., Bipolar Prodrome Symptom Scale-Abbreviated Screen for Patients (BPSS-AS-P). Background: No scale exists to assess patients at-risk for bipolar disorder (BD) in Turkey. We aimed to assess the psychometric properties of the Turkish version of the Bipolar Prodrome Symptom Interview and Scale-Full Prospective (BPSS-FP). Method: Psychiatric service users aged 11-18 years old were interviewed using the BPSS-FP translated into Turkish and the Kiddie Schedule for Affective Disorders and Schizophrenia. Youth with major depressive disorder (MDD, n = 63), bipolar-spectrum disorder (n = 47), and healthy controls (n = 122) were included. Cronbach's alpha was calculated to assess internal consistency. The Young Mania Rating Scale (YMRS) and Children's Depression Rating Scale-Revised (CDRS-R) were administered to test convergent/discriminant validity. Discriminant validity was further tested using one-way ANOVA and "receiver operating characteristic" (ROC) curves. Inter-rater reliability was tested using correlation coefficients. Findings: Across 232 youth, Cronbach's alpha values were 0.932 for the BPSS-FP total score, 0.878 for the Mania Symptom Index, 0.887 for the Depression Symptom Index, and 0.797 for the General Symptom Index. Correlation coefficients for inter-rater reliability were high for the Mania Symptom Index (r = 0.989), Depression Symptom Index (r = 0.973), and General Symptom Index (r = 0.981). There were high correlations between the BPSS-FP Mania Symptom Index subscore and YMRS (r = 0.732), and the BPSS-FP Depression Symptom Index subscore and CDRS-R (r = 0.754), whereas cross-polarity correlations were non-significant. ROC analysis cut-off value was ≥21 for the BPSS-FP Mania Symptom Index between patients with BD and MDD (specificity = 85.7%, sensitivity = 78.7%). Conclusion: The Turkish version of the BPSS-FP has good psychometric properties and can be used in research. Longitudinal studies are needed to confirm the predictive value of the BPSS-FP.

Arthroscopic Quantitative Measurement of Medial Clear Space for Deltoid Injury of the Ankle: A Cadaveric Comparative Study With Stress Radiography

Background: The deltoid ligament (DL) is an important stabilizer of the ankle. DL injury of varying severity can occur alone or with syndesmotic injury and fibular fracture. Limited diagnostic tools are available to assess DL injury quantitatively. Purpose: To establish an arthroscopic quantitative assessment of DL injury and to compare its performance with that of external rotation stress (ERS) and gravity stress (GS) radiography. Study Design: Controlled laboratory study. Methods: In total, 24 cadaveric lower extremities were divided into 4 groups: group 1 consisted of intact DL, group 2 of superficial DL disruption, group 3 of deep DL disruption, and group 4 of complete DL (superficial and deep) disruption. All specimens underwent sequential sectioning of syndesmotic ligaments, and medial clear space (MCS) was measured with ankle arthroscopy, ERS radiography, and GS radiography at different stages of syndesmotic sectioning. Results: For noninjured deltoid (group 1) and injured deltoid (groups 2-4), area under the receiver operating characteristic curve (AUC) of measurement of MCS was 0.939 for arthroscopy, 0.932 for ERS radiography, and 0.874 for GS radiography, with a significant difference between arthroscopy and GS radiography (P = .014). For incomplete deltoid injury (groups 1-3) and complete deltoid injury (group 4), the AUC of MCS was 0.811 for arthroscopy, 0.656 for ERS radiography, and 0.721 for GS radiography, with a significant difference between arthroscopy and ERS radiography (P < .001) and between arthroscopy and GS radiography (P = .035). For all stages of syndesmotic sectioning, cutoff values of arthroscopic MCS with intact fibula were ≤2.5 mm for intact DL, between 2.5 and 3.5 mm for partial DL injury (superficial or deep), and ≥3.5 mm for complete DL injury. Arthroscopy was unable to detect a difference between superficial deltoid injury (group 2) and deep deltoid injury (group 3) in partial DL injury, with a measured MCS between 2.5 and 3.5 mm. The intraclass correlation coefficient of interrater reliability was 0.975 for arthroscopy, 0.917 for ERS radiography, and 0.811 for GS radiography. Conclusion: Arthroscopic MCS measurement can differentiate intact DL, partial DL injury, and complete DL injury. Compared with ERS and GS radiography, arthroscopic MCS measurement has greater accuracy with excellent interrater reliability. Clinical Relevance: For patients with suspected DL injury, arthroscopic MCS is useful for determining deltoid lesion severity based on defined cutoff values for consideration in preoperative planning to improve surgical outcomes.

The Reliability of the African Neuropsychology Battery in Persons of African Descent.

The African Neuropsychology Battery (ANB) includes eight culturally appropriate cognitive tests developed for use in the Congo and other sub-Saharan African populations. The current study examines the reliability of the ANB in three samples of participants of African descent. Subjects were recruited in the United States and the Congo to participate in three studies of ANB internal consistency reliability (Study 1), test-retest reliability (Study 2), and interrater reliability for the two ANB measures (i.e., Visuospatial Memory and Proverb Tests) requiring examiner ratings of response adequacy (Study 3). Subjects were administered ANB tests of visuospatial perception, language, memory, abstract reasoning, and problem solving. We calculated Cronbach's alpha, corrected item-total correlations and mean inter-item correlations for internal consistency, Pearson product-moment correlations and intraclass correlation coefficients for test-retest reliability, and intraclass correlation coefficients for interrater reliability. The ANB tests had acceptable internal consistency (Cronbach's alphas ranging from .37 to .93). Across subtests, test-retest reliability coefficients ranged from .39 to .91, and intraclass correlation stability coefficients (ICCs) ranged from .39 to .82. Of the two ANB tests requiring interrater reliability, only the Proverb Test had a low ICC of .13, (confidence intervals: -.29 to .52). The present study demonstrated that most ANB tests show adequate reliability in participants of African descent. However, the scoring criteria of the African Proverb Test require revision in order to improve the interrater reliability of the measure.

Validation of a Korean version of mobile app rating scale (MARS) for apps targeting disease management.

The mobile app rating scale (MARS) is a widely used instrument for evaluating smartphone app quality. We aimed to examine the reliability and validity of the Korean version of MARS (MARS-K). Two independent raters performed the assessment using the translated 23-item questionnaire. We applied intraclass correlation coefficient analysis (ICC) to examine inter-rater reliability, Omega, and item-total correlation for internal consistency, and Pearson's r for test-retest reliability and correlation between subscales and the total score of MARS-K. Most items showed moderate to good ICC (0.447-1.000). The MARS-K showed excellent internal consistency and all subscales exceeded the acceptable level of omega. Results indicated MARS-K to be a valid and reliable instrument for evaluating disease management apps offered in the Korean app store. However, upgrades are recommended to further improve MARS-K's rating accuracy and reliability.