Two-way Random Effects Research Articles

Effect of number of diffusion-encoding directions in diffusion metrics of 5-year-olds using tract-based spatial statistical analysis.

Methodological aspects and effects of different imaging parameters on DTI (diffusion tensor imaging) results and their reproducibility have been recently studied comprehensively in adult populations. Although MR imaging of children's brains has become common, less interest has been focussed on researching whether adult‐based optimised parameters and pre‐processing protocols can be reliably applied to paediatric populations. Furthermore, DTI scalar values of preschool aged children are rarely reported. We gathered a DTI dataset from 5‐year‐old children (N = 49) to study the effect of the number of diffusion‐encoding directions on the reliability of resultant scalar values with TBSS (tract‐based spatial statistics) method. Additionally, the potential effect of within‐scan head motion on DTI scalars was evaluated. Reducing the number of diffusion‐encoding directions deteriorated both the accuracy and the precision of all DTI scalar values. To obtain reliable scalar values, a minimum of 18 directions for TBSS was required. For TBSS fractional anisotropy values, the intraclass correlation coefficient with two‐way random‐effects model (ICC[2,1]) for the subsets of 6 to 66 directions ranged between 0.136 [95%CI 0.0767;0.227] and 0.639 [0.542;0.740], whereas the corresponding values for subsets of 18 to 66 directions were 0.868 [0.815;0.913] and 0.995 [0.993;0.997]. Following the exclusion of motion‐corrupted volumes, minor residual motion did not associate with the scalar values. A minimum of 18 diffusion directions is recommended to result in reliable DTI scalar results with TBSS. We suggest gathering extra directions in paediatric DTI to enable exclusion of volumes with motion artefacts and simultaneously preserve the overall data quality.

Evaluation of Enforcement and Messaging Campaign Focused on Reducing Cell Phone-Related Distracted Driving

Cellular telephone use has increased significantly in the United States as 97% of residents now own some type of cell phone. The ubiquity of cell phones has introduced concerns with respect to traffic safety as cell phone-related distractions have been shown to affect driving ability and increase crash risk. Various countermeasures have been implemented to address this issue, including public outreach campaigns and targeted enforcement activities. However, the efficacy of such strategies has been the subject of limited research. This paper examines cell phone use rates in consideration of enforcement activities in conjunction with targeted safety messages on roadside dynamic message signs. Two phases of enforcement were conducted in two urbanized areas of Michigan. Data were collected before, during, and after the enforcement period. A two-way random effects logistic regression model was estimated, and the results showed that cell phone use rates were lower during and, particularly, after the enforcement activities were conducted. Use rates were also found to vary based on age, gender, and race, allowing for the identification of target groups for public awareness and outreach campaigns. Use rates were also lower at freeway exit ramps as compared to signalized and stop-controlled surface street intersections. Lastly, cell phone-specific safety messages were associated with lower use rates compared with other message types, suggesting a potential synergistic effect.

High correlation between inner and outer glenoid circle diameters and its clinical relevance.

The majority of methods for measuring glenoid bone loss in shoulder instability use the best-fit circle following the inferior glenoid rim. However, there is no precise method on how to draw this circle, particularly in case of a missing rim segment. Defining the radius is a source of substantial error. It was hypothesized that there is a relationship between the best-fit inferior circle (inner circle), defined by Sugaya, and the circle tangent to the supra- and infra-glenoid tubercles (outer circle), defined by Itoi, thus allowing a more consistent appreciation of the paleo-glenoid. Ninety-five normal dry scapulae were examined. The specimens were digitally photographed obtaining perpendicular images of the glenoid cavity. Using HOROS® imaging software, a best-fit inferior circle (inner circle) and a second circle fitting the most inferior and superior points of the glenoid (outer circle) were drawn by two investigators. The diameters and areas of the circles were recorded. Two-way random-effects intra-class correlation coefficients (ICC) were used to measure intra- and inter-observer agreement. A Bayesian measurement-error regression model was used to determine the relationship between outer and inner circle measurements. The mean glenoid height was 35.1mm and the glenoid width 25.6mm. The mean diameter of the outer circle was 35.7 ± 4.2mm and the mean diameter of the inner circle was 26.8 ± 3.2mm. ICC showed excellent inter- and intra-observer agreement for both the outer circle diameter (ICC ≥ 0.95) and inner circle diameter (ICC ≥ 0.93). The two diameters demonstrated a very strong significant Pearson correlation (0.92, p < 0.001) and the regression showed excellent model fit R2 = 0.87. The areas of the two circles were also highly and significantly correlated (r = 0.94; p < 0.001). The ratio of inner circle to outer diameters was 0.74. There is a strong correlation between the inner and outer glenoid circle diameters. This study sets the base for the use the combined outer and inner circle and its ratio to better appreciate the paleo-glenoid morphology and thus obtain a more reliable bone loss estimation. Application of this method aids in a more reliable estimation bone loss with potential benefit in surgical decision-making.

Smartphone-based behavioral monitoring and patient-reported outcomes in adults with rheumatic and musculoskeletal disease

BackgroundRheumatic and musculoskeletal diseases (RMD) are associated with depression, fatigue, and disturbed sleep – symptoms that often impact behavior and activity. Patient reported outcomes (PROs) are a way of collecting information on the patient symptom experience directly from the individual. The purpose of this study was to measure and compare user smartphone sensor and activity data in adults with RMDs and assess associations with PROs.MethodsWe invited adults with RMDs enrolled in the FORWARD Databank to participate by installing a custom app on their smartphone and answering PROs (pain, global, HAQ-II) questions daily and weekly over 3 years. Passive data collected included mobility distance, unique calls and text messages, call durations, and number of missed calls. Confounders included sociodemographic, clinical, passive phone behavior, and seasonal factors. Kappa statistics between PRO and flares were computed to measure agreement. The agreement between daily and weekly VAS pain was estimated using the intraclass (ICC) correlation of a two-way random effect model. The relationship between the weekly PRO outcomes and the passive phone data was analyzed with a linear mixed-effect model (LMM), including a random intercept for participant and slope for time in the study with an unstructured covariate structure.ResultsOf the 446 participants, the mean (SD) age was 54 (12) years, most (65.5%) had rheumatoid arthritis (RA), the vast majority (91%) were female, and the US Northeast has the least representation (12%). Longer reaction times, interaction diversity, and higher mobility were associated with worse PROs while longer text messages were associated with better PROs. Participants in this study showed good levels of adherence which holds promise for future interventions using passive behavior measures in self-management and clinical follow-up.ConclusionThis is the first study to examine passive smartphone behavior with PROs in RMDs and we found significant associations between these behaviors and important health outcomes of pain and function. As smartphone usage continues to change, future studies should validate and expand on our findings with a goal of finding changes in patient symptoms passively through mobile device monitoring.

Validity and reliability of the German translation of the Diabetes Foot Self-Care Behavior Scale (DFSBS-D).

Comprehensive regular foot self-care is one of the most critical self-management behaviors for people with diabetes to prevent foot ulcer development and related complications. Yet, adequate foot self-care is only practiced by very few of those affected. To improve diabetic foot syndrome prevention, a valid and reliable instrument for measuring daily foot-care routines in patients with diabetes is needed. However, no such instrument is currently available in the German language. This study, therefore, aims to translate and cross-culturally adapt the "Diabetic Foot Self-Care Behavior Scale" (DFSBS) into German (DFSBS-D) and evaluate its validity and reliability. The DFSBS was translated from English into German using a forward-backward procedure as per previous recommendations. Factor analysis was used to study structural validity. To establish construct validity, 21 a priori hypotheses were defined regarding the expected correlation between scores on the new German version (i.e., DFSBS-D) and those of the following questionnaires measuring related constructs: (1) German version "Diabetes Self-Care Activities Measure" (SDSCA-G), (2) "Frankfurter Catalogue of Foot Self-Care" (FCFSP), and (3) "Short Form 36" (SF-36) and tested in 82 patients. To assess test-retest reliability, patients completed the DFSBS-D again after a 2-week interval. Test-retest reliability was assessed from stable patients' data (n = 48) by calculating two-way random-effects absolute agreement ICCs with 95% CI and Bland and Altman analyses. In addition, Cronbach's alpha was calculated as internal consistency measure. The 7-item DFSBS-D showed good structural validity. Its single factor explains 57% of the total sample variance. Of the 21 predefined hypotheses, 13 (62%) were confirmed. The DFSBS-D's internal consistency was good (Cronbach's alpha = 0.87). Test-retest reliability over a 2-week interval was also good (ICC 0.76). The DFSBS was successfully translated into German. Statistical analyses showed good DFSBS-D structural validity, test-retest reliability, and internal consistency. Yet, construct validity may be debated.

Assessing the diagnostic accuracy and interobserver agreement of MRI perfusion in differentiating disease progression and pseudoprogression following treatment for glioblastoma in a tertiary UK centre

To assess the local diagnostic accuracy and interobserver agreement of dynamic susceptibility contrast-enhanced magnetic resonance perfusion (DSC MRP) reporting in differentiating between disease progression and pseudoprogression (PP) at a tertiary UK centre. This retrospective study included adults with histology-proven glioblastoma who underwent an index DSC MRP examination following treatment. Each index examination was evaluated by three reporters independently, including qualitative assessment and measurement of mean regional cerebral blood volume (rCBVmean) ratios. Consensus opinion was used as the reference standard and considered clinical, radiological and histological follow-up information. Examination reports were compared to each other and to the consensus opinion. Thirty-two cases were included (19 progression, 13 pseudoprogression). Interobserver agreement was fair for qualitative opinion (κ=0.58, 95% confidence interval [CI] 0.40-0.76) and good for rCBVmean ratio measurement (intraclass correlation coefficient [ICC, two-way random effects model] 0.63, 95% CI=0.43-0.78). Qualitative opinion showed diagnostic accuracies of 77.1% (95% CI=67.4-85.1) for progression and 75% (95% CI=65.1-83.3) for pseudoprogression. rCBVmean ratios were higher for progression (6.85±3.98) than pseudoprogression (3.71±3.40); a 3.0 threshold value maximised the sum of sensitivity (91.1%) and specificity (69.7%) on receiver operating characteristic analysis. DSC MRP and rCBVmean ratio measurement aid differentiation between progression and pseudoprogression following treatment for glioblastoma. Measurement of the rCBVmean ratio shows good interobserver agreement and can change opinion and improve confidence in DSC MRP reporting. Individual centres should validate their own threshold rCBVmean ratio values to optimise diagnostic accuracy.

The (extended) achondroplasia foramen magnum score has good observer reliability

BackgroundAchondroplasia is the most common skeletal dysplasia. A significant complication is foramen magnum stenosis. When severe, compression of the spinal cord may result in sleep apnea, sudden respiratory arrest and death. To avoid complications, surgical decompression of the craniocervical junction is offered in at-risk cases. However, practice varies among centres. To standardize magnetic resonance (MR) reporting, the achondroplasia foramen magnum score was recently developed. The reliability of the score has not been assessed.ObjectiveTo assess the interobserver reliability of the achondroplasia foramen magnum score.Materials and methodsBase of skull imaging of children with achondroplasia under the care of Sheffield Children’s Hospital was retrospectively and independently reviewed by four observers using the achondroplasia foramen magnum score. Two-way random-effects intraclass coefficient (ICC) was used to assess inter- and intra-observer reliability.ResultsForty-nine eligible cases and five controls were included. Of these, 10 were scored normal, 17 had a median score of 1 (mild narrowing), 11 had a median score of 2 (effacement of cerebral spinal fluid), 10 had a score of 3 (compression of cord) and 6 had a median score of 4 (cord myelopathic change). Interobserver ICC was 0.72 (95% confidence interval = 0.62–0.81). Intra-observer ICC ranged from 0.60 to 0.86. Reasons for reader disagreement included flow void artefact, subtle T2 cord signal and myelopathic T2 cord change disproportionate to canal narrowing.ConclusionThe achondroplasia foramen magnum score has good interobserver reliability. Imaging features leading to interobserver disagreement have been identified. Further research is required to prospectively validate the score against clinical outcomes.

Evaluation of the psychometric properties of the Swiss French version of the Older People\u2019s Quality of Life questionnaire (OPQOL-35-SF)

BackgroundThe proportion of the world population aged over 65 years is increasing in the world population. Quality of life is an important factor in the biopsychosocial management of older patients. The Older People’s Quality of Life-35 (OPQOL-35) questionnaire was developed specifically for assessment of the quality of life of older people. The aim of this study is to evaluate the psychometric properties of a Swiss French version of the OPQOL-35 questionnaire (OPQOL-35-SF).MethodsForward–backward procedure was used to translate the original questionnaire from English into Swiss French. A sample of older people then completed the questionnaire. Construct validity of the OPQOL-35-SF was evaluated by comparing the results with those from three other questionnaires [World Health Organisation Quality of Life in older people questionnaire (WHOQOL-OLD), Control, Autonomy, Self-realization, Pleasure in 12 questions (CASP-12), and EuroQol-5-dimensions-5-levels (EQ-5D-5L)] and two visual analogue scales (health and quality of life). The structure of the OPQOL-35-SF questionnaire was assessed using exploratory and confirmatory factor analysis. To evaluate the reliability the OPQOL-35-SF questionnaire was completed a second time after 7–23 days.ResultsA total of 264 older people completed all the questionnaires at the first session, and 262 completed the OPQOL-35-SF again at the second session. Mean age of participants was 76.8 (standard deviation (SD) = 7.1) years. The majority of participants were women (73.9%). The Kaiser–Meyer–Olkin Measure of Sampling Adequacy (KMO) was 0.86 and Bartlett’s test of sphericity was significant (p < 0.001). The result of Exploratory Factor Analysis (EFA) revealed 8 factors with eigenvalues greater than one, which explained 58% of the observed variance. All items had an acceptable loading (< 0.30) in at least one factor. The convergent validity presented low to moderate correlations (rho: 0.384–0.663). Internal consistency was good (Cronbach’s alpha 0.875 for test and 0.902 for retest). Test–retest reliability presented an intra-class correlation coefficient, two-way random effects, absolute agreement, single rater (ICC2.1) of 0.83 [95% confidence interval (CI) 0.78–0.87].ConclusionsThe Swiss French version of the OPQOL-35 questionnaire shows good psychometric properties, which permit its use in clinical practice or research. A supplementary sample would be necessary for a better distribution of the items in the different factors.

Interobserver reliability of scapula fracture classifications in intra- and extra-articular injury patterns

BackgroundMorphology and glenoid involvement determine the necessity of surgical management in scapula fractures. While being present in only a small share of patients with shoulder trauma, numerous classification systems have been in use over the years for categorization of scapula fractures. The purpose of this study was to evaluate the established AO/OTA classification in comparison to the classification system of Euler and Rüedi (ER) with regard to interobserver reliability and confidence in clinical practice.MethodsBased on CT imaging, 149 patients with scapula fractures were retrospectively categorized by two trauma surgeons and two radiologists using the classification systems of ER and AO/OTA. To measure the interrater reliability, Fleiss kappa (κ) was calculated independently for both fracture classifications. Rater confidence was stated subjectively on a five-point scale and compared with Wilcoxon signed rank tests. Additionally, we computed the intraclass correlation coefficient (ICC) based on absolute agreement in a two-way random effects model to assess the diagnostic confidence agreement between observers.ResultsIn scapula fractures involving the glenoid fossa, interrater reliability was substantial (κ = 0.722; 95% confidence interval [CI] 0.676–0.769) for the AO/OTA classification in contrast to moderate agreement (κ = 0.579; 95% CI 0.525–0.634) for the ER classification system. Diagnostic confidence for intra-articular fracture patterns was superior using the AO/OTA classification compared to ER (p < 0.001) with higher confidence agreement (ICC: 0.882 versus 0.831). For extra-articular fractures, ER (κ = 0.817; 95% CI 0.771–0.863) provided better interrater reliability compared to AO/OTA (κ = 0.734; 95% CI 0.692–0.776) with higher diagnostic confidence (p < 0.001) and superior agreement between confidence ratings (ICC: 0.881 versus 0.912).ConclusionsThe AO/OTA classification is most suitable to categorize intra-articular scapula fractures with glenoid involvement, whereas the classification system of Euler and Rüedi appears to be superior in extra-articular injury patterns with fractures involving only the scapula body, spine, acromion and coracoid process.

Initial Experience on Hyperpolarized [1-13C]Pyruvate MRI Multicenter Reproducibility-Are Multicenter Trials Feasible?

Background: Magnetic resonance imaging (MRI) with hyperpolarized [1-13C]pyruvate allows real-time and pathway specific clinical detection of otherwise unimageable in vivo metabolism. However, the comparability between sites and protocols is unknown. Here, we provide initial experiences on the agreement of hyperpolarized MRI between sites and protocols by repeated imaging of same healthy volunteers in Europe and the US. Methods: Three healthy volunteers traveled for repeated multicenter brain MRI exams with hyperpolarized [1-13C]pyruvate within one year. First, multisite agreement was assessed with the same echo-planar imaging protocol at both sites. Then, this was compared to a variable resolution echo-planar imaging protocol. In total, 12 examinations were performed. Common metrics of 13C-pyruvate to 13C-lactate conversion were calculated, including the kPL, a model-based kinetic rate constant, and its model-free equivalents. Repeatability was evaluated with intraclass correlation coefficients (ICC) for absolute agreement computed using two-way random effects models. Results: The mean kPL across all examinations in the multisite comparison was 0.024 ± 0.0016 s−1. The ICC of the kPL was 0.83 (p = 0.14) between sites and 0.7 (p = 0.09) between examinations of the same volunteer at any of the two sites. For the model-free metrics, the lactate Z-score had similar site-to-site ICC, while it was considerably lower for the lactate-to-pyruvate ratio. Conclusions: Estimation of metabolic conversion from hyperpolarized [1-13C]pyruvate to lactate using model-based metrics such as kPL suggests close agreement between sites and examinations in volunteers. Our initial results support harmonization of protocols, support multicenter studies, and inform their design.

Evaluation of the Simpson's Method to Determine Left Ventricular Ejection Fraction Using the Transgastric Two-Chamber View.

Left ventricular chamber size and functional assessment by transesophageal echocardiography can be difficult if visualization is poor in the mid-esophageal views. However, the accuracy of using the Simpson's method in the transgastric 2-chamber (TG2C) as an alternative approach has not been assessed. The Simpson's method was performed by 2 independent reviewers using midesophageal 2-chamber (ME2C) and TG2C views. Echocardiographic images were retrieved retrospectively for 49 adult cardiac surgical patients. Two-way random effects intraclass correlation coefficients demonstrated no significant interobserver variability. Linear mixed effects models showed no significant differences in ME2C and TG2C measurements with regard to EDV (P=.4407), ESV (P=.5113), or EF (P=.0610).Compared to the ME2C view, the TG2C view had better image quality of the LV walls (image quality score median [interquartile range]: 2.00 [.00] vs 1.00 [1.00]; P<.0001), but worse image quality of the mitral annulus (1.00 [1.00] vs 2.00 [.00]; P<.0001) and LV apex (.00 [1.00] vs 2.00 [1.00]; P<.0001). This study suggests the Simpson's method can be applied to the TG2C view as an alternative to the standard midesophageal method to estimate chamber volumes and EF.

Interrater reliability of quantitative ultrasound measures of muscle in critically ill patients.

Quantitative neuromuscular ultrasound is increasingly used to study muscle pathology and changes in muscle mass during critical illness. Advantages of ultrasound are high axial resolution, low procedural risks, no ionizing radiation, and ease of use early in the course of disease. However, ultrasound is known to be an operator dependent imaging modality and the intensive care unit setting poses additional challenges to obtaining reliable measurements. There is limited evidence validating the feasibility and reliability of its application in this setting. To conduct a standardized protocol for measuring muscle linear depth and cross-sectional area in critically ill populations with a high degree of interrater agreement and feasibility. Prospective observational cohort study of interrater reliability. Medical intensive care unit at an academic medical center and a level one trauma and burn center. Fifteen critically ill patients were evaluated using a standardized ultrasound protocol measuring total elbow flexor, knee extensor, and tibialis anterior depth, as well as rectus femoris cross-sectional area. Each site was independently scanned by two investigators. Reliability of measurements between observers was determined by calculating intraclass correlation coefficients (ICCs) using a two-way random effects model and absolute agreement. An ICC > 0.75 was considered good and >0.90 was considered excellent. In critically ill patients, interrater reliability of linear depth measured at elbow flexor, knee extensor, tibialis anterior, and cross-sectional area of rectus femoris sites was good to excellent with ICC between 0.87 (0.54-0.97) and 0.99 (0.97-1.00). Interrater reliability was improved by creating a summary index of measures resulting in an ICC of 0.99 (0.98-1.00). Feasibility, as definite by the percentage of each measure that was obtainable, ranged from 75%-100%. Using a standardized protocol, ultrasound measures obtained in critically ill patients demonstrated high levels of interrater agreement with good to excellent feasibility.

The MICK (Mobile integrated cognitive kit) app: Digital rapid automatized naming for visual assessment across the spectrum of neurological disorders

ObjectiveRapid automatized naming (RAN) tasks have been utilized for decades to evaluate neurological conditions. Time scores for the Mobile Universal Lexicon Evaluation System (MULES, rapid picture naming) and Staggered Uneven Number (SUN, rapid number naming) are prolonged (worse) with concussion, mild cognitive impairment, multiple sclerosis and Parkinson's disease. The purpose of this investigation was to compare paper/pencil versions of MULES and SUN with a new digitized format, the MICK app. MethodsParticipants (healthy office-based volunteers, professional women's hockey players), completed two trials of the MULES and SUN tests on both platforms (tablet, paper/pencil). The order of presentation of the testing platforms was randomized. Between-platform variability was calculated using the two-way random-effects intraclass correlation coefficient (ICC). ResultsAmong 59 participants (median age 32, range 22–83), no significant differences were observed for comparisons of mean best scores for the paper/pencil versus MICK app platforms, counterbalanced for order of administration (P = 0.45 for MULES, P = 0.50 for SUN, linear regression). ICCs for agreement between the MICK and paper/pencil tests were 0.92 (95% CI 0.86, 0.95) for MULES and 0.94 (95% CI 0.89, 0.96) for SUN, representing excellent levels of agreement. Inter-platform differences did not vary systematically across the range of average best time score for either test. ConclusionThe MICK app for digital administration of MULES and SUN demonstrates excellent agreement of time scores with paper/pencil testing. The computerized app allows for greater accessibility and scalability in neurological diseases, inclusive of remote monitoring. Sideline testing for sports-related concussion may also benefit from this technology.

Translation of Karnofsky Performance Status (KPS) for use in inpatient cancer rehabilitation.

Better tools are needed to predict functional decline and oncologic prognosis in inpatient cancer rehabilitation. The Karnofky Performance Status (KPS) is a widely used scale of functional performance in oncology, although the scale differs from current rehabilitation terminology. Use of the KPS in inpatient rehabilitation may support a shared method of communication between cancer rehabilitation providers and the primary oncology teams. To establish interrater reliability for translation of the KPS for use in inpatient cancer rehabilitation. Retrospective interrater reliability review. A large inpatient rehabilitation hospital system. Fifty randomized charts were chosen for review from a larger database of all patients admitted to an inpatient cancer rehabilitation program in 2020. Not applicable. The KPS scale was translated into common inpatient rehabilitation grading consistent with the Continuity and Assessment Record and Evaluation (CARE) Item Set to support its use in this specialty area. Additionally, a list of best practice guidelines and scoring instructions were created to assist raters in determining appropriate levels within the scale. Members of the inpatient cancer rehabilitation team scored all patients within the larger database (n=424) throughout 2020. A blinded rater completed retrospective chart reviews to score the 50-chart sample. A two-way random effects model was used to calculate an intraclass correlation coefficient (ICC) for the KPS scores at each of three time points (premorbid, admission, and discharge). The KPS interpretation for rehabilitation proved to be statistically reliable for the 50-chart sample. The premorbid KPS interrater reliability was acceptable (ICC=0.67; 95% confidence interval [CI]: 0.40-0.82), admission KPS reliability was good (ICC=0.88, 95% CI: 0.78-0.93), and discharge reliability was excellent (ICC=0.96; 95% CI: 0.91-0.98). The KPS translation at three time points (premorbid, admission, and discharge) during the inpatient rehabilitation continuum has acceptable interrater reliability.

Test-Retest Reliability and Agreement of Single Pulse Transcranial Magnetic Stimulation (TMS) for Measuring Activity in Motor Cortex in Patients With Acute Ischemic Stroke.

Transcranial magnetic stimulation (TMS) is often used to examine neurophysiology. We aimed to investigate the inter-rater reliability and agreement of single pulse TMS in hospitalised acute ischemic stroke patients. Thirty-one patients with first-time acute ischemic stroke (median age 72 (IQR 64-75), 35% females) underwent TMS motor threshold (MT) assessment in 4 muscles bilaterally, conducted by 1 of 2 physiotherapists. Test-retest reliability was evaluated using a two-way random effects model (2,1) absolute agreement-type Interclass Correlation Coefficient (ICC). Standard Error of Measurement (SEM) and Smallest Detectable Change (SDC) were used to evaluate agreement. Reliability, SEM, and SDC of TMS was found to be moderate in right opponens pollicis (0.78 [CI 95% 0.55-0.89], SEM: 4.51, SDC: 12.51), good in right vastus medialis and tibial anterior (0.88 [CI 95% 0.72-0.96], SEM: 2.89, SDC: 8.01 and 0.88 [CI 95% 0.76-0.94], SEM: 2.88, SDC: 7.98 respectively), and excellent in right and left biceps brachii (0.98 [CI 95% 0.96-0.99], SEM: 1.79 SDC: 4.96, and 0.94 [CI 95% 0.89-0.97], SEM: 2.17 SDC: 6.01), opponens pollicis (0.92 [CI 95% 0.83-0.96], SEM: 2.68 SDC: 8.26, vastus medialis (0.92 [CI 95% 0.84-0.96], SEM: 2.87 SDC: 7.95), and tibial anterior (0.93 [CI 95% 0.86-0.96], SEM: 2.51 SDC: 6.95). The TMS demonstrated moderate to excellent inter-rater reliability confirming the ability of these measures to reliably discriminate between individuals in the current study sample. Improvements of less than 4.96 to 12.51 could be a result of measurement error and may therefore not be considered a true change.

Reliability of the Preliminary OMERACT Juvenile Idiopathic Arthritis MRI Score (OMERACT JAMRIS-SIJ).

This study reports the reliability of the juvenile idiopathic arthritis magnetic resonance imaging scoring system (JAMRIS-SIJ). The study comprised of eight raters—two rheumatologists and six radiologists—and 30 coronal T1 and Short-Tau Inversion Recovery (STIR) MRI scans of patients with enthesitis-related juvenile spondylarthritis. The median age of patients was 15 years with a mean disease duration of 5 years and 22 (73.3%) of the sample were boys. The inter-rater agreement of scores for each of the JAMRIS-SIJ items was calculated using a two-way random effect, absolute agreement, and single rater intraclass correlation coefficient (ICC 2.1). The ICC was interpreted together with kurtosis, since the ICC is also affected by the distribution of scores in the sample. The eight-rater, single measure inter-rater ICC (and kurtosis) values for JAMRIS-SIJ inflammation and damage components were the following: bone marrow edema (BME), 0.76 (1.2); joint space inflammation, 0.60 (1.8); capsulitis, 0.58 (9.2); enthesitis, 0.20 (0.1); ankylosis, 0.89 (35); sclerosis, 0.53 (4.6); erosion, 0.50 (6.5); fat lesion, 0.40 (21); backfill, 0.38 (38). The inter-rater reliability for BME and ankylosis scores was good and met the a priori set ICC threshold, whereas for the other items it was variable and below the selected threshold. Future directives should focus on refinement of the scores, definitions, and methods of interpretation prior to validation of the JAMRIS-SIJ through the assessment of its measurement properties.

Examining Impacts of COVID-19-Related Stay-At-Home Orders through a Two-Way Random Effects Model.

The COVID-19 pandemic has had far-reaching impacts on public health and safety, economics, and the transportation system. To reduce the spread of this disease, federal and local governments around the world have introduced stay-at-home orders and other restrictions on travel to "non-essential" businesses to implement social distancing. Preliminary evidence suggests substantial variability in the impacts of these orders in the United States, both across states and over time. This study examines this issue using daily county-level vehicle miles traveled (VMT) data for the 48 continental U.S. states and the District of Columbia. A two-way random effects model is estimated to assess changes in VMT from March 1 to June 30, 2020 as compared with baseline January travel levels. The implementation of stay-at-home orders was associated with a 56.4 percent reduction in VMT on average. However, this effect was shown to dissipate over time, which may be attributable to "quarantine fatigue." In the absence of full shelter-in-place orders, travel was also reduced where restrictions on select businesses were introduced. For example, restrictions on entertainment, indoor dining, and indoor recreational activities corresponded to reductions in VMT of 3 to 4 percent while restrictions on retail and personal care facilities showed 13 percent lower traffic levels. VMT was also shown to vary based on the number of COVID case reports, as well as with respect to other characteristics, including median household income, political leanings, and how rural the county was in nature.

Financial system specialization and private research and development expenditure: research for OECD countries

Purpose The purpose of this paper is to analyse the role that different financial sources and financial specialization have on private research and development (R&amp;D) activity in OECD countries. Design/methodology/approach The authors developed several panel regressions choosing as a final model a two-way random effects regression to understand which funding sources are related to the R&amp;D expenditure, and how financial specialization has links to the private portion of R&amp;D aggregated expenditure. The authors include data from the years 2000 to 2016 for OECD countries. Findings The results reinforce the critical role that stock markets have in enhancing private R&amp;D and that bond markets have an inverse relationship with private R&amp;D national expenditures. The authors do not find evidence of a link between bank sources and private R&amp;D. Specialized financial systems (banking or market) support innovation in a better way than a mixed arrangement of those two systems. Practical implications The findings of this study have considerable policy implications. Policymakers need to be aware of these results, given that some variables related to financial markets, seems to boost the inputs for R&amp;D. In the long term, this could be a signal that national and regional systems of innovation need a broad view of the factors hampering scientific activity, and also a signal that there are other ways to impact the results of the complex innovation activity through the development of stronger financial systems backing up national systems of innovation. Originality/value The authors found that the long discussion about the financial system that a country has to choose to enhance growth with R&amp;D&amp;I may have been misleading the public policy. The findings show that rather than a bank or a stock market financial system, economies looking to boost R&amp;D&amp;I, must specialize in one of the two systems, deepen these and generate the appropriate policies to promote science, technology and innovation using those financial markets.

Cross-cultural adaptation of the Richards-Campbell Sleep Questionnaire for intensive care unit inpatients in Brazil: internal consistency, test-retest reliability, and measurement error

Study objectivesTo perform the cross-cultural adaptation of the Richards-Campbell sleep questionnaire (RCSQ) to Portuguese-Brazil and to eval its internal consistency, test-retest reliability, and measurement error in intensive care unit (ICU) inpatients. MethodsThe study enrolled 113 inpatients at medical/surgical ICU in Curitiba, Brazil. The RCSQ was first translated to Portuguese-Brazil according to the principles of good practice for the translation and cultural adaptation process for patient-reported outcomes and then applied in 30 inpatients. The final version (RCSQ-PT-Br) was applied to measure content validity (83 inpatients, 47 men [56.6%], 60.4 ± 14.2 years), and test-retest reliability and measurement error (a subset of 53 inpatients). Internal consistency of the RCSQ-PT-Br was estimated using Cronbach's a; test-retest reliability (2 independent rates) was assessed using the single measurement, absolute agreement, two-way random effects model (ICC2,1). ResultsGroup-average RCSQ-PT-Br total score was 46.9 ± 26.7 (range 3.4–98.8). The RCSQ-PT-Br total score showed good content internal consistency (Cronbach's α = 0.850 95%CI = [0.789–0.897]) and excellent test-retest reliability (ICC2,1 = 0.840 95% CI = [0.739–0.904]). Measurement error was low (standard error of mean = 11 mm, mean difference = 30 mm). ConclusionsThe RCSQ-PT-Br is a valid and reliable instrument to evaluate the sleep of patients hospitalized in the ICU in Brazil.

Adaptation and validation of the Nigerian Igbo Multidimensional Scale of Perceived Social Support in patients with chronic low back pain

IntroductionSocial support may be important in the perpetuation of symptoms in chronic low back pain (CLBP). The multidimensional scale of perceived social support (MSPSS) is one of the best measures of social support with applicability in Africa.AimsThe aims of this study were to translate, culturally adapt, test–retest, and assess cross-sectional psychometric properties of the Igbo-MSPSS.MethodsForward and backward translation of the MSPSS was done by clinicians and non-clinician translators and evaluated by a specialist review committee. The adapted measure was piloted amongst twelve adults with CLBP in rural Nigeria. Cronbach’s alpha and McDonald’s omega coefficient were used for investigating internal consistency. Intra-class correlation coefficient (ICC: two-way random effects model, average of raters’ measurements, absolute definition of agreement) reflecting both the degree of correlation and agreement between measurements was used for the statistical investigation of test–retest reliability. Criterion validity of the adapted measure was investigated with the eleven-point box scale, back performance scale, Roland Morris Disability Questionnaire, and World Health Organisation Disability Assessment Schedule amongst 200 people with CLBP in rural Nigeria using Spearman’s correlation analyses. Exploratory factor analyses conducted using Kaiser criterion and parallel analysis as methods for determining dimensionality were used to determine the structural validity of the adapted measure amongst the same sample of 200 rural dwellers.ResultsIgbo-MSPSS had excellent internal consistency (0.88) and ICC of 0.82. There were moderate correlations with measures associated with the social support construct. The same item–factor pattern in the three-dimensional structure (with Kaiser criterion) as in the original measure and a two-dimensional structure (with parallel analysis) were produced.ConclusionsIgbo-MSPSS is a measure of social support with some evidence of validity and reliability and can be used clinically or for research. Future studies are required to confirm its validity and reliability.