High Levels Of Test-retest Reliability Research Articles

Validation of the Chinese version stage of recovery instrument-30 (STORI-30) for adults with severe mental illness

BackgroundStage of Recovery Instrument-30 (STORI-30) is grounded in a five-stage model of psychological recovery, and serves as measuring recovery stage of people with mental illness.AimsTo develop and validate the Chinese version STORI-30 on adults with severe mental illness.MethodsSTORI-30 was translated to traditional Chinese through forward-backward method. An expert panel and potential users evaluated face validity and content validity. The Chinese version STORI-30 plus other convergent and divergent scales were then administered to 113 participants for field test.ResultsFace and content validity were confirmed with acceptable Content Validity Index and high inter-rater agreement. Exploratory factor analysis revealed a three-factor structure. An ordinal sequence was presented among the five subscales, similar to the original version. Construct validity was supported by positive correlations with recovery and mental well-being scales, and negative correlation with self-stigma scale. Good internal consistency (Cronbach’s α = 0.78–0.86) and high level of test-retest reliability (Intraclass correlation coefficient = 0.96) were obtained.ConclusionsChinese STORI-30 presents satisfactory psychometric properties in internal consistency, construct convergent and divergent validity, and test-retest reliability. The three-factor structure revealed does not echo the original five-stage recovery model. Further studies exploring the underlying structure are warranted.

Reliability of multi-site UK Biobank MRI brain phenotypes for the assessment of neuropsychiatric complications of SARS-CoV-2 infection: The COVID-CNS travelling heads study.

Magnetic resonance imaging (MRI) of the brain could be a key diagnostic and research tool for understanding the neuropsychiatric complications of COVID-19. For maximum impact, multi-modal MRI protocols will be needed to measure the effects of SARS-CoV-2 infection on the brain by diverse potentially pathogenic mechanisms, and with high reliability across multiple sites and scanner manufacturers. Here we describe the development of such a protocol, based upon the UK Biobank, and its validation with a travelling heads study. A multi-modal brain MRI protocol comprising sequences for T1-weighted MRI, T2-FLAIR, diffusion MRI (dMRI), resting-state functional MRI (fMRI), susceptibility-weighted imaging (swMRI), and arterial spin labelling (ASL), was defined in close approximation to prior UK Biobank (UKB) and C-MORE protocols for Siemens 3T systems. We iteratively defined a comparable set of sequences for General Electric (GE) 3T systems. To assess multi-site feasibility and between-site variability of this protocol, N = 8 healthy participants were each scanned at 4 UK sites: 3 using Siemens PRISMA scanners (Cambridge, Liverpool, Oxford) and 1 using a GE scanner (King's College London). Over 2,000 Imaging Derived Phenotypes (IDPs), measuring both data quality and regional image properties of interest, were automatically estimated by customised UKB image processing pipelines (S2 File). Components of variance and intra-class correlations (ICCs) were estimated for each IDP by linear mixed effects models and benchmarked by comparison to repeated measurements of the same IDPs from UKB participants. Intra-class correlations for many IDPs indicated good-to-excellent between-site reliability. Considering only data from the Siemens sites, between-site reliability generally matched the high levels of test-retest reliability of the same IDPs estimated in repeated, within-site, within-subject scans from UK Biobank. Inclusion of the GE site resulted in good-to-excellent reliability for many IDPs, although there were significant between-site differences in mean and scaling, and reduced ICCs, for some classes of IDP, especially T1 contrast and some dMRI-derived measures. We also identified high reliability of quantitative susceptibility mapping (QSM) IDPs derived from swMRI images, multi-network ICA-based IDPs from resting-state fMRI, and olfactory bulb structure IDPs from T1, T2-FLAIR and dMRI data. These results give confidence that large, multi-site MRI datasets can be collected reliably at different sites across the diverse range of MRI modalities and IDPs that could be mechanistically informative in COVID brain research. We discuss limitations of the study and strategies for further harmonisation of data collected from sites using scanners supplied by different manufacturers. These acquisition and analysis protocols are now in use for MRI assessments of post-COVID patients (N = 700) as part of the ongoing COVID-CNS study.

Conceptualising and measuring householder bushfire (wildfire) risk perception: The householder bushfire risk perception scale (HBRPS-4)

With increasing numbers of householders living in high bushfire (wildfire) risk areas, there is a need to better understand householders' bushfire risk perceptions. In the community bushfire safety research literature, there appears to be no consensus on how best to conceptualise and measure householders' bushfire risk perceptions. The aim of this research was to investigate the concept of bushfire risk perception and its measurement, and to develop a brief, reliable and valid measure of householders’ bushfire risk perceptions. Following a review of 26 studies, a four-item householder bushfire risk perception scale (HBRPS-4) was developed. Analysis of responses to an online survey of 375 householders indicated that the measure had high internal consistency (α = 0.93). There was evidence of: construct validity, concurrent convergent criterion validity (|r| range 0.21–0.58), and concurrent discriminant criterion validity (r ≤ 0.15). A supplementary study with 27 participants found a high level of test-retest reliability over a six-week period (r = 0.95). It is suggested that householder bushfire risk perception can be construed as a fuzzy concept, incorporating three risk perception elements (probability, consequences, concern) whose meaning boundaries are not well-differentiated. The HBRPS-4 appears to hold promise of being a useful measure for community bushfire safety research.

Validation of 'ItchApp©' in Poland and in the USA: multicentre validation study of an electronical diary for the assessment of pruritus.

Although chronic pruritus affects a large part of the population, its reliable assessment remains difficult. Electronical diaries (eDiaries) are often used in multicentre clinical trials. The ItchApp© for Android was developed to assess itch intensity and course and was validated for the German language in 2017. To validate ItchApp© for the use in the Polish and US English languages. Fifty-three subjects in Poland and thirty subjects in the USA with chronic pruritus completed the paper-based and app-based questionnaires. These questionnaires contained items for measuring the itch intensity, including a numerical rating scale (NRS) and verbal rating scale (VRS), and for detecting the change of pruritus since the beginning of treatment. The ItchApp© showed a high level of test-retest reliability [Intraclass correlation, Kappa and Kendall-Tau B coefficients: 0.915-1.000 (Poland) and 0.863-1.000 (USA)]. The convergent validity showed strong correlation between the itch intensity scales on the ItchApp© (Items II-IV=VRS mean, NRS mean and NRS worst) and the paper-based itch intensity scales (mean and worst: VRS, NRS, VAS) [Spearman-Rho and Pearson correlation coefficients: 0.710-0.987 (Poland) and 0.646-0.954 (USA)]. The ItchApp© items moderately correlated with the ItchyQol scores [Spearman-Rho and Pearson correlation coefficients: 0.303-0.554 (Poland) and 0.275-0.447 (USA)]. After completing the ItchApp© questionnaire, a feasibility questionnaire was completed and showed that subjects feel the app is well suited for assessing pruritus. We provide evidence for the ItchApp© as a validated eDiary for the assessment of pruritus in Polish and US English languages, enabling its use in multicentre international clinical trials.

TEST-RETEST RELIABILITY OF THE LIMITS OF STABILITY TEST PERFORMED BY YOUNG ADULTS USING NEUROCOM® VSR SPORT

A reliable measure of dynamic postural control is needed for inclusion in the sports-related concussion assessment battery. Currently, there is not a clinical gold standard. The Limits of Stability (LOS) test has potential to be a useful tool to collect objective data on important dynamic postural stability variables. Psychometric properties of the LOS test with healthy young adults are yet to be established. The purpose of this study was to examine the intra-session and test-retest reliability for the LOS on the NeuroCom® VSR Sport when performed by young adults. Reliability study. Twenty-seven healthy university students completed four trials of the LOS in each of two testing sessions one week apart. Relative reliability was measured within each session with an intraclass correlation coefficient (ICC[3,k]) for Session 1 and Session 2, respectively, on each of the five dependent variables (movement velocity [MVL], directional control [DCL], maximum excursion [MXE], endpoint excursion [EPE], and reaction time [RT]) provided by the Neurocom. Test-retest reliability was assessed using a repeated-measures analysis of variance along with an ICC (3,k) for relative reliability. An ICC value of 0.90 or higher was defined as having a high reliability, moderate reliability for ICC values between 0.80-0.89, and below 0.80 as questionable. The reliability within each session for LOS composite scores for MVL, DCL, and MXE was moderate to high (ICC[3,k]=0.89-0.95). These same three variables also had high levels of test-retest reliability (ICC[3,k]=0.95-0.96). EPE and RT had moderate reliability over time (ICC[3,k]=0.88) but differences for within session reliability. LOS provides a reliable measure of dynamic postural control for young adults. Two trials are recommended at baseline with the first being an adaptation trial to ensure accuracy of findings. Care needs to be taken when interpreting EPE and DCL scores on post-injury tests due to a learning effect for those variables. 2c.

Reliability and validity of the patellofemoral disability index as a measure of functional performance and subjective pain in subjects with patellofemoral pain syndrome

Objective: Patellofemoral pain syndrome (PFPS) is a condition that is characterized by patellar discomfort or pain that is aggravated during certain activities such as ascending/descending stairs. The Patellofemoral Disability Index (PDI) was developed to assess the effect of pain on functional activities in individuals with PFPS. The objectives of the current study were to determine the internal consistency, test-retest reliability, and validity of this index. Design: Cross-sectional study. Methods: Forty-one subjects who had PFPS with a mean age of 28.8±5.0 years and a mean body mass index of 25.6±4.7 kg/m2 participated in the study. All subjects were concurrently enrolled in a clinical trial for which they were instructed to complete hamstring-resistance exercises for 4 weeks. Over the course of the intervention, they completed both the PDI and the Oswestry Disability Index (ODI) at baseline after two weeks, and after four weeks. Pearson correlation coefficient was used to assess the criterion validity. Cronbach’s α was used to examine the internal consistency. Intraclass correlation coefficients with 95% confidence interval were computed to examine test-retest reliability. Results: Subjects’ responses within both the PDI and the ODI yielded Pearson correlation coefficient values that were positive and highly significant (range, 0.73-0.97; p<0.001). There was a high level of internal consistency (Cronbach’s α≥0.8), with the exception of stair climbing (Cronbach’s α=0.65). Intraclass correlation ranged from 0.87 to 0.92, indicating high levels of test-retest reliability. Conclusions: The PDI is a valid, reliable, and feasible method of assessing pain and functional ability in patients with PFPS.

Test Performance and Test-Retest Reliability of the Vestibular/Ocular Motor Screening and King-Devick Test in Adolescent Athletes During a Competitive Sport Season

Background: The Vestibular/Ocular Motor Screening (VOMS) and King-Devick (K-D) test are tools designed to assess ocular or vestibular function after a sport-related concussion. Purpose: To determine the test-retest reliability and rate of false-positive results of the VOMS and K-D test in a healthy athlete sample. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Forty-five healthy high school student-athletes (mean age, 16.11 ± 1.43 years) completed self-reported demographics and medical history and were administered the VOMS and K-D test during rest on day 1 (baseline). The VOMS and K-D test were administered again once during rest (prepractice) and once within 5 minutes of removal from sport practice on day 2 (removal). The Borg rating of perceived exertion scale was administered at removal. Intraclass correlation coefficients were used to determine test-retest reliability on the K-D test and the average near point of convergence (NPC) distance on the VOMS. Level of agreement was used to examine VOMS symptom provocation over the 3 administration times. Multivariate base rates were used to determine the rate of false-positive results when simultaneously considering multiple clinical cutoffs. Results: Test-retest reliability of total time on the K-D test (0.91 [95% CI, 0.86-0.95]) and NPC distance (0.91 [95% CI, 0.85-0.95]) was high across the 3 administration times. Level of agreement ranged from 48.9% to 88.9% across all 3 times for the VOMS items. Using established clinical cutoffs, false-positive results occurred in 2% of the sample using the VOMS at removal and 36% using the K-D test. Conclusion: The VOMS displayed a false-positive rate of 2% in this high school student-athlete cohort. The K-D test’s false-positive rate was 36% while maintaining a high level of test-retest reliability (0.91). Results from this study support future investigation of VOMS administration in an acutely injured high school athletic sample. Going forward, the VOMS may be more stable than other neurological and symptom report screening measures and less vulnerable to false-positive results than the K-D test.

Amazon’s Mechanical Turk as a Viable Source for Organizational and Occupational Health Research

Crowdsourcing is an increasingly popular method for organizational and occupational health research. Amazon’s Mechanical Turk (MTurk) is at the forefront of this trend, but few studies have examined the labor market characteristics of MTurk workers (Turkers) or results of organizational and occupational health data as compared to published benchmarks. To address these gaps, we review the current MTurk literature and present the results of a multi-wave study of Turker labor characteristics and organizational and occupational health variable relationships. We found Turkers to be broadly distributed across the labor market, indicating MTurk is a viable option for both generalizable and understudied samples, as well as a source for targeted occupational sectors. Additionally, we found effect size magnitudes to be comparable to published benchmarks, and data displayed high levels of test-retest reliability and stability of relationships across time. Our results support the use of MTurk as a viable source for organizational and occupational health research assuming general methodological concerns and validity threats are addressed (see Cheung et al. Journal of Business and Psychology 1–15, 2016).

Reproducibility of frequency-dependent low frequency fluctuations in reaction time over time and across tasks.

ObjectiveIncreased levels of reaction time variability (RTV) are characteristics of sustained attention deficits. The clinical significance of RTV has been widely recognized. However, the reliability of RTV measurements has not been widely studied. The present study aimed to assess the test-retest reliability of RTV conventional measurements, e.g., the standard deviation (SD), the coefficient of variation (CV), and a new measurement called the amplitude of low frequency fluctuation (ALFF) of RT. In addition, we aimed to assess differences and similarities of these measurements between different tasks.MethodThirty-seven healthy college students participated in 2 tasks, i.e., an Eriksen flanker task (EFT) and a simple reaction task (SRT), twice over a mean interval of 56 days. Conventional measurements of RTV including RT-SD and RT-CV were assessed first. Then the RT time series were converted into frequency domains, and RT-ALFF was further calculated for the whole frequency band (0.0023–0.167 Hz) and for a few sub-frequency bands including Slow-6 (<0.01 Hz), Slow-5 (0.01–0.027 Hz), Slow-4 (0.027–0.073 Hz), and Slow-3 (0.073–0.167 Hz). The test-retest reliability of these measurements was evaluated through intra-class correlation (ICC) tests. Differences and correlations between each EFT and SRT measurement were further examined during both visits.Results1) The RT-ALFF of the Slow-5/4/3 and conventional measurements of RT-SD and RT-CV showed moderate to high levels of test-retest reliability. EFT RT-ALFF patterns generated slightly higher ICC values than SRT values in higher frequency bands (Slow-3), but SRT RT-ALFF values showed slightly higher ICC values than EFT values in lower frequency bands (Slow-5 and Slow-4). 2) RT-ALFF magnitudes in each sub-frequency band were greater for the SRT than those for the EFT. 3) The RT-ALFF in the Slow-4 of the EFT was found to be correlated with the RT-ALFF in the Slow-5 of the SRT for both two visits, but no consistently significant correlation was found between the same frequency bands.ConclusionsThese findings reveal good test-retest reliability for conventional measurements and for the RT-ALFF of RTV. The RT-ALFF presented frequency-dependent similarities across tasks. All of our results reveal the presence of different frequency structures between the two tasks, and thus the frequency-dependent characteristics of different tasks deserve more attention in future studies.

공원 이용 실태 조사를 위한 무인비행장치의 활용성 연구 - 부산시 도시공원을 사례로 -

공원 이용행태는 주로 이용자 설문이나 행태 관찰을 통해 조사되어 왔다. 하지만 기존 방식들은 시간과 비용이 많이 소모되고, 응답자나 조사자의 주관에 취약하다는 한계를 갖는다. 이로 인해 개별 도시에서 활용할 수 있는 체계적이고 일관된 공원 이용 실태 조사기법이 부족한 실정이다. 이에 본 연구는 부산광역시 도시공원을 대상으로 공원 이용 조사를 위한 무인비행장치의 활용성을 파악해 보고자 한다. 특히 기존에 신뢰성과 타당성이 검증된 체계적 관찰 기법인 여가활동 관찰 기법(SOPARC)과 비교하여 본 기법의 유용성을 살펴본다. 연구결과, 무인비행장치를 이용한 관찰결과는 SOPARC의 결과와 매우 높은 상관성을 보였으며, 통계적으로 유의한 수준에서 차이가 없는 것으로 나타났다. 또한 두 기법 모두 높은 수준의 검사-재검사 신뢰도를 나타냈다. 무인비행장치를 활용한 방법은 기존 관찰기법들에 비해 넓은 지역을 관찰할 수 있고, 정밀한 이용자 수 조사 및 공간 시설 이용패턴 파악에 적합한 장점을 가진 반면, 자세한 이용자 정보를 파악하기 어렵고, 날씨 등 조사 여건의 제약이 많다는 한계를 보였다. 따라서 두 기법을 상호보완적으로 활용하는 것이 바람직할 것이다. 마지막으로 무인비행장치를 활용한 공원 이용 조사 시 유의할 사항들을 제안하였다. Two primary tools to study park use are surveys and direct observation. Existing methods, however, are limited in terms of considerable costs in both time and money and the personal bias of respondents or observers. These limitations result in a lack of efficient, reliable, and affordable tools to investigate park use. This study explores the reliability and usability of unmanned aerial vehicles(UAVs) to explore park use in urban parks in Busan metropolitan city. By comparing with a systematic observation tool, SOPARC(System for Observing Play and Recreation in Communities), this study finds that the number of park users observed by two different techniques are highly correlated and not significantly different with each other. In addition, both methods show a high level of test-retest reliability. Comparing to existing methods, the UAV-using observation tool could cover larger target areas and is suitable to count park users in a more reliable and efficient way and map their use patterns, although it is weak in collecting detailed user information and surveying under poor conditions such as rain. Thus, the UAV method could complement direct observation. This study suggests practical implications of a UAV method to study park use.

Dementia Knowledge Assessment Scale: Development and Preliminary Psychometric Properties.

To develop a reliable and valid dementia knowledge scale to address limitations of existing measures, support knowledge evaluation in diverse populations, and inform educational intervention development. A five-stage, systematic scale development process was employed to construct and assess the psychometric properties of the Dementia Knowledge Assessment Scale (DKAS). Data for the study were generated in an online environment and during clinical dementia care placements from Australian (n = 1,321) and international respondents (n = 446). Volunteers from a dementia-related massive open online course (n = 1,651), medical students on clinical placement in a residential aged care facility (n = 40), and members of the Australian health workforce (n = 76). Psychometric properties of the DKAS were established using a literature review to assess the veracity of scale items, respondent feedback during pilot testing, a Delphi study with dementia experts, construction and review by an expert panel, evaluation of item difficulty, item-total and interitem correlations. Principal components analysis (PCA) was also performed along with measures of test-retest reliability, internal consistency, construct validity, and concurrent validity. The pilot DKAS was reduced from 40 to 27 items during analysis. PCA identified four distinct and interpretable factors. The revised DKAS displays high levels of test-retest reliability; internal consistency; and preliminary construct, concurrent, and factorial validity. The 27-item DKAS is reliable and shows preliminary validity for the assessment of knowledge deficiencies and change in those who provide care and treatment for people with dementia.

Validity and reliability of the 20-m run, horizontal leap, and four-bound tests measuring high-level mobility in neurologically impaired patients.

High-level mobility (HLM) training including running forms an integral part of physical rehabilitation for neurologically impaired patients. This study examines the validity and reliability of three quickly administrable measures of HLM, namely, the 20-m run, horizontal leap, and four-bound tests in patients with neurological disorders. This is a retrospective data audit of 62 patients (23 women, 37.1%; 39 men, 62.9%) participating in the HLM (running retraining) task. All participants were recovering from neurological conditions such as stroke, brain injury, brain/spinal tumour, Guillain-Barré syndrome, and cerebral palsy complications. High levels of test-retest reliability of the investigated tests (interclass correlation coefficient > 0.95) were obtained. The 95% minimum detectable changes were as follows: 20-m run, 1.9 seconds; horizontal leap, 0.20 m; four-bound test, 0.57 m. The area under the receiver-operated characteristic curve was 0.96 for the 20-m run, 0.90 for the horizontal leap, and 0.91 for the four-bound test, which suggests high validity of the tests to discriminate between participants who were classified as "running" and those as "not running". Participants performing at < 7.2 seconds for the 20-m run test or ≥ 0.75 m for the horizontal leap test or 4.0 m for the four-bound test were most likely classified as running. The 20-m run, horizontal leap, and four-bound tests are valid and reliable objective measures of HLM when administered in people with neurological conditions.

The King–Devick test for sideline concussion screening in collegiate football

PurposeSports-related concussion has received increasing attention as a result of neurologic sequelae seen among athletes, highlighting the need for a validated, rapid screening tool. The King–Devick (K–D) test requires vision, eye movements, language function and attention in order to perform and has been proposed as a promising tool for assessment of concussion. We investigated the K–D test as a sideline screening tool in a collegiate cohort to determine the effect of concussion. MethodsAthletes (n=127, mean age 19.6±1.2 years) from the Wheaton College football and men's and women's basketball teams underwent baseline K–D testing at pre-season physicals for the 2012–2013 season. K–D testing was administered immediately on the sidelines for football players with suspected head injury during regular games and changes compared to baseline were determined. Post-season testing was also performed to compare non-concussed athletes’ test performance. ResultsConcussed athletes (n=11) displayed sideline K–D scores that were significantly higher (worse) than baseline (36.5±5.6s vs. 31.3±4.5s, p<0.005, Wilcoxon signed-rank test). Post-season testing demonstrated improvement of scores and was consistent with known learning effects (35.1±5.2s vs. 34.4±5.0s, p<0.05, Wilcoxon signed-rank test). Test-retest reliability was analyzed between baseline and post-season administrations of the K–D test resulting in high levels of test-retest reliability (intraclass correlation coefficient (ICC)=0.95 [95% Confidence Interval 0.85–1.05]). ConclusionsThe data show worsening of K–D test scores following concussion further supporting utility of the K–D test as an objective, reliable and effective sideline visual screening tool to help identify athletes with concussion.

Comparison of Direct Estimate and Partner Elicitation Methods for Measuring the Number of Sexual and Injection Partners

The number of sex partners and number of injection partners an individual has are risk factors for sexually transmitted and blood-borne infections, respectively. The most common method for measuring the number of partners is the direct estimate, in which respondents are simply asked to estimate the number of partners for a given recall period (e.g., “how many people have you had sex with in the last year?”). We assessed the intermethod and test-retest reliability of the direct estimate, described subjects’ direct estimate response strategies and processes, and indirectly evaluated the validity of the direct estimate in data from two studies of persons at presumed high risk for HIV. The direct estimate showed moderate to high levels of test-retest reliability, as did the number of partners recalled when a respondent was asked to list partners by name or description. The correspondence between the two methods, though, tended to be somewhat lower. Across measurement methods, the number of sex partners was more reliably measured than the number of injection/needle-sharing partners with respect to most, but not all, reliability criteria. A large majority of respondents in one study reported using enumeration as a response strategy for the direct estimate. Direct estimates also showed a noteworthy degree of heaping on multiples of five that was not present in the number recalled. Based on comparisons with the estimated mean number of new partners for a comparable period (derived from counts of recalled partners first encountered between two separate interviews), the direct estimate seemed to provide a better estimate of the true mean number of partners (for all respondents) than the number recalled. Nevertheless, both the direct estimate and the number recalled still appeared to underestimate substantially the true number of partners.

Test-retest reliability of the English version of the Edinburgh Postnatal Depression Scale.

Test-retest reliability of the English version of the Edinburgh Postnatal Depression Scale (EPDS) has not been established. This study aimed to address this gap in psychometrics by examining test-retest reliability in a sample of 118 Australian mothers with babies aged under 12months, with a mean of 2.82 (SD 1.38) days between test occasions. The EPDS was found to have a high level of test-retest reliability for total scores (ICC = 0.92) and PND risk categories (90.7% agreement).

Throwing performance and test-retest reliability in Olympic female water polo players.

Shooting performance is critical to successful water polo performance, requiring high levels of speed and accuracy. However, shooting speed and accuracy performance of elite female water polo players has not been described in detail nor has the reliability of accuracy measures been reported. Consequently, the aim of this study was to describe shooting performance in elite female water polo players and compare the test-retest reliability of the currently available accuracy measures. Ten Olympic female water polo players were tested on 3 occasions before Olympic competition for maximal throwing speed and accuracy (total error and hit percentage) toward various target locations, with and without a goalkeeper (GK) present. The current participants (all Olympic athletes) achieved higher speeds (16.8 m·s-1), higher hit percentages (45.3%) of a 20-cm sniper net target, and lower errors (20.7 cm) than any other female water polo players investigated previously. Performance was similar across the different target locations; however, both speed (15.2 vs. 14.8 m·s-1; p ≤ 0.05) and accuracy (50.2 vs. 37.7%; p ≤ 0.05) were reduced in the presence of a GK. Speed and total error was similar across the 3 testing sessions; however, hit percentage was statistically significantly higher in the final session (58.8% vs. 40.4 and 36.4%). Maximal throwing speed showed high levels of test-retest reliability (0.96). Total error (intraclass correlation [ICC] = 0.79) had slightly greater reliability than hit percentage (ICC = 0.73) overall. Hit percentage (ICC = 0.82) showed slightly greater reliability than total error (ICC = 0.72) without a GK present, whereas total error (ICC = 0.79) showed much greater reliability than hit percentage (ICC = 0.34) when a GK was present. This study benchmarks the high degree of throwing speed and accuracy required at the Olympic level in female water polo players. Although resource intensive, total error is a reliable measure of accuracy that allows for the nature of error to be described in detail, providing a great level of insight into performance. Hit percentage, while easier to obtain, should only be used when a GK is not present and in situations where describing the nature of error does not add value to coaching practices.

Development of the Italian version of the knee injury and osteoarthritis outcome score for patients with knee injuries: cross-cultural adaptation, dimensionality, reliability, and validity

Translating, culturally adapting and validating an Italian version of the Knee injury and Osteoarthritis Outcome Score (KOOS-I) to allow its use with Italian-speaking patients with knee complaints. The KOOS-I was developed by means of forward-backward translation, a final review by an expert committee, and a test of the pre-final version to establish its correspondence with the original English version. The psychometric testing included analysis of dimensionality using item-scale correlation after correction for overlap, reliability by means of internal consistency (Cronbach's alpha) and test-retest reliability (Intraclass Correlation Coefficients), and construct validity using an a priori hypothesised Pearson correlations with a Numerical Rating Scale (NRS) and the Short-Form 36 Health Survey (SF-36). The questionnaire was administered to 224 subjects with knee injuries and proved to be acceptable. Hypothesised item-to-domain correlations were observed for all of the items. The questionnaire showed good internal consistency (0.782-0.977), and a high level of test-retest reliability (0.850-0.949). Construct validity was supported by the confirmation of the a priori hypothesised correlations. The KOOS outcome measure was successfully translated into Italian, and proved to have good psychometric properties that replicated the results of existing versions. Its use is recommended for clinical and research purposes in patients with knee injuries.

The King-Devick test as a determinant of head trauma and concussion in boxers and MMA fighters

Sports-related concussion has received increasing attention as a cause of short- and long-term neurologic symptoms among athletes. The King-Devick (K-D) test is based on measurement of the speed of rapid number naming (reading aloud single-digit numbers from 3 test cards), and captures impairment of eye movements, attention, language, and other correlates of suboptimal brain function. We investigated the K-D test as a potential rapid sideline screening for concussion in a cohort of boxers and mixed martial arts fighters. The K-D test was administered prefight and postfight. The Military Acute Concussion Evaluation (MACE) was administered as a more comprehensive but longer test for concussion. Differences in postfight K-D scores and changes in scores from prefight to postfight were compared for athletes with head trauma during the fight vs those without. Postfight K-D scores (n = 39 participants) were significantly higher (worse) for those with head trauma during the match (59.1 ± 7.4 vs 41.0 ± 6.7 seconds, p < 0.0001, Wilcoxon rank sum test). Those with loss of consciousness showed the greatest worsening from prefight to postfight. Worse postfight K-D scores (r(s) = -0.79, p = 0.0001) and greater worsening of scores (r(s) = 0.90, p < 0.0001) correlated well with postfight MACE scores. Worsening of K-D scores by ≥5 seconds was a distinguishing characteristic noted only among participants with head trauma. High levels of test-retest reliability were observed (intraclass correlation coefficient 0.97 [95% confidence interval 0.90-1.0]). The K-D test is an accurate and reliable method for identifying athletes with head trauma, and is a strong candidate rapid sideline screening test for concussion.

Test-retest reliability in a computer-based medical history.

The authors developed a computer-based medical history for patients to take in their homes via the internet. The history consists of 232 'primary' questions asked of all patients, together with more than 6000 questions, explanations, and suggestions that are available for presentation as determined by a patient's responses. The purpose of this research was to measure the test-retest reliability of the 215 primary questions that have preformatted, mutually exclusive responses of 'Yes,' 'No,' 'Uncertain (Don't know, Maybe),' 'Don't understand,' and 'I'd rather not answer.' From randomly selected patients of doctors affiliated with Beth Israel Deaconess Medical Center in Boston, 48 patients took the history twice with intervals between sessions ranging from 1 to 35&emsp14;days (mean 7&emsp14;days; median 5&emsp14;days). High levels of test-retest reliability were found for most of the questions, but as a result of this study the authors revised five questions. They recommend that structured medical history questions that will be asked of many patients be measured for test-retest reliability before they are put into widespread clinical practice.

Development of the Italian Version of the Revised Scoliosis Research Society-22 Patient Questionnaire, SRS-22r-I

Evaluation of the psychometric properties of a translated and culturally adapted questionnaire. Translating, culturally adapting, and validating the Italian version of the revised Scoliosis Research Society-22 Patient Questionnaire (SRS-22r-I) in order to allow its use with Italian-speaking patients with adolescent idiopathic scoliosis (AIS). Increasing attention is being given to health-related quality of life measures as a means of adding information about the evaluation of AIS. A translated form of the revised SRS-22 has never been validated in Italian patients with AIS. The development of the SRS-22 questionnaire involved its translation and back-translation, a final review by an Expert Committee, and testing of the prefinal version to establish its correspondence to the original English version. Psychometric testing included factor analysis, reliability by internal consistency (Cronbach alpha) and test-retest repeatability (Intraclass Coefficient Correlation), and concurrent validity (Pearson correlation) by comparing the SRS-22r-I domains with the Short-Form Health Survey (SF-36) subscales. It took 4 months to develop a shared version of the SRS-22r-I, which proved to be satisfactorily acceptable when administered to 223 subjects with AIS. Factor analysis indicated a 4-factor solution (54% of the explained variance), and the questionnaire had an acceptable level of internal consistency (α = 0.77) and a high level of test-retest reliability (intraclass correlation coefficient = 0.957). In terms of concurrent validity, the correlations with the related Short-Form-36 subscales were moderate to good in the case of the Pain and Mental Health domains, and moderate in the case of the Function and Self-Image domains. The Italian translation of the SRS-22r has a good factorial structure and psychometric properties, and replicates the results of existing English versions of the questionnaire. Its use for research purposes can therefore be recommended.