High Levels Of Test-retest Reliability Research Articles

Test-retest reliability in a computer-based medical history.

The authors developed a computer-based medical history for patients to take in their homes via the internet. The history consists of 232 'primary' questions asked of all patients, together with more than 6000 questions, explanations, and suggestions that are available for presentation as determined by a patient's responses. The purpose of this research was to measure the test-retest reliability of the 215 primary questions that have preformatted, mutually exclusive responses of 'Yes,' 'No,' 'Uncertain (Don't know, Maybe),' 'Don't understand,' and 'I'd rather not answer.' From randomly selected patients of doctors affiliated with Beth Israel Deaconess Medical Center in Boston, 48 patients took the history twice with intervals between sessions ranging from 1 to 35 days (mean 7 days; median 5 days). High levels of test-retest reliability were found for most of the questions, but as a result of this study the authors revised five questions. They recommend that structured medical history questions that will be asked of many patients be measured for test-retest reliability before they are put into widespread clinical practice.

Development of the Italian Version of the Revised Scoliosis Research Society-22 Patient Questionnaire, SRS-22r-I

Evaluation of the psychometric properties of a translated and culturally adapted questionnaire. Translating, culturally adapting, and validating the Italian version of the revised Scoliosis Research Society-22 Patient Questionnaire (SRS-22r-I) in order to allow its use with Italian-speaking patients with adolescent idiopathic scoliosis (AIS). Increasing attention is being given to health-related quality of life measures as a means of adding information about the evaluation of AIS. A translated form of the revised SRS-22 has never been validated in Italian patients with AIS. The development of the SRS-22 questionnaire involved its translation and back-translation, a final review by an Expert Committee, and testing of the prefinal version to establish its correspondence to the original English version. Psychometric testing included factor analysis, reliability by internal consistency (Cronbach alpha) and test-retest repeatability (Intraclass Coefficient Correlation), and concurrent validity (Pearson correlation) by comparing the SRS-22r-I domains with the Short-Form Health Survey (SF-36) subscales. It took 4 months to develop a shared version of the SRS-22r-I, which proved to be satisfactorily acceptable when administered to 223 subjects with AIS. Factor analysis indicated a 4-factor solution (54% of the explained variance), and the questionnaire had an acceptable level of internal consistency (α = 0.77) and a high level of test-retest reliability (intraclass correlation coefficient = 0.957). In terms of concurrent validity, the correlations with the related Short-Form-36 subscales were moderate to good in the case of the Pain and Mental Health domains, and moderate in the case of the Function and Self-Image domains. The Italian translation of the SRS-22r has a good factorial structure and psychometric properties, and replicates the results of existing English versions of the questionnaire. Its use for research purposes can therefore be recommended.

Development of a questionnaire to measure patient‐reported postoperative recovery: content validity and intra‐patient reliability

In this study we describe the development of a short, easy-to-use questionnaire to measure postoperative recovery and evaluate its content validity and intra-patient reliability. The questionnaire is designed to evaluate the progress of postoperative recovery and the long-term follow-up of possible effects of interventions during recovery. The study involved four steps. (1) A conceptualization and item definitions were based on a theoretical framework and a description of patients' postoperative recovery from the perspective of patients, registered nurses and surgeons; (2) Content validity of items was tested through expert judgements; (3) A test run of the questionnaire was performed to confirm its feasibility and workload requirement; and (4) The stability of the questionnaire was evaluated through intra-patient reliability assessment. As a result of the operationalization process of the concept postoperative recovery, five dimensions (physical symptoms, physical functions, psychological, social, activity) and 19 items were identified. Each item was formulated as a statement in the questionnaire. Content validity was judged to be high. After the pre-test of the questionnaire a revision with refinements in the layout was made. The vast majority of items showed a high level of intra-patient reliability. Based on a theoretical framework and empirical data, we developed a short and easy-to-use tentative questionnaire to measure patient-reported postoperative recovery. Initial support for content validity was established. The vast majority of items showed a high level of test-retest reliability.

Unhelpful thoughts and beliefs linked to social anxiety in stuttering: development of a measure

Those who stutter have a proclivity to social anxiety. Yet, to date, there is no comprehensive measure of thoughts and beliefs about stuttering that represent the cognitions associated with that anxiety. The present paper describes the development of a measure to assess unhelpful thoughts and beliefs about stuttering. The Unhelpful Thoughts and Beliefs about Stuttering (UTBAS) self-report measure contains 66 items that assess the frequency of unhelpful thoughts and beliefs. Items were constructed from a comprehensive file audit of all stuttering cases seen in a cognitive-behavior therapy based treatment programme over a ten-year period. Preliminary investigations indicate that the UTBAS has high levels of test-retest reliability (r = 0.89) and internal consistency (Chronbach's alpha = 0.98). It has good known-groups validity, being able to discriminate between stuttering and non-stuttering participants on items that contain no reference to stuttering [t(38) = 8.06, p<0.0001], with a large effect size (d = 2.3). It has good convergent validity (r = 0.53-0.72) and discriminant validity (r = 0.24-0.27). The UTBAS sensitivity to change was supported by improvements in thoughts and beliefs related to social anxiety following cognitive-behavioural treatment for anxiety in stuttering [t(25) = 10.13, p<0.0001]. The effect size was large (d = 2.5). Implications for the use of the UTBAS as an outcome measure and a clinical tool are discussed, along with the potential value of the UTBAS to explore the well-documented social anxiety experienced by those who stutter.

A German Version of the Extended Aberdeen Back Pain Scale

Psychometric testing of translated, culturally adapted questionnaire. Cross-cultural adaptation of the German version of the Extended Aberdeen Back Pain Scale (EABPS, three questionnaires), and to evaluate its use for assessing back pain related health status and disability in German patients. The EABPS can be used as one questionnaire for the whole spine or three questionnaires for the three parts of the spine: neck, upper back, and lower back. It was shown to be valid, reliable, and responsive. No German version was available. The EABPS was translated and adapted. The three questionnaires were evaluated separately. A total of 158 outpatients with neck pain, upper back pain, and/or low back pain were assessed by the EABPS-G at admission, 148 patients 1 day later for retest. For testing responsiveness, the standardized response mean (SRM) was chosen and for criterion validity a generic and cLBP-specific measure (SF-36 and FFbH-R). Between the first and second questionnaire, high correlations (from 0.93 to 0.95) represent a very high level of test-retest reliability. Criterion validity showed high (negative) correlations between the questionnaires for the three spinal areas on the one side and the FFbH-R and the SF-36 on the other. The SRM for the three questionnaires indicated remarkable changes ranging from 1.36 to 1.96. The EABPS-G is a valid, reliable, and responsive questionnaire for assessing health status and disability influenced by pain in one or more area of the spine and allows intercultural comparisons with the original English version. It could be used for assessment of current state as well as measurement for change.

Reliability and Validity of the Cognition Checklist With Psychiatric Outpatients

The Cognition Checklist Anxiety scale (CCL-A) and Depression scale (CCL-D) were administered to psychiatric outpatients with panic disorder ( n = 51), major depression ( n = 44), or panic disorder and major depression ( n = 38). Both scales showed good internal consistency and moderately high levels of test-retest reliability. The scales generally had good convergent and discriminant validities, except that the CCL-D had a moderate-sized correlation with fear of negative evaluation, and the CCL-A was uncorrelated with fear of negative evaluation. The CCL-D showed good criterion-related validity, whereas the CCL-A was weaker in this regard. The CCL scales showed good factorial validity. In all, the results suggest the CCL scales generally have adequate psychometric properties for research purposes.

Reliability and Accuracy of Surgical Resident Peer Ratings

The reliability and accuracy of peer ratings by general surgery residents were examined. Thirty-two residents anonymously and voluntarily evaluated their peers on ten areas of perfor mance in 1988; twenty-eight residents were evaluated in 1989, and thirty-three were evaluated in 1990. Resident peer ratings were found highly reliable, with no evidence of serious restriction of range or leniency effects. The results indicated a high level of test-retest reliability replicated across three academic years. Halo effects appear to pose the greatest threat to rater accuracy. There was some evidence that chief residents exhibit less halo effect than junior residents when rating peers.

Development and initial validation of a dual-language English-Spanish format for the Arthritis Impact Measurement Scales.

Language, cultural, and educational barriers complicate efforts to validate health status questionnaires that have been translated into Spanish. To overcome these problems, a prototype dual-language format was developed for the Arthritis Impact Measurement Scales. Validity testing with 72 patients diagnosed as having rheumatoid arthritis indicated high levels of test-retest reliability, item-to-scale internal consistency, and construct validity for both Anglo and Hispanic subjects. A technique for developing and pilot-testing a questionnaire written in a regional Spanish dialect is described. Linguistic considerations, questionnaire design, and other applications are discussed in light of the results obtained.

A prospective study of the reliability and convergent validity of three physical activity measures in a field research trial

This investigation sought to determine the test-retest reliability and convergent validity of three commonly used physical activity measures. The Stanford Physical Activity Recall, the Caltrac Activity Monitor, and a daily physical activity log were administered to 45 subjects over a 3-week period. The results indicated high levels of test-retest reliability for the Stanford and the daily log; low test-retest reliability was obtained for the Caltrac. Convergent validity was also high between the Stanford and daily log but was low for both of these measures with the Caltrac: These results suggest that the Stanford Physical Activity Recall may be the self-report measure of choice for large studies due to its high reliability and convergent validity with a more time-consuming daily log, as well as its cost- and time-efficiency. Based on the results, it is recommended that the Caltrac activity sensors not be used for field studies of physical activity until the logistical problems of their use in clinical trials are solved.

Structured Diagnostic Interviews for Children and Adolescents: Current Status and Future Directions

Five structured diagnostic interviews keyed to DSM-III criteria for psychiatric disorders in childhood and adolescence are in varying stages of development and differ in respect to format, organization, procedures for interviewing informants, diagnostic content, scoring, and time frame for inquiries. High levels of test-retest reliability have been shown for affective disorder, attention deficit disorder, and conduct disorder on several interview schedules. Evaluation of existing psychometric assessments requires consideration of diagnostic comprehensiveness and the psychiatric treatment status and age distribution of samples. A worthwhile goal for future research is to establish an empirical rationale for all essential features of instruments, thereby reducing unnecessary diversity.

The Development of an Instrument to Measure Social Support

This article describes the development of a new instrument, the Norbeck Social Support Questionnaire, designed to measure multiple dimensions of social support. Based on Kahn's (1979) conceptual definitions of social support and definitions from network theory (Barnes, 1972), the instrument has three main variables--Total Functional, Total Network, and Total Loss--each with three subscales. Graduate and undergraduate nursing students were used as subjects in this phase of testing, which established high levels of test-retest reliability and internal consistency. The social desirability response bias was ruled out, and moderate levels of concurrent validity were found. Additional work to establish construct validity is needed. Two groups of students were compared to study the normative trend for this population, and differences were minimal except for recent losses and aid, reflecting the actual situations of the two groups.