Reliability Of Individual Items Research Articles

Measuring the barriers against seeking consultation for urinary incontinence among Middle Eastern women

BackgroundExisting questionnaires to assess barriers against consultation for urinary incontinence (UI) are not appropriate for use in the Middle East culture. The aim of this study was to explore barriers against seeking help for UI and introducing a questionnaire that assess these barriers among those women. This is important before proceeding to any educational programs or having interval clinical audits to help incontinent women.Methods1- Screening for UI. Women - aged 20 years and older, attending the outpatient Urology and Gynaecology clinics were invited to participate and interviewed by a research nurse. The UDI-6 was administered to assess the presence and type of UI. Women with UI as their chief complaint were excluded. 2- Interviewing study subjects for possible barriers. Subjects who had UI - as determined by the UDI-6-were first asked an open question "what prevented you from seeking medical consultation for urine leakage?"." They were then asked the proposed questions to assess possible barriers. We developed a preliminary questionnaire based on a review of reasons for not seeking incontinence care from the literature and the response of UI sufferers to the open question in this study. The questionnaire was modified many times to reach this final form. 3- Pilot Study to assess characteristics of the questionnaire. Validity and reliability of the final version of the questionnaire were assessed in a small pilot study including 36 women who completed questionnaire at initial visit and again after 2 weeks.ResultsOf the 1231 subjects who agreed to participate in the study, 348 reported having UI. About 80% of incontinent women have never sought medical advice. Factors significantly associated with seeking help were husband encouragement, prayer affection and having severe UI. Common barriers were embarrassment and assuming UI as a normal part of aging. A pilot study included 36 women to assess the psychometric properties of the questionnaire after modifying it. The number of missing or not interpretable responses per item ranged from 2.2% to 8.7%. Internal consistency of the items was good. The test-retest reliability of individual items of the questionnaire was variable, with weighted kappa statistics ranging from 0.32 to 0.94 (median, 0.76, p 0.000).ConclusionsPreliminary data on our proposed questionnaire show that it is an easy to administer, stable and suits the Middle Eastern culture.

Development and validation of a tool for assessing understanding of brain death

Death by neurological criteria is often misunderstood by laypersons even though they make decisions about withdrawal of care and organ donation. No validated questionnaire for determining laypersons' understanding of brain death exists. Such a tool could be useful in clinical, educational, and research settings. Brain death experts and a focus group of laypersons were used to develop a 5-item questionnaire with face validity. The questionnaire explores 3 concepts: apnea, irreversibility, and differentiation between cardiac death, brain death, and persistent vegetative state. The questionnaire was administered to separate groups of laypersons and experts and was readministered 7 to 10 days later. Test-retest reliability for individual items and overall score was measured by using Spearman rank correlation. Internal consistency of the questionnaire was measured by using Cronbach alpha. Utility of the questionnaire in discriminating between scores of laypersons and experts was evaluated by using a t test. Twelve laypersons and 13 experts participated. The test-retest correlation was significant for all questions (Spearman p range, 0.43-0.94) and raw score (Spearman p=0.91, P<.001). Internal consistency was fair (Cronbach alpha=0.64). The questionnaire enabled discrimination of laypersons from experts, with mean (SD) raw scores of 3.0 (1.1) vs 4.8 (0.6), respectively (t test, P<.001). Removal of 1 item improved internal consistency (Cronbach alpha=0.70), but with a corresponding decrease in discriminatory ability. This simple 5-item questionnaire for evaluating understanding of brain death has test-retest reliability, internal consistency, and can be used to discriminate between persons who do and do not understand brain death.

Development and Validation of a Tool for Assessing Understanding of Brain Death

Death by neurological criteria is often misunderstood by laypersons even though they make decisions about withdrawal of care and organ donation. No validated questionnaire for determining laypersons' understanding of brain death exists. Such a tool could be useful in clinical, educational, and research settings. Brain death experts and a focus group of laypersons were used to develop a 5-item questionnaire with face validity. The questionnaire explores 3 concepts: apnea, irreversibility, and differentiation between cardiac death, brain death, and persistent vegetative state. The questionnaire was administered to separate groups of laypersons and experts and was readministered 7 to 10 days later. Test-retest reliability for individual items and overall score was measured by using Spearman rank correlation. Internal consistency of the questionnaire was measured by using Cronbach alpha. Utility of the questionnaire in discriminating between scores of laypersons and experts was evaluated by using a t test. Twelve laypersons and 13 experts participated. The test-retest correlation was significant for all questions (Spearman p range, 0.43-0.94) and raw score (Spearman p=0.91, P<.001). Internal consistency was fair (Cronbach alpha=0.64). The questionnaire enabled discrimination of laypersons from experts, with mean (SD) raw scores of 3.0 (1.1) vs 4.8 (0.6), respectively (t test, P<.001). Removal of 1 item improved internal consistency (Cronbach alpha=0.70), but with a corresponding decrease in discriminatory ability. This simple 5-item questionnaire for evaluating understanding of brain death has test-retest reliability, internal consistency, and can be used to discriminate between persons who do and do not understand brain death.

Subject-centered scalability: The sine qua non of summated ratings.

A unifying theory of subject-centered scalability is offered that is grounded in structural true score modeling, is conceptually distinct from internal consistency and homogeneity as determined by item correlations, and is empirically confirmable. Scalability holds when item true scores are perfectly correlated but differ in their individual scale metric. The condition of scalability imposes constraints that allow individual item reliability to be estimated independently of scalability. Scalability is shown to imply unit rank and to be testable by a single-factor confirmatory factor analysis reinterpreted as a test of unit rank. High item correlations are shown, contrary to intuition, to be an insufficient condition for scalability. Conversely, low item correlations do not necessarily imply lack of scalability. A stepped decision-oriented procedure is offered as a guideline in summated rating scale construction.

The validity and reliability of an instrument to assess children's outdoor play in various locations

The aim of this study was to develop and test the reliability and validity of survey items that examine the frequency with which primary school-aged children play in particular outdoor locations. Parents reported the number of days their child spent playing in specified outdoor locations (i.e., yard at home, own street/court/footpath, and park/playground) out-of-school hours on weekdays and weekend days during a typical week. To test the reliability of these items, the survey was administered on two occasions, 2 weeks apart, to a sample of 53 parents of children attending primary schools located in metropolitan Melbourne. The validity study involved the completion of a log book by 46 parents of primary school children over a 1-week period. Two weeks later, the same sample of parents completed the survey items. The test–retest reliability of individual items was determined using intra-class correlation coefficients (ICC). The kappa statistic and percent agreement between responses were used to assess validity by comparing the information provided in the log book with that provided in the survey. Results from the two studies suggest that the survey was generally a reliable and valid instrument for assessing the frequency with which children play in particular locations especially at home or in the street. Evidence of the reliability and validity of items assessing where children play is novel and important considering the need to promote children's physical activity in a variety of settings.

Reliability and validity of the Edinburgh Visual Gait Score for cerebral palsy when used by inexperienced observers

The Edinburgh Visual Gait Score (EVGS) for cerebral palsy has been validated for observer reliability and validity for observers experienced in gait analysis. This study investigated the reliability and validity of the EVGS for observers inexperienced in gait analysis. Six medical students used the score to analyse videotapes from the original study by Read et al. [Read HS, Hazlewood ME, Hillman SJ, Prescott RJ, Robb JE. Edinburgh visual gait score for use in cerebral palsy. J Pediatr Orthop 2003;23:296–301]. These were viewed on two separate occasions to provide inter- and intra-observer reliability, and the results of the numerical items were compared to those from three-dimensional (3D) gait analyses for validity. Observer agreement was tested using Coefficient of Repeatability (CoR), percentage of complete agreement and the kappa statistic. The CoR for inter-observer agreement for inexperienced observers was 5.99/5.07 (Session 1/Session 2) compared to 4.60/3.95 (Session 1/Session 2) for experienced observers. The CoR for intra-observer agreement for inexperienced observers was 5.15 compared to 4.21 for experienced observers. There was complete agreement for 52% of the 10 numerical items with 3D-gait analysis data for inexperienced observers compared to 64% for experienced observers. Ranking of reliability of individual items was similar between the two groups and was generally best for events occurring at the foot and ankle. Observations of gait events by the inexperienced observers using the EVGS were reasonably reliable but not very accurate when compared to experienced observers and 3D-gait analysis.

Standardizing Assessment of Elderly People in Acute Care: The interRAI Acute Care Instrument

To examine the frequency distributions and interrater reliability of individual items of the interRAI Acute Care instrument. Observational study of a representative sample of older inpatients; duplicate assessments conducted on a subsample by independent assessors to examine interrater reliability. Acute medical, acute geriatric and orthopedic units in 13 hospitals in nine countries. Five hundred thirty-three patients aged 70 and older (mean age 82.4, range 70-102) with an anticipated stay of 48 hours or longer of whom 161 received duplicate assessments. Sixty-two clinical items across 11 domains. Premorbid (3-day observation period before onset of the acute illness) and admission (the first 24 hours of hospital stay) assessments were conducted. The frequency of deficits exceeded 30% for most items, ranging from 1% for physically abusive behavior to 86% for the need for support in activities of daily living after discharge. Common deficits were in cognitive skills for daily decision-making (38% premorbid, 54% at admission), personal hygiene (37%, 65%), and walking (39%, 71%). Interrater reliability was substantial in the premorbid period (average kappa=0.61) and admission period (average kappa=0.66). Of the 69 items tested, less than moderate agreement (kappa<0.4) was recorded for six (9%), moderate agreement (kappa=0.41-0.6) for 14 (20%), substantial agreement (kappa=0.61-0.8) for 40 (58%), and almost perfect agreement (kappa>0.8) for nine (13%). Initial assessment of the psychometric properties of the interRAI Acute Care instrument provided evidence that item selection and interrater reliability are appropriate for clinical application. Further studies are required to examine the validity of embedded scales, diagnostic algorithms, and clinical protocols.

Perceived characteristics of the environment associated with active travel: development and testing of a new scale

BackgroundEnvironmental characteristics may be associated with patterns of physical activity. However, the development of instruments to measure perceived characteristics of the local environment is still at a comparatively early stage, and published instruments are not necessarily suitable for application in all settings. We therefore developed and established the test-retest reliability of a new scale for use in a study of the correlates of active travel and overall physical activity in deprived urban neighbourhoods in Glasgow, Scotland.MethodsWe developed and piloted a 14-item scale based on seven constructs identified from the literature (aesthetics, green space, access to amenities, convenience of routes, traffic, road safety and personal safety). We administered the scale to all participants in a random postal survey (n = 1322) and readministered the scale to a subset of original respondents (n = 125) six months later. We used principal components analysis and Varimax rotation to identify three principal components (factors) and derived summary scores for subscales based on these factors. We examined the internal consistency of these subscales using Cronbach's alpha and examined the test-retest reliability of the individual items, the subscale summary scores and an overall summary neighbourhood score using a combination of correlation coefficients and Cohen's kappa with and without weighting.ResultsPublic transport and proximity to shops were the items most likely to be rated positively, whereas traffic volume, traffic noise and road safety for cyclists were most likely to be rated negatively. Three principal components – 'safe and pleasant surroundings', 'low traffic' and 'convenience for walking' – together explained 45% of the total variance. The test-retest reliability of individual items was comparable with that of items in other published scales (intraclass correlation coefficients (ICCs) 0.34–0.70; weighted Cohen's kappa 0.24–0.59). The overall summary neighbourhood score had acceptable internal consistency (Cronbach's alpha 0.72) and test-retest reliability (ICC 0.73).ConclusionThis new scale contributes to the development of a growing set of tools for investigating the role of perceived environmental characteristics in explaining or mediating patterns of active travel and physical activity.

Case management for the mentally ill: a comparative evaluation of client satisfaction

This paper reports on client satisfaction with community mental health services. A Client Satisfaction Interview was used as one outcome measure in a randomized controlled study of clinical case management vs. standard community care. The Interview had high internal consistency reliability (Cronbach's alpha = 0.89) with very high inter-rater reliability for overall scores (r= 0.99) and good inter-rater reliability for individual items (kappa over 0.9 for 18 of 22 items). Case management clients had significantly higher total satisfaction scores than control group clients who received standard community care at 9 months (t= 2.02 P= 0.05) but not at baseline (t= 0.59, P= 0.55) or 18 months (t= 1.76, P= 0.09). In addition to a quantitative measure of satisfaction, clients were asked to provide more qualitative accounts of their experience with services. The findings are discussed in relation to the team's model of case management and the differences between case management and control services. The limitations of this study are considered in the context of methodological issues surrounding measurement of client satisfaction and the study's own methodological shortcomings.

Are Mood Disorders a Stroke Risk Factor?

See related article, pages 16–21 A growing body of evidence suggests that biological mechanisms underlie a bidirectional link between depression and many neurological illnesses, and that mood disorders can affect the course of the diseases.1 Depression commonly occurs after a stroke, with an estimated prevalence as high as 30% in the first year after the event.2 It is well known that poststroke depression affects quality of life, functional recovery, cognitive function and health care use in stroke survivors.3 Inversely, does any association exist between a history of a previous affective disorder and future risk of cardiovascular events? Recent prospective studies have shown an association between depression and incidence of hypertension,4,5 coronary heart disease,6,7 and cardiovascular mortality.8–11 In the Multiple Risk Factor Intervention Trial, 12 866 men were followed for 18 years; those with greater depressive symptoms, as measured by the Center for Epidemiologic Studies Depression Scale (CES-D), were associated with a significant higher risk of cardiovascular mortality (hazard ratio=1.21; 95% CI, 1.03 to 1.41; P <0.05) and stroke mortality (hazard ratio= 2.03; 95% CI, 1.20 to 3.44; P <0.01).12 The NHANES I Epidemiologic Study13 showed that individuals reporting 5 or more symptoms of depression at baseline were 50% more likely to die of a stroke-related cause during a 29-year follow-up. The Baltimore Epidemiologic Catchment Area Study showed that individuals with a history of depressive disorder, measured with the diagnostic interview schedule, were 2.6 times more likely to report stroke.14 Depressive symptoms, measured by the Zung Self-rating Depression Scale, were also associated with an increased incidence of ischemic stroke in a Japanese 10-year follow study.15 Self-reported depression scores significantly predicted stroke in an Australian cohort of people …

Development and reliability of a self-report questionnaire to examine children's perceptions of the physical activity environment at home and in the neighbourhood

BackgroundEnvironmental factors are increasingly being implicated as key influences on children's physical activity. Few studies have comprehensively examined children's perceptions of their environment, and there is a paucity of literature on acceptable and reliable scales for measuring these. This study aimed to develop and test the acceptability and reliability of a scale which examined a broad range of environmental perceptions among children.MethodsBased on constructs from ecological models, a survey incorporating items on children's perceptions of the physical and social environment at home and in the neighbourhood was developed. This was administered on two occasions, nine days apart, to a sample of 39 children aged 11 years (54% boys), attending a metropolitan Australian elementary school. The acceptability of the survey was determined by the proportion of missing responses to each item. The test-retest reliability of individual items, scores and scales were determined using Kappa statistics and percent agreement for categorical variables, and intraclass correlation coefficients (ICC) for continuous variables.ResultsThere were few missing responses to each question, with only 4% of all responses missing. Although some Kappa values were low, all categorical variables showed acceptable reliability when examined for percent agreement between test and retest (range 68%–100% agreement). Continuous variables all showed moderate to good ICC values (range 0.72–0.92).ConclusionFindings suggest this questionnaire is reliable and acceptable to children for assessing environmental perceptions relevant to physical activity among 11-year-old children.

Fatigue and daytime sleepiness rating scales in myotonic dystrophy: a study of reliability

Objectives: To assess the reliability of the Epworth Sleepiness Scale (ESS), Daytime Sleepiness Scale (DSS), Chalder Fatigue Scale (CFS), and Krupp’s Fatigue Severity Scale (KFSS) in patients with myotonic dystrophy...

The Brief Impairment Scale (BIS): A Multidimensional Scale of Functional Impairment for Children and Adolescents

This article provides the results of the psychometric testing of the Brief Impairment Scale (BIS). The BIS is a 23-item instrument that evaluates three domains of functioning: interpersonal relations, school/work functioning, and self-care/self-fulfillment. It capitalizes on the strengths of existing global measures while addressing some of their limitations. Cross-sectional parent respondent data from one clinical (N = 757) and two community samples (N = 1,888 and 1,132) of children ranging in age from 4 to 17 years is employed to test the reliability and validity of the BIS. Receiver operating characteristic analyses are employed to assess useful cutoff scores on the scale. The total scale's internal consistency ranged from 0.81 to 0.88 and from 0.56 to 0.81 on the three subscales. Test-retest reliability for individual items ranged from fair to substantial in all but six items. The BIS has high convergent and concurrent validity. Receiver operator characteristic analyses suggest possible thresholds for different uses. The BIS is psychometrically sound, useful in assessments and as an outcome measure in clinical practice and research. Its advantages over other global impairment instruments are that it is respondent based, short in administration time, and multidimensional.

Assessing reliability of categorical substance use measures with latent class analysis

This article illustrates the use of the latent class model to identify classes of individuals and to assess the psychometric reliability of categorical items. The latent class model is a categorical latent variable model used to identify homogeneous classes of respondents such that class membership accounts for item responses. The assessment of measurement reliability comes directly from the estimates of the model. Although not based on classical test theory, the reliability assessment procedures described here answer the same question—that is, how consistent or dependable is measurement? The goal is to identify reliable indicators of a characteristic by examining measurement error and the inter-relatedness of the items. Methods for estimating the reliability of individual items as well as sets of items are presented. These methods are illustrated with data on cigarette smoking from a national sample of adolescents. By using the procedures described here, researchers are able to determine: (1) which classes of people are measured well and which are not; (2) which items perform well and which do not; and (3) whether items need to be altered or added in order to measure and identify particular classes better.

Validity and Reliability of the Thrombolysis in Brain Infarction (TIBI) Flow Grades

48 Background: In patients eligible for thrombolytic therapy, the TIBI grading system defines residual transcranial Doppler (TCD) flow signals at the site of clot location. In addition, TIBI flow grades correlate with angiography and predict short-term improvement following TPA therapy. The aim of this study was to develop a valid and reliable instrument to assess how accurately health professionals determine TIBI flow grades. Methods: Two expert sonographers developed a 60 question computerized examination of the 6 TIBI flow grades. Gold standard interpretation was determined by a consensus interpretation by a pool of expert sonographers. All items were equally weighted and written in a standard format. A computerized TIBI grading tutorial and standard interpretation rules were available for all test-takers. To assess content validity and reliability, a blinded panel of 3 experts independently took the examination. Inter-rater agreement was determined among experienced sonographers, stroke neurologists, and other health professionals (N=11). Results: Expert assessment of each test item measured objective congruence at 1.0, overall test validity coefficient of 0.996 (95%CI 0.993–0.997), and an item/TIBI flow grade validity coefficient of 0.992 (95%CI 0.996–0.997). Overall test and individual item reliability had coefficients of 0.98(95%CI 0.97–0.99) and 0.97 (95%CI 0.95–0.98, p Conclusions: Our computerized examination is a valid and reliable tool to assess an individuals ability to score TIBI flow grades. In addition, TIBI flow grade evaluation has a high degree of inter-rater reliability, even among those with limited experience in ultrasound.

Validity and Reliability of the Thrombolysis in Brain Infarction (TIBI) Flow Grades

48 Background: In patients eligible for thrombolytic therapy, the TIBI grading system defines residual transcranial Doppler (TCD) flow signals at the site of clot location. In addition, TIBI flow grades correlate with angiography and predict short-term improvement following TPA therapy. The aim of this study was to develop a valid and reliable instrument to assess how accurately health professionals determine TIBI flow grades. Methods: Two expert sonographers developed a 60 question computerized examination of the 6 TIBI flow grades. Gold standard interpretation was determined by a consensus interpretation by a pool of expert sonographers. All items were equally weighted and written in a standard format. A computerized TIBI grading tutorial and standard interpretation rules were available for all test-takers. To assess content validity and reliability, a blinded panel of 3 experts independently took the examination. Inter-rater agreement was determined among experienced sonographers, stroke neurologists, and other health professionals (N=11). Results: Expert assessment of each test item measured objective congruence at 1.0, overall test validity coefficient of 0.996 (95%CI 0.993–0.997), and an item/TIBI flow grade validity coefficient of 0.992 (95%CI 0.996–0.997). Overall test and individual item reliability had coefficients of 0.98(95%CI 0.97–0.99) and 0.97 (95%CI 0.95–0.98, p&lt;0.0001) respectively. Inter-rater agreement was 0.89 (coefficient of contingency) and 0.86 (kappa) for all participants. Kappa range included 0.98 for an experienced interpreter, 0.81–0.89 for stroke neurologists with beginner experience in TCD and 0.65 for those without previous TCD experience (66% of correct answers after 1 hour tutorial). Conclusions: Our computerized examination is a valid and reliable tool to assess an individuals ability to score TIBI flow grades. In addition, TIBI flow grade evaluation has a high degree of inter-rater reliability, even among those with limited experience in ultrasound.

The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism.

The Autism Diagnostic Observation Schedule-Generic (ADOS-G) is a semistructured, standardized assessment of social interaction, communication, play, and imaginative use of materials for individuals suspected of having autism spectrum disorders. The observational schedule consists of four 30-minute modules, each designed to be administered to different individuals according to their level of expressive language. Psychometric data are presented for 223 children and adults with Autistic Disorder (autism), Pervasive Developmental Disorder Not Otherwise Specified (PDDNOS) or nonspectrum diagnoses. Within each module, diagnostic groups were equivalent on expressive language level. Results indicate substantial interrater and test-retest reliability for individual items, excellent interrater reliability within domains and excellent internal consistency. Comparisons of means indicated consistent differentiation of autism and PDDNOS from nonspectrum individuals, with some, but less consistent, differentiation of autism from PDDNOS. A priori operationalization of DSM-IV/ICD-10 criteria, factor analyses, and ROC curves were used to generate diagnostic algorithms with thresholds set for autism and broader autism spectrum/PDD. Algorithm sensitivities and specificities for autism and PDDNOS relative to nonspectrum disorders were excellent, with moderate differentiation of autism from PDDNOS.

Occupational Therapists’ Involvement With the Minimum Data Set in Skilled Nursing and Intermediate Care Facilities

Abstract Objectives. The Minimum Data Set (MDS) is a comprehensive, federally mandated assessment for all residents of long-term-care facilities who receive reimbursement from Medicare or Medicaid. This study investigated the degree to which occupational therapists contribute to the MDS 2.0 process. Method. A 60-item survey developed for the study was mailed to 252 occupational therapists who worked in skilled nursing or intermediate care facilities throughout the United States, and 148 (59%) usable surveys were received. Test–retest reliability was assessed in a randomly selected subsample of 75, with a 73% rate of return. Fair to perfect reliability for individual items was found, with substantial overall mean reliability. Results. Of the 148 respondents, 98% were familiar with and 90% were involved in the MDS process. Of the 22 MDS sections, the most involvement was with Section G, which includes subsections for dressing, eating, personal hygiene, toilet use, bathing, functional range of motion, functional rehabilitation potential, and change in activities of daily living function. The types of involvement varied from writing directly on the MDS to verbal or written reports to others responsible for writing on the MDS. Fewer than half of respondents reported contributions to MDS sections dealing with cognition, psychosocial well-being, mood or behavior, communication, vision, and activity pursuit patterns. Although most respondents were familiar with the Functional Independence Measure, they were more likely to be involved in the MDS process. Conclusion. Even though the MDS is a comprehensive assessment, most respondents contributed only to the self-care parts of the MDS, with patterns of involvement lacking standardization across facilities

Behavioral assessment of social performance: a rating system for social phobia

The Social Performance Rating Scale (SPRS) is a modification of the rating system for behavioral assessment of social skills, originally developed by Trower et al. (Trower, P., Bryant, B., & Argyle, M. (1978). Social skills and mental health. Pittsburgh: University of Pittsburgh Press) and subsequently adapted by Turner and colleagues (e.g., Turner, S. M., Beidel, D. C., Dancu, C. V., & Keys, D. J. (1986). Psychopathology of social phobia and comparison to avoidant personality disorder. Journal of Abnormal Psychology, 95, 389–394). Designed to yield ratings of social performance appropriate for use in a socially phobic population and based on videotaped role plays, the five SPRS ratings are gaze, vocal quality, speech length, discomfort, and conversation flow. The sum of these ratings provides an internally consistent total score. In an initial study of the psychometric properties of the SPRS, three groups were assessed: individuals with social phobia, another anxiety disorder, or no psychological disorder. Inter-rater reliability for individual items and the total score proved excellent, and positive evidence for convergent, divergent, and criterion-related validity was obtained.

Inter-rater reliability of two depression rating scales, MADRS and DRRS, based on videotape records of structured interviews

The inter-rater reliability of the French versions of the MADRS and the DRRS was studied on the basis of 58 videotape records of structured standardised interviews of depressed inpatients under antidepressant treatment. Each patient was assessed by two trained raters, from the same videotape recording. The inter-rater reliability of total scores was high with both scales (intra-class correlation coefficients: 0.86 for MADRS and 0.77 for DRRS). However, the inter-rater reliability for individual items was higher and more homogeneous for the MADRS than for the DRRS. Finally, the structured interview in French appears to be relevant for the MADRS, but it should be improved for the DRRS.