Inter-method Reliability Research Articles

Literacy Independent Cognitive Assessment: Assessing Mild Cognitive Impairment in Older Adults with Low Literacy Skills.

ObjectiveComprehensive neuropsychological tests are important in the diagnosis and follow-up of patients with MCI; however, most were developed without consideration of illiteracy. We developed the Literacy Independent Cognitive Assessment (LICA) as a comprehensive neuropsychological assessment battery applicable to older adults who are either literate or illiterate. This study aimed to assess the reliability and validity of the LICA for diagnosis of MCI.MethodsNormal controls (n=634) and patients with MCI (n=128) were recruited from 13 centers were included in this study. Participants were divided into illiterate or literate groups, based on their performance on a brief reading and writing test. The LICA, Korean Mini-Mental State Examination (K-MMSE), and Seoul Neuropsychological Screening Battery (SNSB) were administered.ResultsTotal LICA scores distinguished MCI patients from controls (p<0.001). They were closely and positively correlated to the K-MMSE scores (r=0.632, p<0.001) but negatively correlated to clinical dementia rating (CDR) (r=-0.358, p<0.001) and CDR sum of boxes (r=-0.339, p<0.001). Area under the receiver operating characteristic curve for patients with MCI by total LICA score was 0.827 (0.783-0.870), superior to that presented by the K-MMSE. For the classification of MCI subtypes, inter-method reliability of LICA with the SNSB was good (κ 0.773; 0.679-0.867, p<0.001).ConclusionThe results of this study show that the LICA may be reliably used to distinguish MCI patients from cognitively intact adults, to identify MCI subtypes and monitor progression toward dementia, regardless of illiteracy.

Self-reported sex partner dates for use in measuring concurrent sexual partnerships: correspondence between two assessment methods.

Although prevalence of concurrent sexual partnerships is increasingly investigated as a driver of HIV epidemics, its measurement varies and its role in transmission dynamics remains contested. Relying on different methods of obtaining self-reported partnership histories may lead to significant differences in prevalence. This study examined the reliability of two methods for assessing dates of sex and the implications for measuring concurrent sexual partnerships. We conducted a cross-sectional reliability study using self-reported survey data from 650 women ages 18-65 years, recruited online nationwide for human papillomavirus natural history studies from 2007 to 2012. Intermethod reliability of first and last sex with the most recent partner was assessed using weighted kappa. Intraclass correlation coefficient was estimated for intramethod reliability across two consecutive questionnaires administered 4 months apart. Point prevalence of concurrent sexual partnerships at 6 months prior to the questionnaire date was similar between the two question formats (10.5 % for categorical and 10.9 % for continuous). The range between the minimum and maximum cumulative prevalence for 12 months was larger when using the categorical questions (17.0-29.6 % compared to 27.6-28.6 % using the continuous questions). Agreement between the two question formats was moderate for the date of first sex with the most recent partner (κ = 0.56, 95 % CI 0.48-0.64) and almost perfect for the date of last sex (κ = 0.93, 95 % CI 0.91-0.94). Longitudinal agreement for date of first sex was high for the continuous date question (ICC = 0.89, 95 % CI 0.86-0.92). Results of this reliability study can be used to inform the design of future studies of concurrent sexual partnerships and their association with HIV.

Age-friendly cities and environments: an investigation of the living environment of older people in England based on the MRC Cognitive Function and Ageing Study II

BackgroundWith trends in population ageing, the idea of age-friendly cities has been proposed with a focus on built and social environmental features related to active ageing. We aimed to describe the living environment of older people at small area level using data from the Cognitive Function and Ageing Study II (CFAS II), a representative sample of 7505 people aged 65 years and over in England. MethodsLiving environment was described at the community and street level. At community level, postcodes of the CFAS II participants were mapped onto 557 Lower Layer Super Output Areas and linked to environmental data in Neighbourhoods Statistics including area deprivation, crime, distance to services, land use, and green space. Street level assessment was based on an observational instrument designed for UK postcodes, the Residential Environmental Assessment Tool, by use of visual streetscape images of Google Street View. The measurement method was validated and showed acceptable intermethod reliability of physical and visual image audits. Three rural and urban categories (urban conurbation, urban city and town, rural areas) were defined by the 2011 rural–urban classification. FindingsTwo-thirds (n=4905) of the older population lived in an urban conurbation. More of the younger old (aged 65–79 years) than older old (≥80 years) lived in rural areas (1158 vs 396). In the overall population, we found moderate associations between area deprivation and crime (Spearman correlation=0·6), distance to services (−0·2), land use mix (0·5), and green space (−0·3), but they were weaker in rural areas. In addition to rural–urban and area deprivation differences, substantial variations in built and social environmental features were found at community and street levels: communities in urban conurbations generally had high crime, shorter distance to services, high heterogeneity of land use, and low proportion of green space with worse quality of street level conditions than did communities in rural areas. InterpretationOlder people in England live in a wide variety of environments with potential effect on health and wellbeing. Use of new technology can help to observe and explore variations in living environments at the small area level systematically and comprehensively; this provides opportunities to identify important environmental features related to healthy ageing and develop practical guidelines for policy planning to create age-friendly cities and environments through an evidence-based approach. FundingThere is no specific funding contributing to this study. Medical Research Council Cognitive Function and Ageing Study II (MRC CFAS II) was funded by the Medical Research Council (grant number G0601022).

Assessing environmental features related to mental health: a reliability study of visual streetscape images.

BackgroundAn association between depressive symptoms and features of built environment has been reported in the literature. A remaining research challenge is the development of methods to efficiently capture pertinent environmental features in relevant study settings. Visual streetscape images have been used to replace traditional physical audits and directly observe the built environment of communities. The aim of this work is to examine the inter-method reliability of the two audit methods for assessing community environments with a specific focus on physical features related to mental health.MethodsForty-eight postcodes in urban and rural areas of Cambridgeshire, England were randomly selected from an alphabetical list of streets hosted on a UK property website. The assessment was conducted in July and August 2012 by both physical and visual image audits based on the items in Residential Environment Assessment Tool (REAT), an observational instrument targeting the micro-scale environmental features related to mental health in UK postcodes. The assessor used the images of Google Street View and virtually "walked through" the streets to conduct the property and street level assessments. Gwet’s AC1 coefficients and Bland-Altman plots were used to compare the concordance of two audits.ResultsThe results of conducting the REAT by visual image audits generally correspond to direct observations. More variations were found in property level items regarding physical incivilities, with broad limits of agreement which importantly lead to most of the variation in the overall REAT score. Postcodes in urban areas had lower consistency between the two methods than rural areas.ConclusionsGoogle Street View has the potential to assess environmental features related to mental health with fair reliability and provide a less resource intense method of assessing community environments than physical audits.

Reliability and validity of daily self-monitoring by smartphone application for health-related quality-of-life, antiretroviral adherence, substance use, and sexual behaviors among people living with HIV.

This paper examines inter-method reliability and validity of daily self-reports by smartphone application compared to 14-day recall web-surveys repeated over 6weeks with people living with HIV (PLH). A participatory sensing framework guided participant-centered design prioritizing external validity of methods for potential applications in both research and self-management interventions. Inter-method reliability correlations were consistent with prior research for physical and mental health quality-of-life (r=0.26-0.61), antiretroviral adherence (r=0.70-0.73), and substance use (r=0.65-0.92) but not for detailed sexual encounter surveys (r=0.15-0.61). Concordant and discordant pairwise comparisons show potential trends in reporting biases, for example, lower recall reports of unprotected sex or alcohol use, and rounding up errors for frequent events. Event-based reporting likely compensated for modest response rates to daily time-based prompts, particularly for sexual and drug use behaviors that may not occur daily. Recommendations are discussed for future continuous assessment designs and analyses.

Inter-Method Reliability of Progression Sizes in a Hypothetical Purchase Task: Implications for Empirical Public Policy

Advances in behavioral economic research methodology have generated novel insights into public policy considerations regarding substance use and addiction. A major advancement toward this end was the development of hypothetical purchase tasks (HPTs) that permit modeling of consumption and demand without the need for actual purchases and lengthy human operant studies comprised of real reward deliveries. Psychometric research in the domain of behavioral pharmacology suggests that the HPT has adequate test–retest reliability, as well as construct and convergent/divergent validity. Research to date has exclusively examined pharmacological commodities, however, necessitating the need for technology transfer to other pressing societal issues. In the present study, we examined demand for recreational driving across three groups, each consisting of a different fuel price progression size in the HPT. Findings suggest that behavioral economic models of demand do not differ as a function of progression size, providing support to the inter-method reliability of this procedure.

Inter-method reliability of paper surveys and computer assisted telephone interviews in a randomized controlled trial of yoga for low back pain

BackgroundLittle is known about the reliability of different methods of survey administration in low back pain trials. This analysis was designed to determine the reliability of responses to self-administered paper surveys compared to computer assisted telephone interviews (CATI) for the primary outcomes of pain intensity and back-related function, and secondary outcomes of patient satisfaction, SF-36, and global improvement among participants enrolled in a study of yoga for chronic low back pain.ResultsPain intensity, back-related function, and both physical and mental health components of the SF-36 showed excellent reliability at all three time points; ICC scores ranged from 0.82 to 0.98. Pain medication use showed good reliability; kappa statistics ranged from 0.68 to 0.78. Patient satisfaction had moderate to excellent reliability; ICC scores ranged from 0.40 to 0.86. Global improvement showed poor reliability at 6 weeks (ICC = 0.24) and 12 weeks (ICC = 0.10).ConclusionCATI shows excellent reliability for primary outcomes and at least some secondary outcomes when compared to self-administered paper surveys in a low back pain yoga trial. Having two reliable options for data collection may be helpful to increase response rates for core outcomes in back pain trials.Trial registrationClinicalTrials.gov: NCT01761617. Date of trial registration: December 4, 2012.

Reliability of Nasolabial Anthropometric Measures Using Three-Dimensional Stereophotogrammetry in Infants with Unrepaired Unilateral Cleft Lip

Surgical and orthodontic treatment of unilateral cleft lip +/- palate can produce dramatic changes in nasolabial form; however, the lack of ideal methods with which to objectively document three-dimensional form limits the ability to assess treatment outcomes. The purpose of this study was to determine the reliability of three-dimensional stereophotogrammetry for anthropometric assessment of the unilateral cleft lip +/- palate deformity in infants before cleft lip repair. Preoperative three-dimensional images were acquired from 26 consecutive patients with unrepaired unilateral cleft lip +/- palate. Three raters performed indirect anthropometry on each image on two separate occasions, with at least 1 week between rating sessions. One rater performed direct measurements on participants before surgery while in the operating room. Twenty-six linear and angular measurements were considered, and intrarater, interrater, and intermethod reliability were assessed. Regarding intrarater and interrater reliability, most measurements had Pearson coefficients greater than 0.75, mean differences less than 0.8 mm, and mean proportional differences less than 0.1. For measurements involving vermilion height, nostril remnants, or Cupid's bow width, Pearson coefficients ranged from 0.3 to 0.75, mean differences ranged from 0.4 to 0.9 mm, and mean proportional differences ranged from 0.1 to 0.3. Regarding intermethod reliability, correlation coefficients ranged from 0.4 to 0.75 for most measurements. The mean differences for nose and lip measurements were less than 1 mm and between 0.8 and 1.3 mm, respectively. Three-dimensional stereophotogrammetry provides a reliable method for many anthropometric measurements of nasolabial form in infants with unrepaired unilateral cleft lip +/- palate. Diagnostic, II.

Evaluation of Web-Based, Self-Administered, Graphical Food Frequency Questionnaire

Computer-administered food frequency questionnaires (FFQs) can address limitations inherent in paper questionnaires by allowing very complex skip patterns, portion size estimation based on food pictures, and real-time error checking. We evaluated a web-based FFQ, the Graphical Food Frequency System (GraFFS). Participants completed the GraFFS, six telephone-administered 24-hour dietary recalls over the next 12 weeks, followed by a second GraFFS. Participants were 40 men and 34 women, aged 18 to 69 years, living in the Columbus, OH, area. Intakes of energy, macronutrients, and 17 micronutrients/food components were estimated from the GraFFS and the mean of all recalls. Bias (second GraFFS minus recalls) was −9%, −5%, +4%, and −4% for energy and percentages of energy from fat, carbohydrate, and protein, respectively. De-attenuated, energy-adjusted correlations (intermethod reliability) between the recalls and the second GraFFS for fat, carbohydrate, protein, and alcohol were 0.82, 0.79, 0.67, and 0.90, respectively; for micronutrients/food components the median was 0.61 and ranged from 0.40 for zinc to 0.92 for beta carotene. The correlations between the two administrations of the GraFFS (test–retest reliability) for fat, carbohydrate, protein, and alcohol were 0.60, 0.63, 0.73, and 0.87, respectively; among micronutrients/food components the median was 0.67 and ranged from 0.49 for vitamin B-12 to 0.82 for fiber. The measurement characteristics of the GraFFS were at least as good as those reported for most paper FFQs, and its high intermethod reliability suggests that further development of computer-administered FFQs is warranted.

Reliability and Accuracy of Real-Time Visualization Techniques for Measuring School Cafeteria Tray Waste: Validating the Quarter-Waste Method

Measuring food waste is essential to determine the impact of school interventions on what children eat. There are multiple methods used for measuring food waste, yet it is unclear which method is most appropriate in large-scale interventions with restricted resources. This study examines which of three visual tray waste measurement methods is most reliable, accurate, and cost-effective compared with the gold standard of individually weighing leftovers. School cafeteria researchers used the following three visual methods to capture tray waste in addition to actual food waste weights for 197 lunch trays: the quarter-waste method, the half-waste method, and the photograph method. Inter-rater and inter-method reliability were highest for on-site visual methods (0.90 for the quarter-waste method and 0.83 for the half-waste method) and lowest for the photograph method (0.48). This low reliability is partially due to the inability of photographs to determine whether packaged items (such as milk or yogurt) are empty or full. In sum, the quarter-waste method was the most appropriate for calculating accurate amounts of tray waste, and the photograph method might be appropriate if researchers only wish to detect significant differences in waste or consumption of selected, unpackaged food.

Ergonomic issues in ewe cheese production: reliability of the Strain Index and OCRA Checklist risk assessments

Occupational ergonomists often use a variety of methods to identify jobs that are considered at high risk for the development of work-related musculoskeletal illnesses. The Strain Index (SI) and the Occupational Repetitive Actions (OCRA) Checklist are two popular upper limb risk assessment tools used in many industries, including the agro-food industry. Both methods are based on similar biomechanical, physiological and epidemiologic principles, but their approach to quantification and estimation of risk factor magnitude is quite different. The purpose of this study was to assess the inter-method reliability of SI and OCRA Checklist. Methods: Twenty-one jobs were video recorded in a Sardinian cheese manufacturing facility. Eight raters were recruited to assess job exposures to physical risk factors using the SI and OCRA Checklist. Inter-method reliability was characterized using proportion of overall agreement, Cohen’s kappa, and Spearman and Pearson correlations. Results: Strain Index and the OCRA Checklist assessments produced generally reliable results, classifying the risk of 35 of 42 (83%) job exposures similarly. Conclusions: The OCRA Checklist and SI risk assessments are reliable upper limb measures of physical work exposures. Both measures appear useful for assessing risk of upper limb disorders of work tasks in the agro-food industry. However, the SI is specific to disorders of the distal upper limb and perhaps most useful for assessing risk in work primarily involving the wrist and fingers. Whereas the OCRA Checklist, which includes an assessment of the shoulder, may be more appropriate for evaluating jobs that also require extended periods of reaching and shoulder activity.

Reliability and Accuracy of Real-Time Visualization Techniques for Measuring School Cafeteria Tray Waste: Validating the Quarter-Waste Method

Measuring food waste is essential to determine the impact of school interventions on what children eat. There are multiple methods used for measuring food waste, yet it is unclear which method is most appropriate in large-scale interventions with restricted resources. This study examines which of three visual tray waste measurement methods is most reliable, accurate, and cost-effective compared to the gold standard of individually weighing leftovers. School cafeteria researchers used three visual methods to capture tray waste in addition to actual food waste weights for 197 lunch trays: 1) The quarter-waste method, 2) the half-waste method, and 3) the photograph method. Inter-rater and inter-method reliability were highest for on-site visual methods (0.90 for the quarter-waste method and 0.83 for the half-waste method) and lowest for the photograph-method (0.48). This low reliability is partially do to the inability of photographs to determine whether packaged item (such as milk or yogurt) is empty or full. In sum, the quarter-waste method was the most appropriate for calculating accurate amounts of tray waste whereas the photograph method may be appropriate if researchers only wish to detect significant differences in waste or consumption of selected, unpackaged food.

The Reliability of Measuring Pain Distribution and Location Using Body Pain Diagrams in Patients With Acute Whiplash-Associated Disorders

ObjectiveThe objective of this study was to measure the interexaminer reliability of scoring pain distribution using paper and electronic body pain diagrams in patients with acute whiplash-associated disorder and to assess the intermethod reliability of measuring pain distribution and location using paper and electronic diagrams. MethodsWe conducted an interexaminer reliability study on 80 participants recruited from a randomized controlled trial on the conservative management of acute grade I/II whiplash-associated disorder. Participants were assessed for inclusion/exclusion criteria by an experienced clinician. As part of the baseline assessment, participants independently completed paper and electronic pain diagrams. Diagrams were scored independently by 2 examiners using the body region method. Interexaminer and intermethod reliability was computed using intraclass correlation coefficients (ICCs) for pain distribution and κ coefficient for pain location. We used Bland-Altman plots to compute limits of agreement. ResultsThe interexaminer reliability was ICC = 0.925 for paper and ICC = 0.997 for the electronic body pain diagram. The intermethod reliability for measuring pain distribution ranged from ICC = 0.63 to ICC = 0.93. For pain location, the intermethod reliability varied from κ = 0.23 (posterior neck) to κ = 0.90 (right side of the face). ConclusionsWe found good to excellent interexaminer reliability for scoring 2 versions of the body pain diagram. Pain distribution and pain location were reliably and consistently measured on body pain diagrams using paper and electronic methods; therefore, clinicians and researchers may choose either medium when using body pain diagrams.

Reliability of self-reported sun exposure in Canadian women and estimation of lifetime exposure to vitamin D from sun and diet.

To assess the inter-method reliability of the Ovarian Cancer in Alberta (OVAL) survey developed to estimate adult vitamin D exposure from sun and diet for every tenth year, against the longer Geraldton Skin Cancer Prevention Survey (the assumed 'gold standard'). We also estimated total vitamin D exposure using the OVAL survey. A randomized crossover design to assess the inter-method reliability of sun exposure (OVAL v. Geraldton survey), using intra-class correlation and estimated total vitamin D exposure from sun and diet. Calgary, Alberta, Canada. Randomly selected women (n 90) aged 40-79 years. The average lifetime sun exposure of 13,913 h (average 411 h/year) from the Geraldton survey was not significantly different from the 13,034 h (average 385 h/year) from the OVAL survey for periods with sufficient UV radiation to stimulate vitamin D production. The intra-class correlation coefficient for average lifetime sun exposure was 0.77 (95% CI 0.69, 0.86); the annual average was 0.60 (95% CI 0.47, 0.74). Estimated vitamin D from diet and supplements increased with age. Our OVAL survey reliably estimated adult sun exposure relative to the Geraldton survey, suggesting that assessing sun exposure every tenth year is a reliable and efficient method for estimating sun contributions to lifetime vitamin D exposure.

CT and MRI Measurements of Tibial Tubercle–Trochlear Groove Distances Are Not Equivalent in Patients With Patellar Instability

Background: Tibial tubercle–trochlear groove distance (TT-TG) is a commonly used measurement for surgical decision making in patients with patellofemoral malalignment and instability. This measurement has historically been performed utilizing axial computed tomography (CT). More recently, magnetic resonance imaging (MRI) has been proposed as an equivalent method, but this has not yet been fully validated. Purpose: To determine the reliability of TT-TG distance measurements on both MRI and CT and to determine whether the measurements are interchangeable with one another. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: All patients with patellar instability who underwent both CT and MRI of the knee from 2003 to 2011 were included (n = 59 knees in 54 patients). Two fellowship-trained musculoskeletal radiologists measured the TT-TG distances for each patient by CT and MRI in a randomized, blinded fashion. Interobserver reliability was calculated between radiologists for both imaging modalities, and intermethod reliability was calculated between the 2 imaging modalities. The results are reported using intraclass correlation coefficients (ICCs) and Bland-Altman analysis. Results: The 59 knees had a mean TT-TG distance of 16.9 mm (range, 8.3-25.8 mm) by CT and 14.7 mm (range, 1.5-25.1 mm) by MRI. Interobserver reliability between the radiologists was considered excellent for both CT and MRI (ICC = 0.777 and 0.843, respectively). When comparing CT to MRI, the ICC was considered only fair for each of the raters (0.532 and 0.539). Eleven patients (19%) had a TT-TG distance of ≥20 mm on CT preoperatively and underwent distal realignment by tibial tubercle osteotomy. In this surgical subgroup, the mean TT-TG distance was 22.5 mm (range, 19.8-25.8 mm) by CT and only 18.7 mm (range, 14.4-22.8 mm) by MRI for a mean difference of 3.80 mm (P < .001). Conclusion: The TT-TG distance can be measured with excellent interrater reliability on both MRI and CT; however, the values derived from these 2 tests may not be interchangeable. This observation should be taken into consideration when MRI is used for surgical planning because MRI may underestimate the TT-TG distance when compared with CT.

Re: Inter- and intra-observer reliability of a smartphone application for measuring hallux valgus angles [Foot Ankle Surg. 19 (1) (2013) 18–21

The objective of the present study was to assess the reliability of 2 smartphone applications compared with the traditional goniometer technique for measurement of radiographic angles in hallux valgus and the time required for analysis with the different methods. The radiographs of 31 patients (52 feet) with a diagnosis of hallux valgus were analyzed. Four observers, 2 with >10 years’ experience in foot and ankle surgery and 2 in-training surgeons, measured the hallux valgus angle and intermetatarsal angle using a manual goniometer technique and 2 smartphone applications (Hallux Angles and iPinPoint). The interobserver and intermethod reliability were estimated using intraclass correlation coefficients (ICCs), and the time required for measurement of the angles among the 3 methods was compared using the Friedman test. A very good or good interobserver reliability was found among the 4 observers measuring the hallux valgus angle and intermetatarsal angle using the goniometer (ICC 0.913 and 0.821, respectively) and iPinPoint (ICC 0.866 and 0.638, respectively). Using the Hallux Angles application, a very good interobserver reliability was found for measurements of the hallux valgus angle (ICC 0.962) and intermetatarsal angle (ICC 0.935) only among the more experienced observers. The time required for the measurements was significantly shorter for the measurements using both smartphone applications compared with the goniometer method. One smartphone application (iPinPoint) was reliable for measurements of the hallux valgus angles by either experienced or nonexperienced observers. The use of these tools might save time in the evaluation of radiographic angles in the hallux valgus.

Assessing the inter-method reliability and correlational validity of the Body Type Dictionary

The political negotiation, erection, and fall of national and cultural borders represent an issue that frequently occupies the media. Given the historical importance of boundaries as a marker of cultural identity, as well as their function to separate and unite people, the Body Type Dictionary (BTD; Wilson, 2006) represents a suitable computerized content analysis measure to analyse vocabulary qualified to measure body boundaries and their penetrability. Out of this context, this study aimed to assess the inter-method reliability of the BTD (Wilson, 2006) in relation to Fisher and Cleveland’s (1956, 1958) manual scoring system for high and low barrier personalities. The results indicated that Fisher and Cleveland’s manually coded barrier and penetration imagery scores showed an acceptable positive correlation with the computerized frequency counts of the BTD’s coded barrier and penetration imagery scores, thereby indicating an inter-method reliability. In addition, barrier and penetration imagery correlated positively with primordial thought language in the picture response test, and narratives of everyday and dream memories, thereby indicating correlational validity.

Ergonomic issues in ewe cheese production: reliability of the Strain Index and OCRA Checklist risk assessments

Occupational ergonomists often use a variety of methods to identify jobs that are considered at high risk for the development of work-related musculoskeletal illnesses. The Strain Index (SI) and the Occupational Repetitive Actions (OCRA) Checklist are two popular upper limb risk assessment tools used in many industries, including the agro-food industry. Both methods are based on similar biomechanical, physiological and epidemiologic principles, but their approach to quantification and estimation of risk factor magnitude is quite different. The purpose of this study was to assess the inter-method reliability of SI and OCRA Checklist. Methods: Twenty-one jobs were video recorded in a Sardinian cheese manufacturing facility. Eight raters were recruited to assess job exposures to physical risk factors using the SI and OCRA Checklist. Inter-method reliability was characterized using proportion of overall agreement, Cohen’s kappa, and Spearman and Pearson correlations. Results: Strain Index and the OCRA Checklist assessments produced generally reliable results, classifying the risk of 35 of 42 (83%) job exposures similarly. Conclusions: The OCRA Checklist and SI risk assessments are reliable upper limb measures of physical work exposures. Both measures appear useful for assessing risk of upper limb disorders of work tasks in the agro-food industry. However, the SI is specific to disorders of the distal upper limb and perhaps most useful for assessing risk in work primarily involving the wrist and fingers. Whereas the OCRA Checklist, which includes an assessment of the shoulder, may be more appropriate for evaluating jobs that also require extended periods of reaching and shoulder activity.

Disability Weights for Cancers in Korea

This study renewed the estimation of disability weights for cancers in Korea, reflecting the nation's economic and medical-technological development during the past 10 yr. Thirty-two medical doctors evaluated disability weights for 24 major cancers based on the visual analogue scale (VAS) method. To check the intra-rater reliability, a correlation was calculated between 2011 and 2012 medians. To assess the inter-rater reliability, a correlation was estimated between oncologist and non-oncologist medians. To assess the inter-method reliability, a correlation was calculated between medians on VAS and Person-Trade-Off approaches. Moreover, findings in this study were compared to those in 2003 research. Spearman correlation was used and the 1% significance level was applied. Disability weights were relatively high for pancreas cancer (0.90), gallbladder cancer (0.81), mouth and oropharynx cancer (0.80), and esophagus cancer (0.80). Conversely, they were relatively low for breast cancer (0.37), prostate cancer (0.33) and thyroid cancer (0.10). All the inter-rater reliabilities were higher than 0.7. Indeed, the intra-rater and inter-method reliabilities were 0.752 and 0.927, respectively. Above all, disability weights for major cancers went down in Korea during 2003-2012, reflecting the progress of medical technology and the growth of cancer survival.

Web Versus Paper-Based Completion of the Epidemiology of Prolapse and Incontinence Questionnaire

This study aimed to examine the validity and reliability of a Web-based version of the epidemiology of prolapse and incontinence questionnaire (EPIQ). Participants included 876 women age 38 to 65 years attending primary care clinics in the Salt Lake Valley. Women completed a single Web- or paper-based version of the symptom bother questions from EPIQ, and a subset repeated the same or opposite method at 2 separate time points. To assess subscales for the Web-based version factor, analysis of the 22 EPIQ items related to pelvic floor disorder symptoms was performed using principal components analysis and varimax rotation. Internal consistency was assessed using coefficient α. Test-retest and intermethod reliability were assessed using intraclass correlation coefficients for domain scores. Correlations above 0.70 were considered acceptable. Overall, 384 and 492 women completed at least 1 Web and 1 paper EPIQ and 93% were white with mean age of 50 (7) years. Of these, 63 completed Web-Web, 57 Web-paper, 47 paper-Web, and 109 paper-paper test-retest. Overall, factor analyses were consistent with the 7 domains of the original EPIQ. Cronbach α for the 4 symptomatic pelvic floor disorder domains and range of test-retest reliability for the various administration methods were similar to the original EPIQ instrument. Correlations for domain scores were above 0.70, except the anal incontinence scale (intraclass correlation coefficients, 0.68.) Web administration of the EPIQ has similar psychometric properties with comparable internal consistency and test-retest reliability when administered in the same modality. Reliability between both methods of administration is acceptable.