Reliability Of Self-reported Data Research Articles

Abstract P3-03-24: The WISDOM Study: Early Ascertainment of Breast Cancer Diagnoses by Utilizing Self-Reported Questionnaires and Data Warehouse Electronic Health Records

Abstract BACKGROUND WISDOM (Women Informed to Screen Depending on Measures of risk) is a pragmatic trial comparing the safety, efficacy, cost, and patient acceptability of personalized versus annual breast cancer screening in women ages 40-74 years with no personal history of breast cancer. Cancer registry reporting is considered the gold standard for ascertaining cancer diagnosis data; however, the time lag between diagnosis and reporting (1-2 years or more) by the California Cancer Registry (CCR) presents challenges. The WISDOM study must quickly ascertain and report accurate cancer diagnoses to the Data Safety Monitoring Board; delays could lead to preventable harm, unnecessary costs, and unwarranted early trial termination. To ascertain cancer diagnoses in a timely manner, we used multiple data collection methods and compared self-reported with Electronic Health Records (EHR) information, and in some cases verified with chart review. Specifically, we conducted a procedural study with WISDOM participants who sought care at a University of California (UC) health system by extracting their data from the University of California Data Warehouse (UCDW) to 1) verify self-reported breast cancer diagnoses in WISDOM; 2) ensure that all on-study breast cancer diagnoses have been captured within the WISDOM study cohort; and 3) assess the accuracy and reliability of self-reported data. The UCDW provides harmonized EHR data from the six University of California (UC) health systems and constitutes ~120 billion data points from 7.8 million patient records. METHODS We provided the UCDW with a list of WISDOM participants who indicated they had sought care from a UC health system. Participants with recorded breast cancer diagnostic code (ICD-10CM C50.) were matched with the WISDOM self-reported cancer dataset to uncover participants who had no recorded breast cancer diagnosis in the study system. For those individuals with no recorded self-report diagnosis, coordinators conducted manual chart review to determine whether the participants had been diagnosed with breast cancer. RESULTS This cohort included 11,314 enrolled WISDOM participants who self-reported care at a UC and had at least one diagnostic or procedural breast care code. Among these participants, 160 had a ICD-10-CM C50 breast cancer diagnostic code of which 132 breast cancer cases were confirmed: 111 were already self-reported through WISDOM and 21 additional confirmed breast cancer cases were identified through the UCDW. As a standard process, only WISDOM self-reported cancer cases that were confirmed by chart review are entered into the study database. The percentage of confirmed UCDW-identified cases that were not also self-reported was greater for recent diagnoses (16% overall and 6% for period prior to June 2020). Among the 11,314 participants in our cohort, the CCR identified 61 pre-June 2020 cancer diagnoses. Of these 61 diagnoses, 92% (56) were identified by the UCDW procedural process. If the UCDW had been used as the single source for cancer diagnosis, 21 participants without cancer and 7 participants with unclear status (unlocated or inaccessible records) would have been classified as cancer cases. DISCUSSION/CONCLUSION Self-reported data provides quick ascertainment with relative accuracy compared to cancer registry. Cancer ascertainment can be further improved by combining self-reported data with EHR data from a health system data warehouse registry, particularly for self-reported questionnaire issues such as timing and lack of response. Accuracy of self-reported cancer diagnosis from annually distributed questionnaires improves over time. Identifying cancer diagnosis discordance between data sources can inform processes to improve self-reported study accuracy. Citation Format: Katherine Leggat-Barr, Rita H. Ryu, Allison Stover Fiscalini, Tomiyuri Lewis, Rohini S. Bulusu, Samrrah A. Raouf, Hannah Lui Park, Alyssa N. Rocha, Liliana Johansen, Laura Van ’t Veer, Laura J. Esserman, Michael A. Hogarth. The WISDOM Study: Early Ascertainment of Breast Cancer Diagnoses by Utilizing Self-Reported Questionnaires and Data Warehouse Electronic Health Records [abstract]. In: Proceedings of the 2022 San Antonio Breast Cancer Symposium; 2022 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2023;83(5 Suppl):Abstract nr P3-03-24.

Congruence between Physical Activity Patterns and Dietary Patterns Inferred from Analysis of Sex Differences in Lifestyle Behaviors of Late Adolescents from Poland: Cophylogenetic Approach.

Global trends toward physical inactivity and the replacement of healthy dietary behaviors with unhealthy food consumption, particularly in late adolescence, were commonly observed. Thus, the aim of this work was twofold: (1) to examine congruence between PAPs and DPs by identifying sex differences in healthy and unhealthy behaviors and (2) to assess the explanation behind why certain participants were classified into clusters using BMI and fat mass covariates. Late adolescents (19-21 years of age, n = 107) were selected to study. PAPs and DPs were assessed with questionnaires (IPAQ, QEB) and body height, weight, and fat mass percentage were self-reported (the accuracy and reliability of self-reported data were empirically verified). A cophylogenetic approach with several clustering procedures (heatmaps and tanglegrams) was the way to solve the stated problems. Results showed that students achieved the minimal level of physical activity, lower than students from other regions in Poland, Czech Republic, or Germany. There was congruence between PAPs and DPs in some males' and females' behaviors. Significant similarities in sex patterns of behaviors were revealed (Mantel tests-PAPs: r = 0.70, p < 0.001; DPs: r = 0.84, p < 0.001). Similarities in PAPs were related to transportation cycling and school/work activities behaviors. Non-healthy triads in dietary behaviors were found: fast-food, sweetened beverages, and alcoholic drinks in the first, and sweets, fried meals, and yellow cheese in the second. One healthy diad was revealed: vegetables and fruits. Only females' dietary behaviors were reflected in body mass index (F = 3.19, p = 0.049), percentage of body fat (F = 3.87, p = 0.027), and fat mass index (F = 3.83, p = 0.028). The usefulness of the cophenetic approach in patterns study was verified. Sex similarities and specific disparities could help preparing targeted tailored intervention programs that improve healthy habits in late adolescents. This is especially important in relation to females, who more strongly reflected dietary behaviors in body composition.

Reliability of Self-Report Data on Age of Onset in Essential Tremor: Data from a Prospective, Longitudinal Cohort

Background: Essential tremor (ET) is a highly prevalent neurological disease. Age of onset can occur anytime between childhood and advanced age. Tremor generally starts insidiously. Age of onset is a particularly important data item in clinical and epidemiological research. In general, these data are self-reported by ET cases. A fundamental question is whether ET cases reliably report their age of onset. Methods: In this prospective, epidemiological study of 125 ET cases, self-reported age of onset data were collected at regular 18 months intervals over four time points. Results: The correlation between self-reported age of onset was high – intra-class correlation coefficient = 0.972 (95% confidence interval = 0.962–0.980, p < 0.001). However, agreement was not perfect. Approximately 20–25% of participant’s reports at different time intervals differed by as much as 10 years, and approximately 10% of participant’s reports differed by as much as 20 years. Conclusions: There was a robust correlation between self-reports of age of onset. Yet in a not-insignificant number of cases, there were considerable differences, some of which were substantial. These findings have broad implications for development of diagnostic algorithms, data stratification schemes, and analyses that assess correlations between biomarker data and clinical features (e.g., disease duration).

Interviewing adolescent girls about sexual and reproductive health: a qualitative study exploring how best to ask questions in structured follow-up interviews in a randomized controlled trial in Zambia

BackgroundNumerous studies have documented inconsistent reporting of sexual behaviour by adolescents. The validity and reliability of self-reported data on issues considered sensitive, incriminating or embarrassing, is prone to social-desirability bias. Some studies have found that Audio Computer-Assisted Self Interviewing (ACASI) that removes the personal interaction involved in face-to-face interviews, decreases item non-response and increases reporting of sensitive behaviours, but others have found inconsistent or contradictory results. To reduce social desirability bias in the reporting of sensitive behaviours, face-to-face interviews were combined with ACASI in a cluster randomized trial involving adolescents in Zambia.MethodsTo explore adolescent girls’ experiences and opinions of being interviewed about sexual and reproductive health, we combined Focus Group Discussions with girl participants and individual semi-structured interviews with teachers. This study was done after the participants had been interviewed for the 6th time since recruitment. Young, female research assistants who had conducted interviews for the trial were also interviewed for this study.ResultsRespondents explained often feeling shy, embarrassed or uncomfortable when asked questions about sex, pregnancy and abortion face-to-face. Questions on sexual activity elicited feelings of shame, and teachers, research assistants and girls alike noted that direct questions about sexual activities limit what the participant girls may be willing to share. Responding to more indirect questions in relation to the context of a romantic relationship was slightly easier. Efforts by interviewers to signal that they did not judge the participants for their behavior and increased familiarity with the interviewer reduced discomfort over time. Although some appreciated the opportunity to respond to questions on their own, the privacy offered by ACASI also provided an opportunity to give false answers. Answering on tablets could be challenging, but participants were reluctant to ask for assistance for fear of being judged as not conversant with technology.ConclusionStrategies to avoid using overly direct language and descriptive words, asking questions within the context of a romantic relationship and a focus on establishing familiarity and trust can reduce reporting bias. For the use of ACASI, considerations must be given to the context and characteristics of the study population.

Reliability of self-reported data from the 2011 Ja-Kids birth cohort study: demographic, social, obstetric history, medical and outcome indicators

ABSTRACT The Ja-Kids Longitudinal Study (JA-Kids) aims to improve the health and development of Jamaican children by identifying social, demographic, environmental and clinical factors that help or hinder these processes. As clinical indicators relied on maternal reporting, we aim to evaluate the quality of the self-reported data. Women were recruited across Jamaica during pregnancy or at delivery from July 1–30 September 2011. Indicators were compared between women recruited while pregnant and at delivery to understand possible differences between the sub-populations. Variables reported more than once between pregnancy and delivery were assessed to evaluate level of agreement (reliability). Clinical indicators from the literature were contrasted with study findings to determine how maternal reporting align with published prevalence (validity). Intra-class correlation and the kappa (κ) statistic were used to assess reliability while chi-squared, Fisher’s-exact or students-t were used to compare differences over time; p values ≤0.05 were considered statistically significant. Women recruited during pregnancy (n = 3970) were younger, less parous and possibly more socially disadvantaged than those recruited at delivery (n = 5803). Socio-demographic and selected clinical indicators showed good to moderate (0.421 < κ < 0.681) reporting consistency between pregnancy and delivery for previous C-section (κ = 0.681), pre-existing diabetes mellitus (κ = 0.616) and prior twin gestations (0.580). Most conditions however showed only fair agreement (0.21 < κ < 0.40) including previous gestational hypertension (κ = 0.387), asthma (κ = 0.365), premature rupture of membranes (κ = 0.324), eclampsia (κ = 0.257) and essential hypertension (κ = 0.213). Infectious conditions had poor reliability. Prevalence rates for most conditions, except sickle cell disease, were lower than the published literature. Complications and outcomes which were well defined for women were better reported than those requiring clinical judgment (e.g. prior C-section versus specific hypertensive disorders of pregnancy). NCDs with only episodic acute effects were not well reported, e.g. asthma, hypertension and sickle cell disease. Maternal reporting of pregnancy complications needs to be interpreted with caution.

P323 Adherence to treatment in cystic fibrosis: the reliability of self-reported data

P323 Adherence to treatment in cystic fibrosis: the reliability of self-reported data

Reliability of self-reported data on social media versus National Residency Match Program charting outcomes for dermatology applicants

To the Editor: Matching into dermatology is extremely competitive. In 2019, there were a total of 701 applicants for 447 postgraduate year 2 spots.1 Among US medical student seniors applying to dermatology, 257 applicants (36.6%) went unmatched. Social media has risen to the forefront of online resources residency applicants use to solicit advice, gauge the competitiveness of their application, and develop connections within the field. This potentially anonymous forum offers applicants a strong support network and a level of transparency in sharing opinions.

Influences on New Jersey public library budget requests

Purpose This research study aims to examine influences on the public library funding decision from the perspectives of New Jersey mayors and public library directors. Design/methodology/approach Content analysis was used to explore statements of 84 public library directors and 45 mayors about what was most/least effective in a recent library budget request. Findings Although they may differ on the relative importance of a specific concept, the public library directors and mayors in this study have high levels of agreement about what information is important in the budget decision process. Research limitations/implications The primary limitations of the findings of this study stem from the reliability of self-reported data and the low response rates. While the researcher believes that the findings and conclusions are valid for the survey respondents, it is less certain that they are valid for all public libraries in New Jersey, and it is not recommended that the conclusions be extended to public libraries outside of the state which differ in state mandates and other circumstances. Practical implications Understanding more about the factors that can influence library funding decisions provides insight into the very complex public library funding process and may help public library directors and mayors engage in mutually satisfactory budget negotiations. Originality/value This study contributes to the Library and Information Science research literature on library budgets by examining influences on the public library funding decision, specifically adding the perspectives of mayors and public library directors on a recent budget cycle.

Autism Spectrum Disorders and Self-reports: Testing Validity and Reliability Using the NEO-PI-R.

Although self-reported measures are frequently used to assess adults with autism spectrum disorders (ASD), the validity of self-reports is under-researched in ASD. The core symptoms of ASD may negatively affect the psychometric properties of self-reported measures. The aim of the present study was to test the validity and reliability of self-reported data using the NEO personality inventory-revised (NEO-PI-R). Forty-eight adults with ASD and 53 controls completed the NEO-PI-R and a psychiatric interview. Results indicate satisfactory internal consistency of the NEO-PI-R, a satisfactory factor structure, predicted correlations with clinician ratings in the ASD group, and predicted differences in personality between the ASD group and controls. In conclusion, the present results support the use of self-reported measures when assessing adults with ASD .

Reliability and validity of Axis I of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) with proposed revisions.

The research diagnostic criteria for temporomandibular disorders (RDC/TMD) have been employed internationally since 1992 for the study of temporomandibular muscle and joint disorders (TMD). This diagnostic protocol incorporates a dual system for assessment of TMD for Axis I physical diagnoses as well as Axis II psychological status and pain-related disability. Because the reliability and criterion validity of RDC/TMD had not yet been comprehensively characterised, the National Institute of Dental and Craniofacial Research funded in 2001 the most definitive research to date on the RDC/TMD as a U01 project entitled, 'Research Diagnostic Criteria: Reliability and Validity'. The results of this multi-site collaboration involving the University of Minnesota, the University of Washington, and the University at Buffalo were first reported at a pre-session workshop of the Toronto general session of the International Association of Dental Research on 2 July 2008. Summaries of five reports from this meeting are presented in this paper including: (i) reliability of RDC/TMD Axis I diagnoses based on clinical signs and symptoms; (ii) reliability of radiographic interpretations used for RDC/TMD Axis I diagnoses; (iii) reliability of self-report data used for RDC/TMD Axis I diagnoses; (iv) validity of RDC/TMD Axis I diagnoses based on clinical signs and symptoms; and (v) proposed revisions of the RDC/TMD Axis I diagnostic algorithms.

The Longitudinal Pattern of Alcohol-Related Injury in a College Population: Emergency Department Data Compared to Self-Reported Data

Background: Self-report survey is the most common method of obtaining information from college students on substance use and its consequences. However, the validity and reliability of self-report data, especially in relationship to harmful substance use, is frequently called into question. Objectives: To establish the convergent validity of self-reported alcohol-related injury data and data from a university-affiliated hospital Emergency Department (ED) across a seven year period. () To examine the trend lines for relative risk of alcohol-related injury. Methods: Two existing data sets at a major public university are compared: records of 1,253 ED admissions for alcohol-related reasons and 13,518 survey responses. Convergent validity is evaluated with the Pearson correlation coefficients of the two data sets for 2001/2002 through 2007/2008. Longitudinal trends for each data set are evaluated by change in relative risk. Results: Over the seven years, 51% of ED visits for alcohol-related reasons were due to injury, and 14% of survey respondents who drank alcohol reported alcohol-related injury. Both decreased significantly over the years: from 62% to 45% for ED reports and from 24% to 9% for self reports. ED visits for alcohol-related injury and self-reported alcohol-related injury are highly correlated: r = .67, 45% shared variance. Conclusions: The comparison establishes convergent validity for the self-report data and decreased rates of alcohol-related injury. Scientific Significance: These findings support the validity in college populations of self-report data about negative consequences associated with drinking alcohol.

Promoting Transparency in the NGO Sector: Examining the Availability and Reliability of Self-Reported Data

Summary Amid calls for NGOs to become more accountable, this work examines discrepancies between what NGOs say and do. Using a unique dataset of NGOs in Uganda it investigates the inaccuracies in reported financial transparency and community participation. We find that the threat of being caught reduces the likelihood of financial misrepresentation, while a desire to maintain a good reputation leads to misrepresentation of community consultation. Analysis provides indications that: NGOs with antagonistic relations with government may be more likely to hide information; and that unrealistic donor demands may be an obstacle to transparency. Findings caution against an overly naive view of NGOs and a reliance on self-reported information.

Alcohol and coffee drinking and smoking habit among subjects with HCV infection

The aims were to estimate among patients with hepatitis C virus (HCV) infection the prevalence of alcohol and coffee intake and smoking habit, the reliability of these self-reported data and the possible change of patients' habit after their first contact with a Viral Hepatitis Service. 229 patients were initially interviewed personally at the Viral Hepatitis Service and after 6 months they were re-interviewed by phone in regard to their alcohol, coffee drinking and smoking habits. Alcohol drinkers were 55.5% of males and 35.3% of females. Most subjects drank coffee daily, both men (90.0%) and women (84.9%). The proportion of current smokers was higher in males (43.6%) than females (26.9%). We found a fair to good reliability of self-reported data regarding patients' habits, alcohol and coffee intake, and number of cigarettes smoked daily. We observed a statistically significant decrease in alcohol and coffee intake and cigarettes smoked between baseline and follow-up interviews. We found a fairly high proportion of HCV-infected patients who regularly drink alcohol and coffee beverages and smoke cigarettes, especially among males. The reliability of self-reported data on these habits seems satisfactory. More decisive action to modify these habits, especially alcohol intake, is required in these patients.

RELIABILITY OF SELF-REPORTED ENVIRONMENTAL EXPOSURE DATA IN AN EPIDEMIOLOGICAL STUDY OF PARKINSONʼS DISEASE

Introduction There is substantial disagreement among published epidemiological studies regarding environmental risk factors for Parkinson's Disease (PD). Differences in the quality of measurement of environmental exposures contribute to this variation. To date, there has been only one published study of the reliability of self-reported environmental exposures and PD. That study was limited by a small sample size (n = 20), and did not include a population-based control group. The current study examined the test-retest reliability of self report data on risk factors for PD obtained from a series of 35 PD cases and 42 healthy controls with a new interviewer-delivered questionnaire and a previously-used self-administered questionnaire. A feature of the new questionnaire was the inclusion of “dummy” exposures unrelated to PD, that are generally perceived as being ‘toxic’, to check for consistent over-reporting of exposures by case subjects. Method Cases were recruited from neurology clinics. Controls were randomly selected from the Commonwealth Electroal Roll and matched to cases on sex, age and residential suburb. Exposure data were collected in face-to-face interviews with a new questionnaire. Repeat interviews were conducted with 32 of the cases and 29 of the controls, on average 3 months later. Self-administered questionnaires were completed by approximately half the respondents 6–24 months prior to the interview and the remainder 6–12 months after the interview was completed. Results In general, we found good reliability and external validity of our self-report data. For example, estimates of lifestyle-related exposures such as smoking and caffeine intake showed very good repeatability with kappa statistics of between 0.81 and 0.90. For continuous measures of these behaviours, intra-class correlation coefficients (ICC) were 0.99 for smoking pack-years, 0.86 and 0.84 for lifetime consumption of coffee and tea. A Bland-Altman Plot of pack-years confirmed good reliability with limits of agreement within 5 pack-years. In general, repeatability of environmental exposure data was moderate to high. For example, kappa statistics >0.85 were obtained for “Ever used Pesticides at Home”, “Ever Mixed Herbicides at Work”, “Ever Applied Herbicides at Work”, “Ever Mixed Insecticides at Work”, “Ever Sprayed with Pesticide on Skin” and “Worked with Solvents”. Similar results were obtained for ICCs calculated on continuous measures. For example, ICCs >0.85 were obtained for a number of exposures including “Number of days hobby gardened over lifetime”, “Number of times applied herbicides at work over lifetime”. Reporting of these exposures was similarly reliable for cases and controls. Risk estimates obtained for the “dummy” variable of “occupational exposure to electromagnetic radiation” suggested cases did not generally over-report on environmental exposures (OR 0.35, 95% CI 0.12–0.97). Further results to be presented include the comparison of exposure-PD associations obtained from the interviewer-delivered and self-administered questionnaires and risk estimates obtained for the exposures examined. Conclusion Self-reported details of lifestyle and environmental exposures are recalled with good-to-high reliability in individuals with or without PD. There is little suggestion that persons with PD overstate their exposures.

Variation in youthful risks of progression from alcohol and tobacco to marijuana and to hard drugs across generations.

Much research has documented that youthful substance use typically follows a sequence starting with use of alcohol or tobacco or both and potentially proceeding to marijuana and then hard drug use. This study explicitly examined the probabilities of progression through each stage and their covariates. A secondary analysis of data from the National Household Survey on Drug Abuse (1979-1997) was conducted with particular sensitivity to the nature of substance use progression, sampling procedures, and reliability of self-report data. Progression to marijuana and hard drug use was uncommon among persons born before World War II. The stages phenomenon essentially emerged with the baby boom and rose to a peak among persons born around 1960. Subsequently, progression risks at each stage declined. Progression risks were also higher among younger initiators of alcohol, tobacco, or marijuana use. The recent increase in youthful marijuana use has been offset by lower rates of progression to hard drug use among youths born in the 1970s. Dire predictions of future hard drug abuse by youths who came of age in the 1990s may be greatly overstated.

Educational Attainment in Survivors of ALL-Reply

<h3>In Reply.</h3> —The skewed age distribution is not due to an atypical sample or to poorer survival of younger children, but is due simply to the fact that ALL survival started to improve only during the 1970s. Thus, by 1989, when the interview was conducted, subjects treated at a young age were still not old enough to be eligible. Since we were interested in events of adulthood, we would have to wait another 10 years, until 1999, for the survival cohort to resemble an incidence cohort. With regard to the concern about the measures of scholastic achievement, we expect that the "rigor of academic programs" would be equally distributed across survivors and controls, especially because so many different schools are represented across many states in this study. We did not attempt to obtain verification of subjects' reported grades in school; in fact, the reliability of self-report data should be equally

Accuracy and reliability of self-reported data in interorganizational networks

Abstract Although network analysis is becoming a more viable and informative methodology for the study of interorganizational behavior, issues involving the accuracy and reliability of self-reported or ‘cognitive’ network data are still unresolved. Two networks based on information and coordination relationships in each of four major cities are examined. Reliability of responses is assessed as the percent of confirmed relationships between agency respondents and by correlating the extent of agreement in each network. In addition, two possible measurement errors are examined: systematic errors which are network-independent and idiosyncratic errors which are network-dependent. These errors are assessed through correlational analyses of the intensity of an organization's relationships with the number of its relationships that are confirmed in each network. Also systematic errors are accounted for by calculating the proportion of confirmed relationships within the different response categories used to judge the strength of relationship between ego organizations in the network. It is concluded that boundary spanning personnel of organizations can provide fairly reliable responses to network generated questions, but that errors in the data tend to be systematic in the way that prior studies of interpersonal cognitive networks report.

Feelings about Self and Body during Adolescent Pregnancy

The primary objective of this pilot study was to explore the stability of feelings about self and body during adolescent pregnancy. Fourteen pregnant adolescents kept personal diaries for six weeks concerning their perceptions of self and body. Diary entries revealed negative feelings toward self and body. However, negative feelings about body were slightly more stable than were negative feelings about self. Results indicate that practitioners should be sensitive to the pregnant adolescent's changing image of self and body. Additionally, researchers should consider the reliability of self-report data.

Inmate Self-Report Data: A Study of Reliability

The present study examines the reliability of self-report data inadvertently collected from 11 adult inmates in a study of a house arrest program. Data were collected with a self-administered questionnaire that was given twice within a four-month period. Correlations of 92 items, divided into categories of "Information," "Expectations," and "Affections," showed wide variation in reliability. Complete agreement on the two occasions was found for only 24 items, which were primarily in the "Information" category. Correlations across the 92 items were also computed for each subject, and these correlations also showed wide variation in reliability. Although no subject gave exactly the same responses on all 92 items, greater reliability was again found in the "Information" category. In addition, 3 of the subjects gave particularly unreliable responses. These results, together with the lack of existing literature on the topic, suggest a need to conduct more research on reliability of inmates in order to develop more reliable measures as well as to detect unreliable subjects.

Reliability of Self-Reported Data: A Reply

Reliability of Self-Reported Data: A Reply