An Evaluation of Inter-coder and Intra-coder Reliability for 24-Hour Dietary Recall Data Entered in WebNEERS

Abstract

ObjectiveTo evaluate inter-coder (between-coder) and intra-coder (within-coder) reliability among trained data coders who enter 24-hour dietary recall data collected through Expanded Food and Nutrition Education Program operations in the state of Georgia. DesignThis study employed multiple cross-sectional evaluations of inter-coder reliability and a short-term longitudinal evaluation of intra-coder reliability. Participants/SettingStudy participants consisted of trained data coders (n = 9) who were employed during the 12-month period of evaluation. Main Outcome MeasuresPrimary outcome measures were inter-coder and intra-coder reliability across data entered into the Web-based Nutrition Education Evaluation and Reporting System. Statistical analyses were conducted using IBM SPSS 24. Descriptive statistics were generated and inter-coder and intra-coder reliability were assessed using 2-way mixed intraclass correlation coefficients. ResultsResults of this evaluation indicated good to excellent inter-coder reliability among all coders, and excellent intra-coder reliability among the majority of coders. However, some notable inconsistencies were identified within the intra-coder reliability analyses. ConclusionsFuture strategies to improve data quality within Expanded Food and Nutrition Education Program operations might include enhanced training for data coders, implementation of error detection protocols, expansion of the Web-based Nutrition Education Evaluation and Reporting System database, and exploration of automated, computer-assisted administration of 24-hour dietary recalls.