Assessing reliability and validity of food safety culture assessment tools

Abstract

Since its recognition as a plausible direction to assure food safety, food safety culture research has evolved with several commercial and scientific assessment tools developed to evaluate the food safety culture in food businesses. However, existing research does not specify the validity and reliability checks required to demonstrate rigor in the tool development process and there is no unified methodology to confirm robustness of the tools to ensure trustworthiness and usefulness of findings and inferences generated. The purpose of the study was to develop a method to evaluate food safety culture assessment tools and to assess the reliability and validity of existing food safety culture assessment tools using the developed method. Eleven elements were found to be key in validating food safety culture assessment tools. Of the eight tools assessed, only one tool (CT2) was validated on each of the elements. The depth of validation strategies differed for each tool. Three out of the five commercial tools published peer reviewed publications that demonstrated the validation checks that were done. Face validation, and pilot testing were evident and appeared to be done the most. Whilst content, ecological, and cultural validity were the least validated for scientific tools, factor analysis and reliability checks were the least evaluated for commercial tools. None of the tools were assessed for postdictive validity, concurrent validity and the correlation coefficient relating to construct validity. Having an established science-based approach is key as it provides a way to determine the trustworthiness of established assessment tools against accepted methods.