Automatic Chinese Food recognition based on a stacking fusion model.

Abstract

With commercialization of deep learning models, daily precision dietary record based on images from smartphones becomes possible. This study took advantage of Deep-learning techniques on visual recognition tasks and proposed a big-data-driven Deep-learning model regressing from food images. We established the largest data set of Chinese dishes to date, named CNFOOD-241. It contained more than 190,000 images with 241 categories, covering Staple food, meat, vegetarian diet, mixed meat and vegetables, soups, dessert category. This study also compares the prediction results of three popular deep learning models on this dataset, ResNeXt101_32x32d achieving up to 82.05% for top-1 accuracy and 97.13% for top-5 accuracy. Besides, this paper uses a multi-model fusion method based on stacking in the field of food recognition for the first time. We built a meta-learner after the base model to integrate the three base models of different architectures to improve robustness. The accuracy achieves 82.88% for top-1 accuracy.Clinical Relevance-This study proves that the application of artificial intelligence technology in the identification of Chinese dishes is feasible, which can play a positive role in people who need to control their diet, such as diabetes and obesity.