Intelligent system for assessing the harmfulness of food products based on the processing of textual and graphic information

Abstract

The paper substantiates the need to assess the harm of food for consumers with chronic diseases or allergies, which is important to prevent possible deterioration of the disease or eliminate acute allergic reactions of the human body to harmful ingredients present in the product. It is proved that currently there is no convenient intelligent system that could recognize the composition of products on the Ukrainian market, provide product characteristics and assess the harmfulness of the product. It is proposed to use food labels and packaging as primary sources of food information that is available to the consumer. It is shown that the printed information on the packages is presented in text-graphic form. The development of a mobile system as a software solution for the detection and analysis of textual and graphical information on the composition of products based on the use of artificial intelligence methods is proposed and substantiated. The block diagram of the intelligent mobile system for detection and analysis of food composition has been developed. The MSER algorithm is used to select text regions on the input image matrix in the presented algorithmic software. The solution to the problem of character recognition was based on the use of convolutional neural network MobileNet-V2, which is currently the best option in the classification of images by mobile applications that do not have a server part, and therefore large computing resources. Alignment of text on the image was carried out using the method of finding a rectangle with the smallest area Developed algorithms for grouping words. A decision support algorithm has been proposed to assess the harmfulness of products. The developed system allows personalized selection of food for each individual user, ie, the assessment of the composition of products is calculated taking into account the state of health of use, existing threats, diseases, restrictions or allergies