AI-ASSISTED emotion analysis during complementary feeding in infants aged 6–11 months

Abstract

This study aims to explore AI-assisted emotion assessment in infants aged 6–11 months during complementary feeding using OpenFace to analyze the Actions Units (AUs) within the Facial Action Coding system. When infants (n = 98) were exposed to a diverse range of food groups; meat, cow-milk, vegetable, grain, and dessert products, favorite, and disliked food, then video recordings were analyzed for emotional responses to these food groups, including surprise, sadness, happiness, fear, anger, and disgust. Time-averaged filtering was performed for the intensity of AUs. Facial expression to different food groups were compared with neutral states by Wilcoxon Singed test. The majority of the food groups did not significantly differ from the neutral emotional state. Infants exhibited high disgust responses to meat and anger reactions to yogurt compared to neutral. Emotional responses also varied between breastfed and non-breastfed infants. Breastfed infants showed heightened negative emotions, including fear, anger, and disgust, when exposed to certain food groups while non-breastfed infants displayed lower surprise and sadness reactions to their favorite foods and desserts. Further longitudinal research is needed to gain a comprehensive understanding of infants' emotional experiences and their associations with feeding behaviors and food acceptance.