In-class Student Emotion and Engagement Detection System (iSEEDS): An AI-based Approach for Responsive Teaching

Abstract

The innate ability to recognize facial expressions and associated emotions is fundamental to human communication. Technology advancements have enabled computers to perform similar tasks to a considerable extent, opening versatile applications in diverse domains. In particular, Facial Emotion Recognition (FER) technology has recently been widely explored for investigating student engagement in classroom settings. While previous research studies mainly captivated the FER practice in engagement detection, far too little attention has been paid to the real-time emotional states of students during classroom interactions. In this regard, this paper introduces the In-Class Student Emotion and Engagement Detection System (iSEEDS), a novel AI-based approach for pinpointing learners' emotional states during classroom lectures. The iSEEDS employs Convo-lutional Neural Network (CNN) models for emotion detection and corresponding eye movement analysis. The system can help educators respond in real-time to students' emotional states and engagement levels. It can support responsive teaching by initiating remedial feedback in accordance with students' current emotions and engagement. A detailed literature review of existing emotion recognition models is presented as a background of iSEEDS development. Then the initial prototype model design and illustrative test results are discussed. Potential applications of iSEEDS and future research directions are also elaborated.