From Textbook to Teacher: an Adaptive Intelligent Tutoring System Based on BCI.

Abstract

In this work, we propose FT3, an adaptive intelligent tutoring system based on Brain Computer Interface(BCI). It can automatically generate different difficulty levels of lecturing video with teachers from textbook adapting to student engagement measured by BCI. Most current studies employ animated images to create pedagogical agents in such adaptive learning environments. However, evidence suggests that human teacher video brings a better learning experience than animated images. We design a virtual teacher generation engine consisting of text-to-speech (TTS) and lip synthesis method, being able to generate high-quality adaptive lecturing clips of talking teachers with accurate lip sync merely based on a textbook and teacher's photo. We propose a BCI to measure engagement, serving as an indicator for adaptively generating appropriate lecturing videos. We conduct a preliminary study to build and evaluate FT3. Results verify that FT3 can generate synced lecturing videos, and provide proper levels of learning content with an accuracy of 73.33%.