Orthogonal-Moment-Based Attraction Measurement With Ocular Hints in Video-Watching Task

Abstract

Pupil dilation and eye movements are closely related to human emotional and cognitive processes. Visual stimulus, especially video clips, is widely used in computer-assisted experimental paradigms as emotional inducers. However, the level of attraction as a critical factor to such visual stimulus still needs comprehensive investigation. This article conducts a novel study of attraction assessment with pupil diameter and eye movements. We collected high temporal resolution ocular variation data from 50 subjects while they viewed a variety of emotional video stimuli. Besides, this article proposes two orthogonal-moment-based feature extraction methods for emotion classification, i.e., Legendre moment and Krawtchouk moment. The results of experiments show that our proposed feature sets achieve better classification performance compared with conventional time-or frequency-domain feature sets. The accuracy of predicting attraction level reached 87.4% and 91.0% when new features were used alone and combined with conventional features, respectively. Compared with the conventional features with an accuracy of 86.6%, our proposed features can improve the accuracy by 4.4%.This study conducts a ground investigation of quantitative attraction assessment for video clips, which might provide reference for paradigm design of affective computing research.