Using a Novel Motion Index to Study the Neural Basis of Event Segmentation

Abstract

Our understanding of the perceived actions of those around us includes an ability to segment this continuous stream of activity into discrete events. We studied naive observers' abilities to segment a video of an unfamiliar dance style into events using a combination of behavioural, computational vision and brain imaging methods. A 386 s video of a solo Bharatanatyam dancer was used as the basis for the study. A computational analysis provided us with, for every video frame, a Motion Index (MI) quantifying the movement of the entire dancer. A behavioural analysis using 30 naive observers provided us with the time points where observers were most likely to place an event boundary. These behavioural and computational data were used to interpret the brain activity of another 11 participants who viewed the dance video while in an MRI scanner. Results showed that the Motion Index predicted brain activity in a single cluster in the right hemisphere that was located close to the Extrastriate Body Area (EBA). Eve...