Auditory-Visual Perception Analysis Of Multimodal Content Associated With Aggressive Behavior

Abstract

Introduction: Stable and dynamic parameters of speech production associated with aggressive behavior as well as the intensity of emotional background of multimodal communication are rarely investigated. The aim of the research is to characterize discrete discursive units associated with aggressive behavior and to contribute to the knowledge of auditory and visual perception on the basis of aggressive behavior in relation to different degrees of the emotional intensity of communication. Methods: perceptual-auditory and perceptual-visual analysis. Participants: 31 females aged 18-22. Stimuli: two discursive situations in Russian language, produced by males, taken out of the original database of multimodal content evaluated as aggressive behavior. The experiment was conducted in two sessions: 1) visual perception (facial expressions and body movements), 2) auditory perception (verbal and prosodic). Statistical reliability of the results obtained was measures using ANOVA. Findings: The majority of participants perceived the stimuli as aggressive behavior. They estimated emotional intensity of communication lower when perceived through the visual channel, than when perceived through the auditory channel. Nominations of emotions mentioned by recipients in perceptual-visual and perceptual-auditory sessions correlate with each other and relate to the complex of emotional states associated with aggressive behavior. The most stable parameters during auditory perception were voice pitch, voice intensity, speech tempo; during visual perception – movements of eyes and eyelids, eyebrows and forehead muscles, movements of arms.