Attentional synchrony in films: A window to visuospatial characterization of events

What is the relationship between film viewers’ eye movements and their film comprehension? Typical Hollywood movies induce strong attentional synchrony—most viewers look at the same things at the same time. Thus, we asked whether film viewers’ eye movements would differ based on their understanding—the mental model hypothesis—or whether any such differences would be overwhelmed by viewers’ attentional synchrony—the tyranny of film hypothesis. To investigate this question, we manipulated the presence/absence of prior film context and measured resulting differences in film comprehension and eye movements. Viewers watched a 12-second James Bond movie clip, ending just as a critical predictive inference should be drawn that Bond’s nemesis, “Jaws,” would fall from the sky onto a circus tent. The No-context condition saw only the 12-second clip, but the Context condition also saw the preceding 2.5 minutes of the movie before seeing the critical 12-second portion. Importantly, the Context condition viewers were more likely to draw the critical inference and were more likely to perceive coherence across the entire 6 shot sequence (as shown by event segmentation), indicating greater comprehension. Viewers’ eye movements showed strong attentional synchrony in both conditions as compared to a chance level baseline, but smaller differences between conditions. Specifically, the Context condition viewers showed slightly, but significantly, greater attentional synchrony and lower cognitive load (as shown by fixation probability) during the critical first circus tent shot. Thus, overall, the results were more consistent with the tyranny of film hypothesis than the mental model hypothesis. These results suggest the need for a theory that encompasses processes from the perception to the comprehension of film.

ABSTRACTEyetracking studies of traditional movies have shown that although viewers are free to look at any part of a film or television clip, the gaze behaviours of viewers predominantly cluster around predictable features. This phenomenon is called attentional synchrony. Virtual Reality (VR) hype promises viewers to choose their own viewpoint on scenes regardless of directorial intention. This article is the first scholarly work to examine attentional synchrony in the so-called Cinematic VR. The study uses a hybrid creative-practice research model to test the extent to which attentional synchrony is achieved in two VR productions. The videos present the same dramatic narrative from two optical and narrative viewpoints: a ‘first person’ point of view and a ‘third person’ perspective. After testing on audiences using VR headsets, the results of the research show that attentional synchrony was achieved in both productions. The result is slightly stronger in the first person point of view production, and the expected difficulty of the increased editing pace in the third person point of view did not result in substantially lower levels of attentional synchrony. The article discusses practical and theoretical considerations of editing 360-degree VR in order to synthesise industry heuristics with testable hypotheses.

Does viewing task influence gaze during dynamic scene viewing? Research into the factors influencing gaze allocation during free viewing of dynamic scenes has reported that the gaze of multiple viewers clusters around points of high motion (attentional synchrony), suggesting that gaze may be primarily under exogenous control. However, the influence of viewing task on gaze behavior in static scenes and during real-world interaction has been widely demonstrated. To dissociate exogenous from endogenous factors during dynamic scene viewing we tracked participants' eye movements while they (a) freely watched unedited videos of real-world scenes (free viewing) or (b) quickly identified where the video was filmed (spot-the-location). Static scenes were also presented as controls for scene dynamics. Free viewing of dynamic scenes showed greater attentional synchrony, longer fixations, and more gaze to people and areas of high flicker compared with static scenes. These differences were minimized by the viewing task. In comparison with the free viewing of dynamic scenes, during the spot-the-location task fixation durations were shorter, saccade amplitudes were longer, and gaze exhibited less attentional synchrony and was biased away from areas of flicker and people. These results suggest that the viewing task can have a significant influence on gaze during a dynamic scene but that endogenous control is slow to kick in as initial saccades default toward the screen center, areas of high motion and people before shifting to task-relevant features. This default-like viewing behavior returns after the viewing task is completed, confirming that gaze behavior is more predictable during free viewing of dynamic than static scenes but that this may be due to natural correlation between regions of interest (e.g., people) and motion.

When multiple viewers attend to the same static naturalistic scene there is a high degree of agreement in terms of the regions viewers attend to but no synchronization of when they attend there. By comparison, real-world scenes are rich with temporally-defined visual events such as motion which have the potential to involuntarily capture attention. Initial studies of attention during dynamic scenes have reported a high degree of spatiotemporal agreement, henceforth referred to as Attentional Synchrony. However, these dynamic scenes are composed with viewer attention in mind e.g. film and TV footage depicting a single subject tracked by a moving camera. Therefore, it is not currently known if attentional synchrony is caused by the presence of motion, scene content, or compositional factors.

To comprehend edited video, viewers must infer the meaning conveyed by successive video shots (i.e., continuous video segments separated by edit points, such as camera cuts). The central question here was whether comprehension-related top-down cognitive processes drive eye movements during sequential processing of video montage. Eye movements were recorded as 4 year olds and adults (n = 62) watched a video with the same constituent shots in either normal or random sequence. The key analyses compared eye movements to constituent shots when presented in normal order with those to the same shots presented in random order. The dependent variable was attentional synchrony or the extent to which viewers looked at the same location at the same time, indicating commonality of processing the video. This was calculated as the bivariate contour ellipse area within which points of gaze fell during each video frame. Results indicated that children were more scattered in their gaze locations than adults. Viewers became more similar to each other as normal vignettes unfolded over time; this was especially true in adults and possibly reflects a growing and shared understanding of the content. Conversely, adult attentional synchrony was reduced when watching random shot sequences. Thus, attentional synchrony during normal video viewing is driven not only by salient visual features, such as movement and areas of high contrast, but also, by the unfolding sequential comprehension of video montage, especially in adults. Differences between children and adults indicate that this top-down control of eye movements while watching video changes systematically over development.

In one of the first attempts to apply eye-tracking technology to the area of dubbing, this chapter reports on an experiment conducted in 2016 with viewers of the original English and dubbed Italian version of Wes Anderson’s The Grand Budapest Hotel. The study analysed the gaze behaviour of participants watching different scenes, focusing on variations in attentional synchrony and visual momentum. The results show less attentional synchrony and a higher visual momentum for the dubbing viewers. They also support the existence of the so-called dubbing effect, an unconscious eye movement strategy performed by dubbing viewers to avoid looking at mouths in dubbing, which prevails over the natural and idiosyncratic way in which they watch original films and real-life scenes.

Advances in head mounted displays (HMDs) have increased the interest in cinematic virtual reality as an art form. However, the freedom of a viewer in 360 video presents challenges in ensuring that audiences do not inadvertently miss important events and locations. We examined whether the high level of immersion provided by HMDs encourages participants to synchronize their attention during viewing. Sixty-four participants watched the 360° documentary Clouds Over Sidra (VRSE.works, 2015) using either an HMD or via a flat screen tablet display. We used intersubject correlation (ISC) analysis to measure attentional synchrony over the course of the video and to examine whether spatial and temporal factors led to different amounts of correlation both within and between groups. We found significantly greater ISC for the HMD compared to the tablet group. This effect was greatest for scenes with a unidirectional focus and at the start of scenes. We discuss our results in terms of the visual properties and the motor affordances of HMDs versus tablets. Our results show the value of HMDs in increasing attentional synchrony and may provide producers of 360° content insight in how to encourage or discourage synchronization of viewing direction. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Synchrony has been used to describe simple beat entrainment as well as correlated mental processes between people, leading some to question whether the term conflates distinct phenomena. Here we ask whether simple synchrony (beat entrainment) predicts more complex attentional synchrony, consistent with a common mechanism. While eye-tracked, participants listened to regularly spaced tones and indicated changes in volume. Across multiple sessions, we found a reliable individual difference: some people entrained their attention more than others, as reflected in beat-matched pupil dilations that predicted performance. In a second study, eye-tracked participants completed the beat task and then listened to a storyteller, who had been previously recorded while eye-tracked. An individual’s tendency to entrain to a beat predicted how strongly their pupils synchronized with those of the storyteller, a corollary of shared attention. The tendency to synchronize is a stable individual difference that predicts attentional synchrony across contexts and complexity.

We present a method for the spatio-temporal analysis of gaze data from multiple participants in the context of a video stimulus. For such data, an overview of the recorded patterns is important to identify common viewing behavior (such as attentional synchrony) and outliers. We adopt the approach of space-time cube visualization, which extends the spatial dimensions of the stimulus by time as the third dimension. Previous work mainly handled eye tracking data in the space-time cube as point cloud, providing no information about the stimulus context. This paper presents a novel visualization technique that combines gaze data, a dynamic stimulus, and optical flow with volume rendering to derive an overview of the data with contextual information. With specifically designed transfer functions, we emphasize different data aspects, making the visualization suitable for explorative analysis and for illustrative support of statistical findings alike.

Synchronous behaviors between individuals are nonverbal signs of closeness and common purpose. In the flow from initial attraction to intimate sexual interaction, attention and synchrony move from distal to proximal to interactive and are mediated by sensitized activation of neural systems for sexual motivation, arousal, and desire and those that recognize and mimic common facial and body movements between individuals. When reinforced by sexual pleasure and other relationship rewards, this results in the strengthening of attraction and bonding and the display of more common motor patterns. As relationships falter, nonverbal behaviors likely become asynchronous. To define behavioral, romantic, and sexual synchrony during phases of attraction and how their disruption can be observed and utilized by clinicians to assess individual relationship styles and quality. We review the literature on behavioral and attentional synchrony in humans and animals in an effort to understand experiential and innate mechanisms of synchrony and asynchrony and how they develop, as well as implications for attraction, relationship initiation, maintenance of romantic and sexual closeness, and relationship disintegration. Evidence is presented that behavioral synchrony and the neural mechanisms that underlie it are vital to relationship formation and satisfaction. Behavioral synchrony helps to create feelings of sexual and romantic synergy, cohesion, and arousal among individuals. Asynchrony is aversive and can spark feelings of discontent, aversion, and jealousy. Thus, observing patterns of nonverbal sexual and romantic synchrony between individuals offers insights into the potential quality of their relationships.

8 March (8M), now known as International Women’s Day, is a day for feminist claims where demonstrations are organized in over 150 countries, with the participation of millions of women all around the world. These demonstrations can be viewed as collective rituals and thus focus attention on the processes that facilitate different psychosocial effects. This work aims to explore the mechanisms (i.e., behavioral and attentional synchrony, perceived emotional synchrony, and positive and transcendent emotions) involved in participation in the demonstrations of 8 March 2020, collective and ritualized feminist actions, and their correlates associated with personal well-being (i.e., affective well-being and beliefs of personal growth) and collective well-being (i.e., social integration variables: situated identity, solidarity and fusion), collective efficacy and collective growth, and behavioral intention to support the fight for women’s rights. To this end, a cross-cultural study was conducted with the participation of 2,854 people (age 18–79; M = 30.55; SD = 11.66) from countries in Latin America (Mexico, Chile, Argentina, Brazil, Peru, Colombia, and Ecuador) and Europe (Spain and Portugal), with a retrospective correlational cross-sectional design and a convenience sample. Participants were divided between demonstration participants (n = 1,271; 94.0% female) and non-demonstrators or followers who monitored participants through the media and social networks (n = 1,583; 75.87% female). Compared with non-demonstrators and with males, female and non-binary gender respondents had greater scores in mechanisms and criterion variables. Further random-effects model meta-analyses revealed that the perceived emotional synchrony was consistently associated with more proximal mechanisms, as well as with criterion variables. Finally, sequential moderation analyses showed that proposed mechanisms successfully mediated the effects of participation on every criterion variable. These results indicate that participation in 8M marches and demonstrations can be analyzed through the literature on collective rituals. As such, collective participation implies positive outcomes both individually and collectively, which are further reinforced through key psychological mechanisms, in line with a Durkheimian approach to collective rituals.

During reading, eye-movements are closely related to comprehension, but the opposite has been shown in film viewing. Recent studies have shown that the high attentional synchrony found during film viewing may leave little room for comprehension based eye-movement differences. We therefore tested the following two competing hypotheses: 1) The Cognitive Task Hypothesis: high-level task processes guide eye-movements, versus 2) The Tyranny of Film Hypothesis: movies produce strong attentional synchrony regardless of higher-level processes. Previous experiments testing similar hypotheses showed that manipulations of viewer comprehension showed little effect on eye-movements, thus strongly supporting the tyranny of film hypothesis. To test whether the tyranny of film could be "turned-off," thus supporting the Cognitive Task hypothesis, participants were explicitly told their task was to draw a detailed map from memory of all locations depicted in a video, the 3-minute opening shot from "Touch of Evil" (Welles, 1958). In this clip a bomb is placed in a car at the beginning, and is shown until the bomb in the car is just about to explode. Map task viewers' eye-movements were compared to participants who watched the same clip while free viewing. To measure viewers' comprehension at the end of the clip, we asked them what would happen next, which showed the large expected task difference in terms of mentioning the bomb. The free-view group was much more likely to mention the bomb, indicating they were following the narrative, and are thus referred to as the Comprehension condition. For the eye-movement measures, compared to the Comprehension condition, the Map Task produced significantly longer saccades, different fixation patterns, and less looks at the car with the bomb. Thus, while comprehension differences produce only small effects in film viewers' eye-movements, a task implicitly at odds with comprehending the film narrative counteracts the tyranny of film. Meeting abstract presented at VSS 2016

In a sample of 711 ethnically diverse adolescents, the observed interpersonal dynamics of dyadic adolescent friendship interactions were coded to predict early adulthood tobacco, alcohol, and marijuana use. Deviant discussion content within the interactions was coded along with dyadic coregulation (i.e., interpersonal coordination, attention synchrony). Structural equation modeling revealed that, as expected, deviant content in adolescent interactions at age 16-17 years was strongly predictive of problematic use of tobacco, alcohol, and marijuana at ages 22 and 23. Although dyadic coregulation was not directly predictive of early adulthood substance use, it did moderate the impact of deviant talk within the dyad on future alcohol and marijuana use. For these substances, high levels of dyadic coregulation increased the risk associated with high levels of deviant talk for problematic use in early adulthood. Results held when comparing across genders and across ethnic groups. The results suggest that these interpersonal dynamics are associated with developmental trajectories of risk for or resilience to peer influence processes.

Recent advances in personalized displays now allow for the delivery of high-fidelity content only to the most sensitive regions of the visual field, a process referred to as foveation [Guenter et al. 2012]. Because foveated systems require accurate knowledge of gaze location, attentional synchrony is particularly relevant: this is observed when multiple viewers attend to the same image region concurrently.

The field of CSD relies on evidence-based practice or the notion that all therapy and evaluation procedures are determined by clinical opinion or reliable research. Several studies have been conducted on the efficacy of music therapy as a treatment method for children with autism; however, this method is not widely practiced by speech-language pathologists. This literature review outlines the results, strengths and weaknesses of 14 studies on the efficacy of music therapy for children with ASD. The studies were an average of 20 weeks, with 1-3 sessions per week ranging from 30-60 minutes. The sessions were all conducted by music therapists and included both individual and group sessions. The studies revealed music therapy leads to significant improvement for children with ASD in the following areas: joint attention, eye gaze, turn-taking, selective attention, expressive language, Social-emotional reciprocity, motor skills, and emotional synchrony. The paper also includes relevant background information on why music therapy works especially well for children with ASD, and suggestions for practical clinical implementation and future research. The overarching goal of this paper is to encourage SLPs to explore the research that exists outside of play-based therapy in order to ensure the best possible treatment and outcomes for children with ASD.