Perception Of Object Motion Research Articles

Evaluating Visual Perception of Object Motion in Dynamic Environments

Precisely understanding how objects move in 3D is essential for broad scenarios such as video editing, gaming, driving, and athletics. With screen-displayed computer graphics content, users only perceive limited cues to judge the object motion from the on-screen optical flow. Conventionally, visual perception is studied with stationary settings and singular objects. However, in practical applications, we---the observer---also move within complex scenes. Therefore, we must extract object motion from a combined optical flow displayed on screen, which can often lead to mis-estimations due to perceptual ambiguities. We measure and model observers' perceptual accuracy of object motions in dynamic 3D environments, a universal but under-investigated scenario in computer graphics applications. We design and employ a crowdsourcing-based psychophysical study, quantifying the relationships among patterns of scene dynamics and content, and the resulting perceptual judgments of object motion direction. The acquired psychophysical data underpins a model for generalized conditions. We then demonstrate the model's guidance ability to significantly enhance users' understanding of task object motion in gaming and animation design. With applications in measuring and compensating for object motion errors in video and rendering, we hope the research establishes a new frontier for understanding and mitigating perceptual errors caused by the gap between screen-displayed graphics and the physical world.

Aging and the visual perception of rigid and nonrigid motion

Nonrigid forms of motion are commonplace in everyday life. Given previously documented age-related deteriorations in various tasks involving motion (discriminating speed, identifying motion direction, etc.), an experiment was conducted to evaluate the potential effect of age upon the visual ability to detect rigid and nonrigid object motion. Thirty younger and older observers participated in the experiment (mean ages were 19.9 and 75.8 years, respectively). As has been done multiple times in the past, the individual motions of object vertices were manipulated to simulate either rigid motion (rotation in depth, with or without precession) or two different types of nonrigid motion (also rotation in depth with or without precession, but with added object deformation). In confirmation of previous research, there were large effects of nonrigid motion type and precession upon the ability to differentiate between rigid and nonrigid object motion. There was also a large effect of age, such that the discrimination performance of the younger observers was 49.6% higher than that exhibited by the older observers. In this first ever study of aging and nonrigid object motion perception, we thus find that aging is associated with a substantial impairment in the ability to visually perceive object nonrigidity.

Inverse relation between motion perception and postural responses induced by motion of a touched object

Self vs. external attribution of motions based on vestibular cues is suggested to underlie our coherent perception of object motion and self-motion. However, it remains unclear whether such attribution also underlies sensorimotor responses. Here, we examined this issue in the context of touch. We asked participants to lightly touch a moving object with their thumb while standing still on an unstable surface. We measured both the accuracy of judging the object motion direction and the postural response. If the attribution underlies both object-motion perception and posture control, sensitivity of posture to object motion should decrease with motion speed since high speed motion is unlikely to reflect self-motion. Furthermore, when motion perception is erroneous, there should be a corresponding increase in postural responses. Our results are consistent with these predictions and suggest that self-external attribution of somatosensory motion underlies both object motion perception and postural responses.

The accuracy of object motion perception during locomotion.

Human observers are capable of perceiving the motion of moving objects relative to the stationary world, even while undergoing self-motion. Perceiving world-relative object motion is complicated because the local optical motion of objects is influenced by both observer and object motion, and reflects object motion in observer coordinates. It has been proposed that observers recover world-relative object motion using global optic flow to factor out the influence of self-motion. However, object-motion judgments during simulated self-motion are biased, as if the visual system cannot completely compensate for the influence of self-motion. Recently, Xie et al. demonstrated that humans are capable of accurately judging world-relative object motion when self-motion is real, actively generated by walking, and accompanied by optic flow. However, the conditions used in that study differ from those found in the real world in that the moving object was a small dot with negligible optical expansion that moved at a fixed speed in retinal (rather than world) coordinates and was only visible for 500 ms. The present study investigated the accuracy of object motion perception under more ecologically valid conditions. Subjects judged the trajectory of an object that moved through a virtual environment viewed through a head-mounted display. Judgments exhibited bias in the case of simulated self-motion but were accurate when self-motion was real, actively generated, and accompanied by optic flow. The findings are largely consistent with the conclusions of Xie et al. and demonstrate that observers are capable of accurately perceiving world-relative object motion under ecologically valid conditions.

Perception of object motion during self-motion: Correlated biases in judgments of heading direction and object motion.

This study investigated the relationship between perceived heading direction and perceived motion of an independently moving object during self-motion. Using a dual task paradigm, we tested whether object motion judgments showed biases consistent with heading perception, both across conditions and from trial to trial. Subjects viewed simulated self-motion and estimated their heading direction (Experiment 1), or walked toward a target in virtual reality with conflicting physical and visual cues (Experiment 2). During self-motion, an independently moving object briefly appeared, with varied horizontal velocity, and observers judged whether the object was moving leftward or rightward. In Experiment 1, heading estimates showed an expected center bias, and object motion judgments showed corresponding biases. Trial-to-trial variations were also correlated: on trials with a more rightward heading bias, object motion judgments were consistent with a more rightward heading, and vice versa. In Experiment 2, we estimated the relative weighting of visual and physical cues in control of walking and object motion judgments. Both were strongly influenced by nonvisual cues, with less weighting for object motion (86% vs. 63%). There were also trial-to-trial correlations between biases in walking direction and object motion judgments. The results provide evidence that shared mechanisms contribute to heading perception and perception of object motion.

Impaired Ocular Tracking and Cortical Atrophy in Idiopathic Rapid Eye Movement Sleep Behavior Disorder.

Idiopathic rapid eye movement sleep behavior disorder (iRBD) is a prodromal stage of synucleinopathies. Patients with synucleinopathies frequently display eye movement abnormalities. However, whether patients with iRBD have eye movement abnormalities remains unknown. The aim of this study was to assess eye movement abnormalities and related gray matter alterations and explore whether such abnormalities can serve as biomarkers to indicate phenoconversion to synucleinopathies in iRBD. Forty patients with iRBD with early disease progression and 35 healthy control subjects participated in a 15-minute ocular-tracking task that evaluated their control of eye movement abilities. They also underwent clinical assessments for olfactory function, nonmotor symptoms, and autonomic symptoms, all of which are biomarkers to predict phenoconversion to synucleinopathies in iRBD. A subgroup of the participants (20 patients with iRBD and 20 healthy control subjects) also participated in structural magnetic resonance imaging. The ocular-tracking ability in patients with iRBD was inferior to that of healthy control subjects in two aspects: pursuit initiation and steady-state tracking. Cortical thinning in the right visual area V4 in patients with iRBD is coupled with impaired pursuit initiation. Furthermore, prolonged pursuit initiation in patients with iRBD exhibits a trend of correlation with olfactory loss, the earliest biomarker that develops prior to other prodromal biomarkers. We found ocular-tracking abnormalities in patients with iRBD even early in their disease progression that have not been reported before. These abnormalities are coupled with atrophy of brain areas involved in the perception of object motion and might indicate phenoconversion to synucleinopathies in iRBD. © 2022 International Parkinson and Movement Disorder Society.

Vision-based speedometer regulates human walking

SummaryCan we recover self-motion from vision? This basic issue remains unsolved since, while the human visual system is known to estimate the direction of self-motion from optic flow, it remains unclear whether it also estimates the speed. Importantly, the latter requires disentangling self-motion speed and depths of objects in the scene as retinal velocity depends on both. Here we show that our automatic regulator of walking speed based on vision, which estimates and maintains the speed to its preferred range by adjusting stride length, is robust to changes in the depths. The robustness was not explained by temporal-frequency-based speed coding previously suggested to underlie depth-invariant object-motion perception. Meanwhile, it broke down, not only when the interocular distance was virtually manipulated but also when monocular depth cues were deceptive. These observations suggest that our visuomotor system embeds a speedometer that calculates self-motion speed from vision by integrating monocular/binocular depth and motion cues.

Effects of stereopsis on vection, presence and cybersickness in head-mounted display (HMD) virtual reality

Stereopsis provides critical information for the spatial visual perception of object form and motion. We used virtual reality as a tool to understand the role of global stereopsis in the visual perception of self-motion and spatial presence using virtual environments experienced through head-mounted displays (HMDs). Participants viewed radially expanding optic flow simulating different speeds of self-motion in depth, which generated the illusion of self-motion in depth (i.e., linear vection). Displays were viewed with the head either stationary (passive radial flow) or laterally swaying to the beat of a metronome (active conditions). Multisensory conflict was imposed in active conditions by presenting displays that either: (i) compensated for head movement (active compensation condition), or (ii) presented pure radial flow with no compensation during head movement (active no compensation condition). In Experiment 1, impairing stereopsis by anisometropic suppression in healthy participants generated declines in reported vection strength, spatial presence and severity of cybersickness. In Experiment 2, vection and presence ratings were compared between participants with and without clinically-defined global stereopsis. Participants without global stereopsis generated impaired vection and presence similarly to those found in Experiment 1 by subjects with induced stereopsis impairment. We find that reducing global stereopsis can have benefits of reducing cybersickness, but has adverse effects on aspects of self-motion perception in HMD VR.

Roles of visual and non-visual information in the perception of scene-relative object motion during walking.

Perceiving object motion during self-movement is an essential ability of humans. Previous studies have reported that the visual system can use both visual information (such as optic flow) and non-visual information (such as vestibular, somatosensory, and proprioceptive information) to identify and globally subtract the retinal motion component due to self-movement to recover scene-relative object motion. In this study, we used a motion-nulling method to directly measure and quantify the contribution of visual and non-visual information to the perception of scene-relative object motion during walking. We found that about 50% of the retinal motion component of the probe due to translational self-movement was removed with non-visual information alone and about 80% with visual information alone. With combined visual and non-visual information, the self-movement component was removed almost completely. Although non-visual information played an important role in the removal of self-movement-induced retinal motion, it was associated with decreased precision of probe motion estimates. We conclude that neither non-visual nor visual information alone is sufficient for the accurate perception of scene-relative object motion during walking, which instead requires the integration of both sources of information.

The role of the ventral intraparietal area (VIP/pVIP) in the perception of object-motion and self-motion

Retinal image motion is a composite signal that contains information about two behaviourally significant factors: self-motion and the movement of environmental objects. It is thought that the brain separates the two relevant signals, and although multiple brain regions have been identified that respond selectively to the composite optic flow signal, which brain region(s) perform the parsing process remains unknown. Here, we present original evidence that the putative human ventral intraparietal area (pVIP), a region known to receive optic flow signals as well as independent self-motion signals from other sensory modalities, plays a critical role in the parsing process and acts to isolate object-motion. We localised pVIP using its multisensory response profile, and then tested its relative responses to simulated object-motion and self-motion stimuli; results indicated that responses were much stronger in pVIP to stimuli that specified object-motion. We report two further observations that will be significant for the future direction of research in this area; firstly, activation in pVIP was suppressed by distant stationary objects compared to the absence of objects or closer objects. Secondly, we describe several other brain regions that share with pVIP selectivity for visual object-motion over visual self-motion as well as a multisensory response.

Perception of haptic motion is enhanced during conditions of increased postural stability

BackgroundCoupling between postural sway and fingertip displacement has been observed in individuals lightly touching a moving surface. This can be attributed to the central nervous system (CNS) misinterpreting surface motion as self-motion, evoking a compensatory sway response. Research questionDoes baseline postural state influence the correct perception of haptic object motion? MethodsMotion perception detection thresholds of index finger displacement at 1 mm s−1 velocity during light touch were determined for three postural conditions: standing with eyes open (EO) and closed (EC), and sitting with eyes closed. For the standing condition with eyes shut, displacement thresholds were measured using three velocities (1, 2 and 4 mm s−1). ResultsPostural condition had a large influence on motion perception, with a reduction in displacement threshold from 12 → 6 → 2 mm during the transition from standing EC → standing EO → sitting EC. A systematic decrease in displacement perception threshold was observed with increasing velocity. This tends to suggest that the increase of the touched object velocity may help overcoming the misinterpretation. SignificanceThese results suggest that the ability to disambiguate self motion from haptic motion is enhanced during stable postures, and when stimulus velocity is high. Our findings may help to understand the mechanisms underlying the coupling between surface movements and postural sway, reported in the literature.

Anatomy and white matter connections of the lateral occipital cortex.

White matter tracts link different regions of the brain, and the known functions of those interconnected regions may offer clues about the roles that white matter tracts play in information relay. The authors of this report discuss the structure and function of the lateral occipital lobe and how the lateral occipital lobe communicates with other regions via white matter tracts. The authors used generalized q-sampling imaging and cadaveric brain dissections to uncover the subcortical white matter connections of the lateral occipital lobe. The authors created GQI of ten healthy controls and dissected ten cadaveric brains. The middle longitudinal fasciculus, vertical occipital fasciculus, inferior fronto-occipital fasciculus, inferior longitudinal fasciculus, optic radiations, and a diverse array of U-shaped fibers connect the lateral occipital lobe to itself, parts of the temporal, parietal, and medial occipital cortices. The complex functional processes attributed to the lateral occipital lobe, including object recognition, facial recognition, and motion perception are likely related to the subcortical white matter tracts described within this study. There was good concordance between the white matter tracts generated using GQI and the white matter tracts that were found after dissection of the cadaveric brains. This article presents the anatomic connections of the lateral occipital lobe and discusses the associated functions.

A model of how depth facilitates scene-relative object motion perception.

Many everyday interactions with moving objects benefit from an accurate perception of their movement. Self-motion, however, complicates object motion perception because it generates a global pattern of motion on the observer’s retina and radically influences an object’s retinal motion. There is strong evidence that the brain compensates by suppressing the retinal motion due to self-motion, however, this requires estimates of depth relative to the object—otherwise the appropriate self-motion component to remove cannot be determined. The underlying neural mechanisms are unknown, but neurons in brain areas MT and MST may contribute given their sensitivity to motion parallax and depth through joint direction, speed, and disparity tuning. We developed a neural model to investigate whether cells in areas MT and MST with well-established neurophysiological properties can account for human object motion judgments during self-motion. We tested the model by comparing simulated object motion signals to human object motion judgments in environments with monocular, binocular, and ambiguous depth. Our simulations show how precise depth information, such as that from binocular disparity, may improve estimates of the retinal motion pattern due the self-motion through increased selectivity among units that respond to the global self-motion pattern. The enhanced self-motion estimates emerged from recurrent feedback connections in MST and allowed the model to better suppress the appropriate direction, speed, and disparity signals from the object’s retinal motion, improving the accuracy of the object’s movement direction represented by motion signals.

Computational Mechanisms for Perceptual Stability using Disparity and Motion Parallax.

Walking and other forms of self-motion create global motion patterns across our eyes. With the resulting stream of visual signals, how do we perceive ourselves as moving through a stable world? Although the neural mechanisms are largely unknown, human studies (Warren and Rushton, 2009) provide strong evidence that the visual system is capable of parsing the global motion into two components: one due to self-motion and the other due to independently moving objects. In the present study, we use computational modeling to investigate potential neural mechanisms for stabilizing visual perception during self-motion that build on neurophysiology of the middle temporal (MT) and medial superior temporal (MST) areas. One such mechanism leverages direction, speed, and disparity tuning of cells in dorsal MST (MSTd) to estimate the combined motion parallax and disparity signals attributed to the observer's self-motion. Feedback from the most active MSTd cell subpopulations suppresses motion signals in MT that locally match the preference of the MSTd cell in both parallax and disparity. This mechanism combined with local surround inhibition in MT allows the model to estimate self-motion while maintaining a sparse motion representation that is compatible with perceptual stability. A key consequence is that after signals compatible with the observer's self-motion are suppressed, the direction of independently moving objects is represented in a world-relative rather than observer-relative reference frame. Our analysis explicates how temporal dynamics and joint motion parallax-disparity tuning resolve the world-relative motion of moving objects and establish perceptual stability. Together, these mechanisms capture findings on the perception of object motion during self-motion.SIGNIFICANCE STATEMENT The image integrated by our eyes as we move through our environment undergoes constant flux as trees, buildings, and other surroundings stream by us. If our view can change so radically from one moment to the next, how do we perceive a stable world? Although progress has been made in understanding how this works, little is known about the underlying brain mechanisms. We propose a computational solution whereby multiple brain areas communicate to suppress the motion attributed to our movement relative to the stationary world, which is often responsible for a large proportion of the flux across the visual field. We simulated the proposed neural mechanisms and tested model estimates using data from human perceptual studies.

Effects of the gravity direction in the environment and the visual polarity and body direction on the perception of object motion

To process the motion of objects, humans need to consider information about up-down direction as obtained through various cues such as the gravity direction in the environment, visual polarity, and body direction. This study investigates the effects of up-down direction, as obtained from these cues on motion perception, with a focus on acceleration perception. We presented the participants with moving objects that had various acceleration speeds and measured the physical acceleration to be perceived as constant velocity. We examined the effect of the up-down direction from the visual polarity by changing the relationship between the up-down direction indicated by the gravity direction cue and the up-down direction indicated by visual polarity by manipulating the posture of the observer. The results showed that the up-down direction received by the gravity affected motion perception. Moreover, the up-down direction indicated by the visual polarity affected motion perception when the observer’s body direction and the physical gravity direction were different. On the other hand, up-down direction indicated by the visual polarity did not affect motion perception when the body direction coincides with physical gravity direction. Overall, the results suggest that the up-down directions indicated by the gravity, visual polarity, and body direction are integrated non-linearly in the perceived acceleration of visual motion.

An integrated neural model of robust self-motion and object motion perception in visually realistic environments

An integrated neural model of robust self-motion and object motion perception in visually realistic environments

Temporal dynamics of heading perception and identification of scene-relative object motion from optic flow

Temporal dynamics of heading perception and identification of scene-relative object motion from optic flow

Assessment tool for visual perception deficits in cerebral visual impairment: development and normative data of typically developing children.

To develop an assessment tool that measures a wide range of visual perceptual deficits common in cerebral visual impairment (CVI) and to provide normative data from typically developing children between 3 and 6years of age. Test development reflected cross-talk between vision research and clinical relevance for CVI. The Children's Visual Impairment Test for 3- to 6-year-olds (CVIT 3-6) includes 14 subtests covering four domains of visual perception: Object Recognition, Degraded Object Recognition, Motion Perception, and Global-Local Processing. Normative data were collected from 301 typically developing children (mean age 4y 8mo [SD 9.7mo]; 148 females, 153 males). A questionnaire was administered to parents about pregnancy duration, birth, and developmental problems. Average total CVIT 3-6 performance was 60.1 (SD 5.5) out of 70. The cut-off score for normal visual perception (53) was set at the 10th centile of scores in typically developing children. Multiple regression indicated CVIT 3-6 visual perception scores increase with age for children born at 36weeks' gestational age or later (β=-18.03, 95% confidence interval -31.31 to -4.75). CVIT 3-6 is a tool to assess a wide range of visual perceptual deficits common in CVI. Age-dependent normative data are available because we found performance increased with age. A test for visual perceptual deficits common in cerebral visual impairment. Visual perceptual functions improve with age in full-term typically developing children.

Causal inference accounts for heading perception in the presence of object motion

The brain infers our spatial orientation and properties of the world from ambiguous and noisy sensory cues. Judging self-motion (heading) in the presence of independently moving objects poses a challenging inference problem because the image motion of an object could be attributed to movement of the object, self-motion, or some combination of the two. We test whether perception of heading and object motion follows predictions of a normative causal inference framework. In a dual-report task, subjects indicated whether an object appeared stationary or moving in the virtual world, while simultaneously judging their heading. Consistent with causal inference predictions, the proportion of object stationarity reports, as well as the accuracy and precision of heading judgments, depended on the speed of object motion. Critically, biases in perceived heading declined when the object was perceived to be moving in the world. Our findings suggest that the brain interprets object motion and self-motion using a causal inference framework.

Perception of Object Movement in Virtual Reality

Perception of Object Movement in Virtual Reality