Attention In 3D Space Research Articles

I Understand You: Blind 3D Human Attention Inference From the Perspective of Third-Person

Inferring object-wise human attention in 3D space from the third-person perspective (e.g., a camera) is crucial to many visual tasks and applications, including human-robot collaboration, unmanned vehicle driving, etc. Challenges arise from classical human attention when human eyes are not visible to cameras, gaze point is outside the field of vision, or the gazed object is occluded by others in the 3D space. In this case, blind 3D human attention inference brings a new paradigm to the community. In this paper, we address these challenges by proposing a scene-behavior associated mechanism, in which both 3D scene and temporal behavior of human are adopted to infer object-wise human attention and its transition. Specifically, point cloud is reconstructed and used for the spatial representation of 3D scene, which is beneficial to handle the blind problem from the perspective of a camera. Based on this, in order to address the blind human attention inference without eye information, we propose a Sequential Skeleton Based Attention Network (S2BAN) for behavior-based attention modeling. As is embedded in the scene-behavior associated mechanism, the proposed S2BAN is built under the temporal architecture of Long-Short-Term-Memory (LSTM). Our network employs human skeleton as behavior representation, and maps it to the attention direction frame by frame, which makes attention inference a temporal-correlated issue. With the help of S2BAN, 3D gaze spot and further the attended objects can be obtained frame by frame via intersection and segmentation on the previously reconstructed point cloud. Finally, we conduct experiments from various aspects to verify the object-wise attention localization accuracy, the angular error of attention direction calculation, as well as the subjective results. The experimental results show that the proposed outperforms other competitors.

Allocation of attention in 3D space is adaptively modulated by relative position of target and distractor stimuli.

Allocation of attention across different depth planes is a prerequisite for visual selection in a three-dimensional environment. Previous research showed that participants successfully used stereoscopic depth information to focus their attention. This, however, does not mean that salient information from other depth planes is completely neglected. The present study investigated the question of whether competing visual information is differentially processed when displayed in a single depth plane or across two different depth planes. Moreover, it was of interest whether potential effects were further modulated by the items' relative spatial position (near or far). In three experiments participants performed a variant of the additional singleton paradigm. Targets were defined by stereoscopic depth information and as such appeared either in a near or far depth plane. Distractor stimuli were displayed in the same or in the opposed depth plane. The results consistently showed that visual selection was slower when target and distractor coincided within the same depth plane. There was no general advantage for targets presented in near or far depth planes. However, differential effects of target depth plane and the target-distractor relation were observed. Selection of near targets was more affected by distractors within the same depth plane while far targets were identified more slowly when the amount of information in closer depth planes increased. While attentional resources could not be exclusively centered to a distinct depth plane, the allocation of attention might be organized along an egocentric gradient through space and varies with the organization of the visual surrounding.

Effect of bright and dark environments on allocation of attention in 3D space

Effect of bright and dark environments on allocation of attention in 3D space

Visual search is influenced by 3D spatial layout.

Many activities necessitate the deployment of attention to specific distances and directions in our three-dimensional (3D) environment. However, most research on how attention is deployed is conducted with two dimensional (2D) computer displays, leaving a large gap in our understanding about the deployment of attention in 3D space. We report how each of four parameters of 3D visual space influence visual search: 3D display volume, distance in depth, number of depth planes, and relative target position in depth. Using a search task, we find that visual search performance depends on 3D volume, relative target position in depth, and number of depth planes. Our results demonstrate an asymmetrical preference for targets in the front of a display unique to 3D search and show that arranging items into more depth planes reduces search efficiency. Consistent with research using 2D displays, we found slower response times to find targets in displays with larger 3D volumes compared with smaller 3D volumes. Finally, in contrast to the importance of target depth relative to other distractors, target depth relative to the fixation point did not affect response times or search efficiency.

Visual search is influenced by 3D spatial layout

Many activities necessitate the deployment of attention to specific distances and directions in our three-dimensional (3D) environment. However, most research on how attention is deployed is conducted with two dimensional (2D) computer displays, leaving a large gap in our understanding about the deployment of attention in 3D space. We report how each of four parameters of 3D visual space influence visual search: 3D display volume, distance in depth, number of depth planes, and relative target position in depth. Using a search task, we find that visual search performance depends on 3D volume, relative target position in depth, and number of depth planes. Our results demonstrate an asymmetrical preference for targets in the front of a display unique to 3D search and show that arranging items into more depth planes reduces search efficiency. Consistent with research using 2D displays, we found slower response times to find targets in displays with larger 3D volumes compared with smaller 3D volumes. Finally, in contrast to the importance of target depth relative to other distractors, target depth relative to the fixation point did not affect response times or search efficiency.

Measurement on Reaction Time of Visual Attention in Depth during Driving

This research aimed to reveal characteristics of visual attention of low-vision drivers. Near and far stimuli were used by means of a three-dimensional (3D) attention measurement system that simulated traffic environment. We measured the reaction time of subjects while attention shifted in three kinds of imitational peripheral environment illuminance (daylight, twilight and dawn conditions). Subjects were required to judge whether the target presented nearer than fixation point or further than it. The results showed that the peripheral environment illuminance had evident influence on the reaction time of drivers, the reaction time was slow in dawn and twilight conditions than in daylight condition, distribution of attention had the advantage in nearer space than farther space, that is, and the shifts of attention in 3D space had an anisotropy characteristic in depth. The results suggested that (1) visual attention might be operated with both precueing paradigm and stimulus controls included the depth information, (2) an anisotropy characteristic of attention shifting depend on the attention moved distance, and it showed remarkably in dawn condition than in daylight and twilight conditions.

Age related differences in the spatial extent of attention in 3D space

Age related differences in the spatial extent of attention in 3D space

Visional Attentional Allocation of Top-down and Bottom-up Cues in Three-Dimensional Space

The aim of the present experiment was to investigate visual attentional allocation of top-down and bottom-up cues in three-dimensional (3D) space. Near and far stimuli were used by a 3D attention measurement apparatus. Two experiments were conducted in order to examine top-down and bottom-up controls of visual attention. In the experiment 1, the cue about the location of a target by means of location information. In the experiment 2, color cue by brief change of color at target locations was presented. Observers were required to judge whether the target presented nearer than fixation point or further than it. The results in experiment 1 and experiment 2 show that both location and color cue have the effect on reaction time, and that shift of attention were faster from far to near than the reverse. These findings suggest that (1) attention in 3D space might be operated with both location and color controls included the depth information, (2) the shift of visual attention in 3D space has an asymmetric characteristic in depth.

Effects of self-motion on attention in real 3D space

Human behavioral space is three-dimensional (3D), and when moving through 3D space individuals selectively allocate their attention to acquire necessary information. This study aimed to examine the characteristics of attention in real 3D space when observers were moving forward. In static and self-motion situations, relative and absolute cues were used. Results indicated that internal representation for allocation of attention in 3D space is in depth-aware mode whether in static or moving condition. Moreover, near superior asymmetrical switching of attention is more strongly manifested under moving than under static conditions. Our findings indicate that focusing of attention by relative and absolute cues is maintained in self-motion, and that allocation of attention during movement is more viewer-centered than when observers are static.

Attending to a location in three-dimensional space modulates early ERPs

It has been reported that attending to a particular location can modulate incoming sensory signals, as reflected by the stimulus-evoked P1 and N1 components of the visual event-related potential (ERPs) in a two-dimensional (2D) display [Attention, Space, and Action: Studies in Cognitive Neuroscience, Oxford University Press, New York, 1999, p. 31]. In contrast, in this study we examined the effect of attention in 3D space using a stereoscopic display. Stimuli were presented randomly, one at a time, in an orthogonal combination of two depths (near, far) and two 2D locations (left, right) relative to the fixation point. The task was to attend selectively to one of these four positions and to respond to a target stimulus defined by shape in the attended 3D location. The effect of 2D location selection on the P1 amplitude was greater for stimuli in the near than the far depth plane, and the amplitude of N1 increased in response to stimuli in the attended combination of 2D location and depth. These results suggest that the effect of early spatial selection on the visual ERP is not simply based on retinotopic organization of the visual field, but also on intermediate stages that construct a 3D spatial representation of the external world.

Object and space-based attentional selection in three-dimensional space

It has been previously demonstrated that visual attention has an extent in depth (3D space) as well as an extent in the fronto-parallel plane (2D space). Numerous experiments have also demonstrated that attention can be allocated to objects, and that “object-based” attention can overcome some of the costs associated with moving attention about in 2D space. In real visual environments, objects often have an extent in depth. Four experiments were conducted to examine the nature of object-based attention in 3D space. The experiments demonstrated large object-based attention benefits, as well as costs for switching attention in depth. However, the costs associated with switching attention in depth were eliminated with objects that had an extent in depth. Experiments 2-4 examined the interaction of spatial attention in 3D space and object-based attention. Evidence was found for the spread of spatial attention to objects. However, contrary to other work (Lavie & Driver, 1996), neither non-predictive exogenous spatial cues (Experiment 2) nor predictive exogenous spatial cues (Experiments 3 and 4) were able to eliminate object-based attention, suggesting that object-based attention can remain intact despite the allocation of attention spatially.