Vergence-accommodation Conflict Research Articles

Kinematic Properties of Haptic-Free Reach-to-Grasp Movements in Virtual Reality: A Comparison with Natural Prehension in Real Spaces and Pantomimed Ones

Many researchers are interested in how the kinematics of reach-to-grasp movements in virtual reality (VR), which involve the vergence–accommodation conflict, differ from real space. The present study, conducted in VR, verified the effect of a discrepancy between visual and haptic target size and found that terminal haptic feedback is weighted more heavily than visual information, as is the case in real space. Furthermore, we investigated how the presence or absence of terminal haptic feedback modulates performance in VR by comparing prehension with or without terminal haptic feedback in VR, closed-loop natural grasping in real space, and pantomimed prehension with the eyes closed. Our results suggested that the contribution of a visual image to grip aperture adjustment is quite marginal in situations where terminal haptic feedback is unavailable, and that the performance in VR without haptic feedback is highly correlated with performances driven by fully internal representations (i.e., pantomimed movements).

Improving Depth Perception in Immersive Media Devices by Addressing Vergence-Accommodation Conflict.

Recently, immersive media devices have seen a boost in popularity. However, many problems still remain. Depth perception is a crucial part of how humans behave and interact with their environment. Convergence and accommodation are two physiological mechanisms that provide important depth cues. However, when humans are immersed in virtual environments, they experience a mismatch between these cues. This mismatch causes users to feel discomfort while also hindering their ability to fully perceive object distances. To address the conflict, we have developed a technique that encompasses inverse blurring into immersive media devices. For the inverse blurring, we utilize the classical Wiener deconvolution approach by proposing a novel technique that is applied without the need for an eye-tracker and implemented in a commercial immersive media device. The technique's ability to compensate for the vergence-accommodation conflict was verified through two user studies aimed at reaching and spatial awareness, respectively. The two studies yielded a statistically significant 36% and 48% error reduction in user performance to estimate distances, respectively. Overall, the work done demonstrates how visual stimuli can be modified to allow users to achieve a more natural perception and interaction with the virtual environment.

Eyebox extension for holographic Maxwellian near-eye display by using a real grating and a virtual grating

The Maxwellian display presents always-focused images to the viewer, alleviating the vergence-accommodation conflict (VAC) in near-eye displays (NEDs). However, the limited eyebox of the conventional Maxwellian display prevents it from wider applications. In this paper, an exebox-extended holographic Maxwellian near-eye display is proposed by using a real grating and a virtual grating. A diffraction grating is used to duplicate multiple beams and produce duplicate viewpoints. A virtual grating phase is added in the hologram to steer the beams and deflect the viewpoints. The proposed method combines a slight steering with a large duplicated eyebox, realizing that the viewpoint position can be flexibly controlled. The optical experiment realizes a 49.2° FOV and 12.1 mm eyebox which contains 5 moveable viewpoints. This proposed system shows good display capabilities and has potential applications.

Design of a zoom head-up display optical system based on a nodal aberration theory

We propose a zoom dual-path augmented reality head-up display optical system. The system uses two image generation units to display the basic and interactive information. Based on the node aberration theory, the aberration evaluation function was constructed. By solving the optimal solution of the aberration evaluation function, the initial structure of the interactive information display optical path was obtained. In order to solve the vergence-accommodation conflict in the process of vehicle speed change, the interactive information optical path was designed as a zoom optical path. The zoom distance is 10–20 m, and the basic information optical path will not be interfered with in the process. In addition, the tolerance analysis of the system was carried out to prove the machinability and stability of the system. This study makes the imaging of the augmented reality head-up display system more in line with the characteristics of the human eye and improves driving comfort.

16‐3: Distinguished Paper: Vergence‐Accommodation Conflict Increases Time to Focus in Augmented Reality

Vergence‐Accommodation Conflicts (VAC) occur in neareye displays when the binocular disparity of the 3D rendered content (vergence) does not match the display focal distance (accommodation). VAC has been shown to reduce perceptual image quality, cognitive performance, and oculomotor coordination. In this study, we aimed to investigate the impact of VAC on visual performance in augmented reality (AR). Specifically, we quantified the impact of AR VAC on the ‘Time to Focus’ (TTF); when the user switches focus between real world content and worldlocked AR rendered content. Our results show that TTF increases exponentially with VAC. The increase is more pronounced at closer vergence distances in displays with focal distance of 1 D or longer. Finally, we showed that VAC may have a differential effect across age groups; specifically, older users may be affected more in closer focal and longer vergence distances 186‐189.

27‐3: Invited Paper: Visual Fatigue‐free AR Displays

AR enables the integration of virtual digital information on the real world. However, most AR displays suffer from accommodation vergence conflict, which results in 3D visual fatigue. In this work, our works on 3D visual fatigue‐free display techniques would be presented.

Tomographic waveguide-based augmented reality display

A tomographic waveguide-based augmented reality display technique is proposed for near-eye three-dimensional (3D) display with accurate depth reconstructions. A pair of tunable lenses with complementary focuses is utilized to project tomographic virtual 3D images while maintaining the correct perception of the real scene. This approach reconstructs virtual 3D images with physical depth cues, thereby addressing the vergence-accommodation conflict inherent in waveguide augmented reality systems. A prototype has been constructed and optical experiments have been conducted, demonstrating the system’s capability in delivering high-quality 3D scenes for waveguide-based augmented reality display.

The geometry of the vergence-accommodation conflict in mixed reality systems

Mixed reality technologies, such as virtual (VR) and augmented (AR) reality, present promising opportunities to advance education and professional training due to their adaptability to diverse contexts. Distortions in the perceived distance in such mediated conditions, however, are well documented and have imposed nontrivial challenges that complicate and limit transferring task performance in a virtual setting to the unmediated reality (UR). One potential source of the distance distortion is the vergence-accommodation conflict—the discrepancy between the depth specified by the eyes’ accommodative state and the angle at which the eyes converge to fixate on a target. The present study involved the use of a manual pointing task in UR, VR, and AR to quantify the magnitude of the potential depth distortion in each modality. Conceptualizing the effect of vergence-accommodation offset as a constant offset to the vergence angle, a model was developed based on the stereoscopic viewing geometry. Different versions of the model were used to fit and predict the behavioral data for all modalities. Results confirmed the validity of the conceptualization of vergence-accommodation as a device-specific vergence offset, which predicted up to 66% of the variance in the data. The fitted parameters indicate that, due to the vergence-accommodation conflict, participants’ vergence angle was driven outwards by approximately 0.2°, which disrupted the stereoscopic viewing geometry and produced distance distortion in VR and AR. The implications of this finding are discussed in the context of developing virtual environments that minimize the effect of depth distortion.

Vergence-Accommodation Conflict: Increased Presbyopia in Virtual Reality.

Performance and symptoms in completing a visual search task on a PC monitor and using a head-mounted display (HMD) were compared for different viewing conditions and between users of different ages. Twenty-three young (M = 30 y, SD = 7 y) and 23 older (M = 52 y, SD = 5 y) participants performed a visual search task presented on a PC monitor. The task was repeated using an HMD for a near and a far virtual viewing distance. Reaction times (RT), detection sensitivity (d'), and symptoms were recorded for the three different viewing conditions. RT and d' were not affected by the viewing condition (p > 0.05). In contrast, symptoms significantly depended on the viewing condition but were, in part, not significantly affected by age. It is interesting to note that although not significant, young participants reported more ocular symptoms than older participants in the near vision task carried out using the HMD. HMD increases visual symptoms. However, HMD could be, in part, a remedy to problems when using visual aids for near work, in particular for presbyopes.

Wide field-of-view light-field head-mounted display for virtual reality applications

Light-field head-mounted displays (HMDs) can resolve vergence-accommodation conflicts but suffer from limited display pixels, causing a narrow field-of-view (FOV). This study proposes a wide-FOV light-field HMD with a 5.5-inch-diagonal 4 K display for virtual reality applications. By adjusting the pitch of elemental images to control the eye relief and creating a virtual intermediate image, horizontal and vertical FOVs of 68.8° and 43.1°, respectively, can be achieved using a monocular optical bench prototype.

Vergence eye movements in virtual reality

There is increasing interest in incorporating eye tracking in virtual reality (VR) systems to infer gaze in 3 dimensions. Estimation of gaze in depth may be limited by errors of measurement of the small eye vergence angles involved. It may also be limited by true errors of vergence in VR. We found that observers commonly made errors of vergence when viewing in VR, such that the dominant eye was more accurately aligned than the non-dominant eye. Errors of vergence were often larger than Panum’s fusional range. The absence of reported diplopia suggests that some of the visual input from one eye was supressed or the double images escaped attention. Errors of vergence could not be explained by contamination by variations in pupil diameter. Errors of vergence were not reduced when the vergence-accommodation conflict was eliminated by optical correction. These results suggest that the ability to correctly infer gaze distance in VR may be limited by true errors of eye vergence, rather than by measurement errors imposed by limitations of eye tracking.

Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technology.

Stereoscopic imagery often aims to evoke three-dimensional (3-D) percepts that are accurate and realistic-looking. The "gap" between 3-D imagery and real scenes is small, but focus cues typically remain incorrect because images are displayed on a single focal plane. Research has concentrated on the resulting vergence-accommodation conflicts. Yet, incorrect focus cues may also affect the appearance of 3-D imagery. We investigated whether incorrect focus cues reduce perceived realism of 3-D structure ("depth realism"). Experiment1 used a multiple-focal-planes display to compare depth realism with correct focus cues vs. conventional stereo presentation. The stimuli were random-dot stereograms, which isolated the role of focus cues. Depth realism was consistently lower with incorrect focus cues, providing proof-of-principle evidence that they contribute to perceptual realism. Experiments2 and3 examined whether focus cues play a similar role with realistic objects, presented with an almost complete set of visual cues using a high-resolution, high-dynamic-range multiple-focal-planes display. We also examined the efficacy of approximating correct focus cues via gaze-contingent depth-of-field rendering. Improvements in depth realism with correct focus cues were less clear in more realistic scenes, indicating that the role of focus cues in depth realism depends on scene content. Rendering-based approaches, if anything, reduced depth realism, which we attribute to their inability to present higher-order aspects of blur correctly. Our findings suggest future general 3-D display solutions may need to present focus cues correctly to maximise perceptual realism.

Quasi-3D: reducing convergence effort improves visual comfort of head-mounted stereoscopic displays

The diffusion of virtual reality urges to solve the problem of vergence-accommodation conflict arising when viewing stereoscopic displays, which causes visual stress. We addressed this issue with an approach based on reducing ocular convergence effort. In virtual environments, vergence can be controlled by manipulating the binocular separation of the virtual cameras. Using this technique, we implemented two quasi-3D conditions characterized by binocular image separations intermediate between 3D (stereoscopic) and 2D (monoscopic). In a first experiment, focused on perceptual aspects, ten participants performed a visuo-manual pursuit task while wearing a head-mounted display (HMD) in head-constrained (non-immersive) condition for an overall exposure time of ~ 7 min. Passing from 3D to quasi-3D and 2D conditions, progressively resulted in a decrease of vergence eye movements—both mean convergence angle (static vergence) and vergence excursion (dynamic vergence)—and an increase of hand pursuit spatial error, with the target perceived further from the observer and larger. Decreased static and dynamic vergence predicted decreases in asthenopia trial-wise. In a second experiment, focused on tolerance aspects, fourteen participants performed a detection task in near-vision while wearing an HMD in head-free (immersive) condition for an overall exposure time of ~ 20 min. Passing from 3D to quasi-3D and 2D conditions, there was a general decrease of both subjective and objective visual stress indicators (ocular convergence discomfort ratings, cyber-sickness symptoms and skin conductance level). Decreased static and dynamic vergence predicted the decrease in these indicators. Remarkably, skin conductance level predicted all subjective symptoms, both trial-wise and session-wise, suggesting that it could become an objective replacement of visual stress self-reports. We conclude that relieving convergence effort by reducing binocular image separation in virtual environments can be a simple and effective way to decrease visual stress caused by stereoscopic HMDs. The negative side-effect—worsening of spatial vision—arguably would become unnoticed or compensated over time. This initial proof-of-concept study should be extended by future large-scale studies testing additional environments, tasks, displays, users, and exposure times.

Visually guided movement in virtual reality is tolerant of the vergence-accommodation conflict

Stereoscopic virtual reality (VR) headsets display vergence cues to object distance but present images at a fixed focus, resulting in a vergence-accommodation conflict (VAC). This study examined the effects of introducing or reducing the VAC with optical lenses in a targeted reaching task implemented in both VR and the real world. Contrary to previous reports of reduced visual performance and fatigue with the VAC, we found no evidence of impairments to visually guided movement for either the real-world or VR-based versions of the task. As lenses also magnify or minify the image, a control experiment was conducted to examine the effects of image minification on movement in VR. No significant effects of optical correction or image minification were found, suggesting that the VAC does not adversely affect visually guided movement over the durations employed in this study.

Geometric lightguide for near-eye light field displays.

Most near-eye displays with one fixed focal plane suffer from the vergence-accommodation conflict and cause visual discomfort to users. In contrast, light field displays can provide natural and comfortable 3D visual sensation to users without the conflict. This paper presents a near-eye light field display consisting of a geometric lightguide and a light field generator, along with a collimator to ensure the light rays propagating in the lightguide are collimated. Unlike most lightguides, which reduce thickness by employing total internal reflection that can easily generate stray light, our lightguide directly propagates light rays without total internal reflection. The partially reflective mirrors of the lightguide expand the exit pupil to achieve an eyebox of 13m m(h o r i z o n t a l)×6.5m m(v e r t i c a l) with an eye relief of 18mm. The collimator and the light field generator, both having effective focal lengths different in the horizontal and vertical directions, are designed to provide a 40-deg diagonal field of view. The working range of the light field generator, which is 30cm to infinity, is verified qualitatively and quantitatively by experiments. We optimize the illuminance uniformity and analyze the illuminance variation across the eyebox. Further, we minimize the ghost artifact (referring to the split-up of light fields replicated by the partially reflective mirrors) by orienting the partially reflective mirrors at slightly different angles to enhance the image quality for short-range applications such as medical surgery.

Free-space combiner based on holographic mirrors for head-mounted displays.

The paper presents an augmented reality display based on the free-space combiner, consisting of two holographic mirrors: flat and spherical. A feature of such a system is a high-reflection coefficient of mirrors up to 90% for one wavelength and a high transmittance to the lumen up to 67% throughout the rest of the visible spectrum, unlike similar solutions implementing principles of polarization or dichroic beam splitting. The recording scheme and calculation of a separate flat holographic mirror and spherical holographic mirror are described. The proposed augmented reality display can provide multifocality, i.e.,reproduction of virtual images at several distances, which demonstrates a certain perspective of this implementation in terms of compensation for the vergence accommodation conflict.

Linear perspective cues have a greater effect on the perceptual rescaling of distant stimuli than textures in the virtual environment.

The presence of pictorial depth cues in virtual environments is important for minimising distortions driven by unnatural viewing conditions (e.g., vergence-accommodation conflict). Our aim was to determine how different pictorial depth cues affect size constancy in virtual environments under binocular and monocular viewing conditions. We systematically removed linear perspective cues and textures of a hallway in a virtual environment. The experiment was performed using the method of constant stimuli. The task required participants to compare the size of 'far' (10 m) and 'near' (5 m) circles displayed inside a virtual environment with one or both or none of the pictorial depth cues. Participants performed the experiment under binocular and monocular viewing conditions while wearing a virtual reality headset. ANOVA revealed that size constancy was greater for both the far and the near circles in the virtual environment with pictorial depth cues compared to the one without cues. However, the effect of linear perspective cues was stronger than textures, especially for the far circle. We found no difference between the binocular and monocular viewing conditions across the different virtual environments. We conclude that linear perspective cues exert a stronger effect than textures on the perceptual rescaling of far stimuli placed in the virtual environment, and that this effect does not vary between binocular and monocular viewing conditions.

Waveguide holography for 3D augmented reality glasses

Near-eye displays are fundamental technology in the next generation computing platforms for augmented reality and virtual reality. However, there are remaining challenges to deliver immersive and comfortable visual experiences to users, such as compact form factor, solving vergence-accommodation conflict, and achieving a high resolution with a large eyebox. Here we show a compact holographic near-eye display concept that combines the advantages of waveguide displays and holographic displays to overcome the challenges towards true 3D holographic augmented reality glasses. By modeling the coherent light interactions and propagation via the waveguide combiner, we demonstrate controlling the output wavefront using a spatial light modulator located at the input coupler side. The proposed method enables 3D holographic displays via exit-pupil expanding waveguide combiners, providing a large software-steerable eyebox. It also offers additional advantages such as resolution enhancement capability by suppressing phase discontinuities caused by pupil replication process. We build prototypes to verify the concept with experimental results and conclude the paper with discussion.

Effects of Eye Vergence and Accommodation on Interactions with Content on an AR Magic-lens Display and its Surroundings.

Augmented reality (AR) magic-lens (ML) displays, such as handheld devices, offer a convenient and accessible way to enrich our environment using virtual imagery. Several display technologies, including conventional monocular, less common stereoscopic, and varifocal displays, are currently being used. Vergence and accommodation effects on depth perception, as well as vergence-accommodation conflict, have been studied, where users interact only with the content on the display. However, little research exists on how vergence and accommodation influence user performance and cognitive-task load when users interact with the content on a display and its surroundings in a short timeframe. Examples of this are validating augmented instructions before making an incision andperforming general hand-eye coordinated tasks such as grasping augmented objects. To improve interactions with future AR displays in such scenarios, we must improve our understanding of this influence. To this end, we conducted two fundamental visual-acuity user studies with 28 and 27 participants, while investigating eye vergence and accommodation distances on four ML displays. Our findings show that minimizing the accommodation difference between the display and its surroundings is crucial when the gaze between the display and its surroundings shifts rapidly. Minimizing the difference in vergence is more important when viewing the display and its surroundings as a single context without shifting the gaze. Interestingly, the vergence-accommodation conflict did not significantly affect the cognitive-task load nor play a pivotal role in the accuracy of interactions with AR ML content and its physical surroundings.

Perceptual Thresholds for Radial Optic Flow Distortion in Near-Eye Stereoscopic Displays.

We provide the first perceptual quantification of user's sensitivity to radial optic flow artifacts and demonstrate a promising approach for masking this optic flow artifact via blink suppression. Near-eye HMOs allow users to feel immersed in virtual environments by providing visual cues, like motion parallax and stereoscopy, that mimic how we view the physical world. However, these systems exhibit a variety of perceptual artifacts that can limit their usability and the user's sense of presence in VR. One well-known artifact is the vergence-accommodation conflict (VAC). Varifocal displays can mitigate VAC, but bring with them other artifacts such as a change in virtual image size (radial optic flow) when the focal plane changes. We conducted a set of psychophysical studies to measure users' ability to perceive this radial flow artifact before, during, and after self-initiated blinks. Our results showed that visual sensitivity was reduced by a factor of 10 at the start and for ~70 ms after a blink was detected. Pre- and post-blink sensitivity was, on average, ~O.15% image size change during normal viewing and increased to ~1.5- 2.0% during blinks. Our results imply that a rapid (under 70 ms) radial optic flow distortion can go unnoticed during a blink. Furthermore, our results provide empirical data that can be used to inform engineering requirements for both hardware design and software-based graphical correction algorithms for future varifocal near-eye displays. Our project website is available at https://gamma.umd.edu/ROF/.