Vergence-accommodation Conflict Research Articles

Tomographic waveguide-based augmented reality display

A tomographic waveguide-based augmented reality display technique is proposed for near-eye three-dimensional (3D) display with accurate depth reconstructions. A pair of tunable lenses with complementary focuses is utilized to project tomographic virtual 3D images while maintaining the correct perception of the real scene. This approach reconstructs virtual 3D images with physical depth cues, thereby addressing the vergence-accommodation conflict inherent in waveguide augmented reality systems. A prototype has been constructed and optical experiments have been conducted, demonstrating the system’s capability in delivering high-quality 3D scenes for waveguide-based augmented reality display.

The geometry of the vergence-accommodation conflict in mixed reality systems

Mixed reality technologies, such as virtual (VR) and augmented (AR) reality, present promising opportunities to advance education and professional training due to their adaptability to diverse contexts. Distortions in the perceived distance in such mediated conditions, however, are well documented and have imposed nontrivial challenges that complicate and limit transferring task performance in a virtual setting to the unmediated reality (UR). One potential source of the distance distortion is the vergence-accommodation conflict—the discrepancy between the depth specified by the eyes’ accommodative state and the angle at which the eyes converge to fixate on a target. The present study involved the use of a manual pointing task in UR, VR, and AR to quantify the magnitude of the potential depth distortion in each modality. Conceptualizing the effect of vergence-accommodation offset as a constant offset to the vergence angle, a model was developed based on the stereoscopic viewing geometry. Different versions of the model were used to fit and predict the behavioral data for all modalities. Results confirmed the validity of the conceptualization of vergence-accommodation as a device-specific vergence offset, which predicted up to 66% of the variance in the data. The fitted parameters indicate that, due to the vergence-accommodation conflict, participants’ vergence angle was driven outwards by approximately 0.2°, which disrupted the stereoscopic viewing geometry and produced distance distortion in VR and AR. The implications of this finding are discussed in the context of developing virtual environments that minimize the effect of depth distortion.

Vergence-Accommodation Conflict: Increased Presbyopia in Virtual Reality.

Performance and symptoms in completing a visual search task on a PC monitor and using a head-mounted display (HMD) were compared for different viewing conditions and between users of different ages. Twenty-three young (M = 30 y, SD = 7 y) and 23 older (M = 52 y, SD = 5 y) participants performed a visual search task presented on a PC monitor. The task was repeated using an HMD for a near and a far virtual viewing distance. Reaction times (RT), detection sensitivity (d'), and symptoms were recorded for the three different viewing conditions. RT and d' were not affected by the viewing condition (p > 0.05). In contrast, symptoms significantly depended on the viewing condition but were, in part, not significantly affected by age. It is interesting to note that although not significant, young participants reported more ocular symptoms than older participants in the near vision task carried out using the HMD. HMD increases visual symptoms. However, HMD could be, in part, a remedy to problems when using visual aids for near work, in particular for presbyopes.

Wide field-of-view light-field head-mounted display for virtual reality applications

Light-field head-mounted displays (HMDs) can resolve vergence-accommodation conflicts but suffer from limited display pixels, causing a narrow field-of-view (FOV). This study proposes a wide-FOV light-field HMD with a 5.5-inch-diagonal 4 K display for virtual reality applications. By adjusting the pitch of elemental images to control the eye relief and creating a virtual intermediate image, horizontal and vertical FOVs of 68.8° and 43.1°, respectively, can be achieved using a monocular optical bench prototype.

Vergence eye movements in virtual reality

There is increasing interest in incorporating eye tracking in virtual reality (VR) systems to infer gaze in 3 dimensions. Estimation of gaze in depth may be limited by errors of measurement of the small eye vergence angles involved. It may also be limited by true errors of vergence in VR. We found that observers commonly made errors of vergence when viewing in VR, such that the dominant eye was more accurately aligned than the non-dominant eye. Errors of vergence were often larger than Panum’s fusional range. The absence of reported diplopia suggests that some of the visual input from one eye was supressed or the double images escaped attention. Errors of vergence could not be explained by contamination by variations in pupil diameter. Errors of vergence were not reduced when the vergence-accommodation conflict was eliminated by optical correction. These results suggest that the ability to correctly infer gaze distance in VR may be limited by true errors of eye vergence, rather than by measurement errors imposed by limitations of eye tracking.

Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technology.

Stereoscopic imagery often aims to evoke three-dimensional (3-D) percepts that are accurate and realistic-looking. The "gap" between 3-D imagery and real scenes is small, but focus cues typically remain incorrect because images are displayed on a single focal plane. Research has concentrated on the resulting vergence-accommodation conflicts. Yet, incorrect focus cues may also affect the appearance of 3-D imagery. We investigated whether incorrect focus cues reduce perceived realism of 3-D structure ("depth realism"). Experiment1 used a multiple-focal-planes display to compare depth realism with correct focus cues vs. conventional stereo presentation. The stimuli were random-dot stereograms, which isolated the role of focus cues. Depth realism was consistently lower with incorrect focus cues, providing proof-of-principle evidence that they contribute to perceptual realism. Experiments2 and3 examined whether focus cues play a similar role with realistic objects, presented with an almost complete set of visual cues using a high-resolution, high-dynamic-range multiple-focal-planes display. We also examined the efficacy of approximating correct focus cues via gaze-contingent depth-of-field rendering. Improvements in depth realism with correct focus cues were less clear in more realistic scenes, indicating that the role of focus cues in depth realism depends on scene content. Rendering-based approaches, if anything, reduced depth realism, which we attribute to their inability to present higher-order aspects of blur correctly. Our findings suggest future general 3-D display solutions may need to present focus cues correctly to maximise perceptual realism.

Quasi-3D: reducing convergence effort improves visual comfort of head-mounted stereoscopic displays

The diffusion of virtual reality urges to solve the problem of vergence-accommodation conflict arising when viewing stereoscopic displays, which causes visual stress. We addressed this issue with an approach based on reducing ocular convergence effort. In virtual environments, vergence can be controlled by manipulating the binocular separation of the virtual cameras. Using this technique, we implemented two quasi-3D conditions characterized by binocular image separations intermediate between 3D (stereoscopic) and 2D (monoscopic). In a first experiment, focused on perceptual aspects, ten participants performed a visuo-manual pursuit task while wearing a head-mounted display (HMD) in head-constrained (non-immersive) condition for an overall exposure time of ~ 7 min. Passing from 3D to quasi-3D and 2D conditions, progressively resulted in a decrease of vergence eye movements—both mean convergence angle (static vergence) and vergence excursion (dynamic vergence)—and an increase of hand pursuit spatial error, with the target perceived further from the observer and larger. Decreased static and dynamic vergence predicted decreases in asthenopia trial-wise. In a second experiment, focused on tolerance aspects, fourteen participants performed a detection task in near-vision while wearing an HMD in head-free (immersive) condition for an overall exposure time of ~ 20 min. Passing from 3D to quasi-3D and 2D conditions, there was a general decrease of both subjective and objective visual stress indicators (ocular convergence discomfort ratings, cyber-sickness symptoms and skin conductance level). Decreased static and dynamic vergence predicted the decrease in these indicators. Remarkably, skin conductance level predicted all subjective symptoms, both trial-wise and session-wise, suggesting that it could become an objective replacement of visual stress self-reports. We conclude that relieving convergence effort by reducing binocular image separation in virtual environments can be a simple and effective way to decrease visual stress caused by stereoscopic HMDs. The negative side-effect—worsening of spatial vision—arguably would become unnoticed or compensated over time. This initial proof-of-concept study should be extended by future large-scale studies testing additional environments, tasks, displays, users, and exposure times.

Visually guided movement in virtual reality is tolerant of the vergence-accommodation conflict

Stereoscopic virtual reality (VR) headsets display vergence cues to object distance but present images at a fixed focus, resulting in a vergence-accommodation conflict (VAC). This study examined the effects of introducing or reducing the VAC with optical lenses in a targeted reaching task implemented in both VR and the real world. Contrary to previous reports of reduced visual performance and fatigue with the VAC, we found no evidence of impairments to visually guided movement for either the real-world or VR-based versions of the task. As lenses also magnify or minify the image, a control experiment was conducted to examine the effects of image minification on movement in VR. No significant effects of optical correction or image minification were found, suggesting that the VAC does not adversely affect visually guided movement over the durations employed in this study.

Geometric lightguide for near-eye light field displays.

Most near-eye displays with one fixed focal plane suffer from the vergence-accommodation conflict and cause visual discomfort to users. In contrast, light field displays can provide natural and comfortable 3D visual sensation to users without the conflict. This paper presents a near-eye light field display consisting of a geometric lightguide and a light field generator, along with a collimator to ensure the light rays propagating in the lightguide are collimated. Unlike most lightguides, which reduce thickness by employing total internal reflection that can easily generate stray light, our lightguide directly propagates light rays without total internal reflection. The partially reflective mirrors of the lightguide expand the exit pupil to achieve an eyebox of 13m m(h o r i z o n t a l)×6.5m m(v e r t i c a l) with an eye relief of 18mm. The collimator and the light field generator, both having effective focal lengths different in the horizontal and vertical directions, are designed to provide a 40-deg diagonal field of view. The working range of the light field generator, which is 30cm to infinity, is verified qualitatively and quantitatively by experiments. We optimize the illuminance uniformity and analyze the illuminance variation across the eyebox. Further, we minimize the ghost artifact (referring to the split-up of light fields replicated by the partially reflective mirrors) by orienting the partially reflective mirrors at slightly different angles to enhance the image quality for short-range applications such as medical surgery.

Free-space combiner based on holographic mirrors for head-mounted displays.

The paper presents an augmented reality display based on the free-space combiner, consisting of two holographic mirrors: flat and spherical. A feature of such a system is a high-reflection coefficient of mirrors up to 90% for one wavelength and a high transmittance to the lumen up to 67% throughout the rest of the visible spectrum, unlike similar solutions implementing principles of polarization or dichroic beam splitting. The recording scheme and calculation of a separate flat holographic mirror and spherical holographic mirror are described. The proposed augmented reality display can provide multifocality, i.e.,reproduction of virtual images at several distances, which demonstrates a certain perspective of this implementation in terms of compensation for the vergence accommodation conflict.

Linear perspective cues have a greater effect on the perceptual rescaling of distant stimuli than textures in the virtual environment.

The presence of pictorial depth cues in virtual environments is important for minimising distortions driven by unnatural viewing conditions (e.g., vergence-accommodation conflict). Our aim was to determine how different pictorial depth cues affect size constancy in virtual environments under binocular and monocular viewing conditions. We systematically removed linear perspective cues and textures of a hallway in a virtual environment. The experiment was performed using the method of constant stimuli. The task required participants to compare the size of 'far' (10 m) and 'near' (5 m) circles displayed inside a virtual environment with one or both or none of the pictorial depth cues. Participants performed the experiment under binocular and monocular viewing conditions while wearing a virtual reality headset. ANOVA revealed that size constancy was greater for both the far and the near circles in the virtual environment with pictorial depth cues compared to the one without cues. However, the effect of linear perspective cues was stronger than textures, especially for the far circle. We found no difference between the binocular and monocular viewing conditions across the different virtual environments. We conclude that linear perspective cues exert a stronger effect than textures on the perceptual rescaling of far stimuli placed in the virtual environment, and that this effect does not vary between binocular and monocular viewing conditions.

Waveguide holography for 3D augmented reality glasses

Near-eye displays are fundamental technology in the next generation computing platforms for augmented reality and virtual reality. However, there are remaining challenges to deliver immersive and comfortable visual experiences to users, such as compact form factor, solving vergence-accommodation conflict, and achieving a high resolution with a large eyebox. Here we show a compact holographic near-eye display concept that combines the advantages of waveguide displays and holographic displays to overcome the challenges towards true 3D holographic augmented reality glasses. By modeling the coherent light interactions and propagation via the waveguide combiner, we demonstrate controlling the output wavefront using a spatial light modulator located at the input coupler side. The proposed method enables 3D holographic displays via exit-pupil expanding waveguide combiners, providing a large software-steerable eyebox. It also offers additional advantages such as resolution enhancement capability by suppressing phase discontinuities caused by pupil replication process. We build prototypes to verify the concept with experimental results and conclude the paper with discussion.

Effects of Eye Vergence and Accommodation on Interactions with Content on an AR Magic-lens Display and its Surroundings.

Augmented reality (AR) magic-lens (ML) displays, such as handheld devices, offer a convenient and accessible way to enrich our environment using virtual imagery. Several display technologies, including conventional monocular, less common stereoscopic, and varifocal displays, are currently being used. Vergence and accommodation effects on depth perception, as well as vergence-accommodation conflict, have been studied, where users interact only with the content on the display. However, little research exists on how vergence and accommodation influence user performance and cognitive-task load when users interact with the content on a display and its surroundings in a short timeframe. Examples of this are validating augmented instructions before making an incision andperforming general hand-eye coordinated tasks such as grasping augmented objects. To improve interactions with future AR displays in such scenarios, we must improve our understanding of this influence. To this end, we conducted two fundamental visual-acuity user studies with 28 and 27 participants, while investigating eye vergence and accommodation distances on four ML displays. Our findings show that minimizing the accommodation difference between the display and its surroundings is crucial when the gaze between the display and its surroundings shifts rapidly. Minimizing the difference in vergence is more important when viewing the display and its surroundings as a single context without shifting the gaze. Interestingly, the vergence-accommodation conflict did not significantly affect the cognitive-task load nor play a pivotal role in the accuracy of interactions with AR ML content and its physical surroundings.

Perceptual Thresholds for Radial Optic Flow Distortion in Near-Eye Stereoscopic Displays.

We provide the first perceptual quantification of user's sensitivity to radial optic flow artifacts and demonstrate a promising approach for masking this optic flow artifact via blink suppression. Near-eye HMOs allow users to feel immersed in virtual environments by providing visual cues, like motion parallax and stereoscopy, that mimic how we view the physical world. However, these systems exhibit a variety of perceptual artifacts that can limit their usability and the user's sense of presence in VR. One well-known artifact is the vergence-accommodation conflict (VAC). Varifocal displays can mitigate VAC, but bring with them other artifacts such as a change in virtual image size (radial optic flow) when the focal plane changes. We conducted a set of psychophysical studies to measure users' ability to perceive this radial flow artifact before, during, and after self-initiated blinks. Our results showed that visual sensitivity was reduced by a factor of 10 at the start and for ~70 ms after a blink was detected. Pre- and post-blink sensitivity was, on average, ~O.15% image size change during normal viewing and increased to ~1.5- 2.0% during blinks. Our results imply that a rapid (under 70 ms) radial optic flow distortion can go unnoticed during a blink. Furthermore, our results provide empirical data that can be used to inform engineering requirements for both hardware design and software-based graphical correction algorithms for future varifocal near-eye displays. Our project website is available at https://gamma.umd.edu/ROF/.

Improving Depth Perception in Immersive Media Devices by Addressing Vergence-Accommodation Conflict.

Recently, immersive media devices have seen a boost in popularity. However, many problems still remain. Depth perception is a crucial part of how humans behave and interact with their environment. Convergence and accommodation are two physiological mechanisms that provide important depth cues. However, when humans are immersed in virtual environments, they experience a mismatch between these cues. This mismatch causes users to feel discomfort while also hindering their ability to fully perceive object distances. To address the conflict, we have developed a technique that encompasses inverse blurring into immersive media devices. For the inverse blurring, we utilize the classical Wiener deconvolution approach by proposing a novel technique that is applied without the need for an eye-tracker and implemented in a commercial immersive media device. The technique's ability to compensate for the vergence-accommodation conflict was verified through two user studies aimed at reaching and spatial awareness, respectively. The two studies yielded a statistically significant 36% and 48% error reduction in user performance to estimate distances, respectively. Overall, the work done demonstrates how visual stimuli can be modified to allow users to achieve a more natural perception and interaction with the virtual environment.

Recent Progress in True 3D Display Technologies Based on Liquid Crystal Devices

In recent years, the emergence of virtual reality (VR) and augmented reality (AR) has revolutionized the way we interact with the world, leading to significant advancements in 3D display technology. However, some of the currently employed 3D display techniques rely on stereoscopic 3D display method, which may lead to visual discomfort due to the vergence-accommodation conflict. To address this issue, several true 3D technologies have been proposed as alternatives, including multi-plane displays, holographic displays, super multi-view displays, and integrated imaging displays. In this review, we focus on planar liquid crystal (LC) devices for different types of true 3D display applications. Given the excellent optical performance of the LC devices, we believe that LC devices hold great potential for true 3D displays.

Comparison of Light Field and Conventional Near-Eye AR Displays in Virtual-Real Integration Efficiency

Most existing wearable displays for augmented reality (AR) have only one fixed focal plane and hence can easily suffer from vergence-accommodation conflict (VAC). In contrast, light field displays allow users to focus at any depth free of VAC. This paper presents a series of text-based visual search tasks to systematically and quantitatively compare a near-eye light field AR display with a conventional AR display, specifically in regards to how participants wearing such displays would perform on a virtual-real integration task. Task performance is evaluated by task completion rate and accuracy. The results show that the light field AR glasses lead to significantly higher user performance than the conventional AR glasses. In addition, 80% of the participants prefer the light field AR glasses over the conventional AR glasses for visual comfort.

Gaze-directed and saliency-guided approaches of stereo camera control in interactive virtual reality

Despite remarkable advances in virtual reality (VR) technologies, serious challenges remain in making extended VR sessions with head-mounted displays (HMDs) thoroughly comfortable. 3D stereo imagery can cause discomfort and eye fatigue due to poor stereo camera settings that result in extreme disparities and vergence-accommodation conflicts. The default stereoscopic parameters of consumer HMDs produce images with shallow depth to circumvent these issues. In this work, we propose a methodology to utilize the gaze-directed and visual saliency-guided paradigms for automatic stereo camera control in real-time interactive VR by employing the basics of stereo grading. We evaluate these two approaches at different levels of interaction, first through a user study and then through a performance benchmark. The results show that the gaze-directed approach outperforms the saliency-guided approach in the VEs tested and both methods are able to convey a better overall depth feeling than the default HMD setting without hindering visual comfort. It is also shown that both approaches lead to a significant overall enhancement of the VR experience in the more interactive VE.

Cascaded transflective liquid crystal planar lenses enable multi-plane augmented reality.

In this Letter, we report and experimentally demonstrate the multi-plane augmented reality (AR) by combining the reflective polarization volume lens (PVL) and electrically controlled transmissive Pancharatnam-Berry (PB) liquid crystal (LC) lens. This strategy is based on the electrically controlled power-based approach, which significantly alleviates the challenge of vergence-accommodation conflict (VAC) of the current near-eye display (NED). As a proof of concept, a birdbath architecture dual-plane optical see-through (OST) display was implemented experimentally by changing the power of the lens. The proposed method is expected to be a novel, to the best of our knowledge, NED that is compact, light, and fatigue-free.

Neutral density filter-based catadioptric optical design for thin virtual reality head-mounted device

Virtual reality (VR) has been a popular trending technology affecting the lifestyles of humans. Especially for near-eye displays, VR head-mounted devices (HMDs) are designed accordingly and widely used in different fields. Nowadays, small structure size is a challenge and an urgent need for the VR HMD, while catadioptric optics is an effective and promising approach to solving this problem. Thus, this paper develops three kinds of catadioptric optical systems for thin VR HMDs by adjusting the configuration positions of the light refraction module created by the aspheric lens and the light partial reflection module formed by the neutral density (ND) filter. The comparison results of the three designs in terms of structure size and imaging quality show that multiple reflections during the light divergence process can effectively reduce the thickness of the optical structure. Reasonable transmission during the reflection process is also favorable for size reduction. Based on the designed catadioptric optical module, a varifocal VR HMD is developed to mitigate the vergence-accommodation conflict, thereby improving the image quality and the sensory experience of users.