Virtual Objects In Augmented Reality Research Articles

GPS-Induced Disparity Correction for Accurate Object Placement in Augmented Reality

The use of augmented reality (AR) continues to increase, particularly in marketing and advertising, where virtual objects are showcased in the AR world, thereby expanding its various applications. In this paper, a method of linking coordinate systems to connect the metaverse with the real world is proposed and a system for correcting and displaying virtual objects in the AR environment is implemented. The proposed method calculates errors to accurately represent virtual objects in AR and presents a method to show these objects without errors. The proposed method was verified through experiments to successfully display virtual objects in AR. To minimize localization errors, semantic segmentation was used to recognize objects and estimate buildings, thereby correcting the device location. An error correction expression is also presented. The proposed system is designed to correct and display virtual objects in AR, with confirmed functionality for location correction.

Interactions with 3D virtual objects in augmented reality using natural gestures

Interactions with 3D virtual objects in augmented reality using natural gestures

Perceptual thresholds of visual size discrimination in augmented and virtual reality

The perception of size in virtual objects in Augmented Reality (AR) and Virtual Reality (VR) is a not trivial issue, as the effectiveness of manipulating and interacting with virtual content depends on the accuracy of size perception. However, there are missing straightforward comparisons between VR and AR in terms of size perception for the deep understanding of size perceptual differences. Understanding these perceptual differences can inform designers on how to adapt content when transitioning between these two spatial computing platforms. In this paper, we conducted two psychophysical experiments to measure the perceptual thresholds of size discrimination for virtual objects. Our results indicated that users are more sensitive to size changes in VR than in video see-through AR, suggesting that size differences are easier to be perceived in VR than in AR. Additionally, for increase or decrease of sizes, the accuracy of judgments showed an asymmetric trend in video see-through AR.

Design and Evaluation of Bare-Hand Interaction for Precise Manipulation of Distant Objects in AR

Interaction with virtual objects is one of the essential features of Augmented Reality (AR) systems. One of its main issues is how to provide precise manipulation of distant virtual objects in AR. In this work, we explore bare-hand manipulation of distant objects in AR with DOF (degree-of-freedom) separation, motion scaling, and near-field metaphors. We developed two manipulation techniques: the distant widget-based metaphor (DWBM), and the near-field widget-based metaphor (NFWBM). We conducted a user study with 20 participants to compare the two techniques in terms of performance and user experience. We found that NFWBM has faster speed, lower mental effort, better ease-of-use, and a friendlier user experience. However, there is no significant difference in terms of precision; both techniques could manipulate distant objects precisely, with an average position error of less than 0.7 cm and an average orientational error of less than 1°. We also discussed the limitations of this research and directions for future work.

Shedding Light on Cast Shadows: An Investigation of Perceived Ground Contact in AR and VR.

Virtual objects in augmented reality (AR) often appear to float atop real world surfaces, which makes it difficult to determine where they are positioned in space. This is problematic as many applications for AR require accurate spatial perception. In the current study, we examine how the way we render cast shadows-which act as an important monocular depth cue for creating a sense of contact between an object and the surface beneath it-impacts spatial perception. Over two experiments, we evaluate people's sense of surface contact given both traditional and non-traditional shadow shading methods in optical see-through augmented reality (OST AR), video see-through augmented reality (VST AR), and virtual reality (VR) head-mounted displays. Our results provide evidence that nontraditional shading techniques for rendering shadows in AR displays may enhance the accuracy of one's perception of surface contact. This finding implies a possible tradeoff between photorealism and accuracy of depth perception, especially in OST AR displays. However, it also supports the use of more stylized graphics like non-traditional cast shadows to improve perception and interaction in AR applications.

Advanced Visual SLAM and Image Segmentation Techniques for Augmented Reality

Augmented reality can enhance human perception to experience a virtual-reality intertwined world by computer vision techniques. However, the basic techniques cannot handle complex large-scale scenes, tackle real-time occlusion, and render virtual objects in augmented reality. Therefore, this paper studies potential solutions, such as visual SLAM and image segmentation, that can address these challenges in the augmented reality visualizations. This paper provides a review of advanced visual SLAM and image segmentation techniques for augmented reality. In addition, applications of machine learning techniques for improving augmented reality are presented.

HapticProxy: Providing Positional Vibrotactile Feedback on a Physical Proxy for Virtual-Real Interaction in Augmented Reality

Consistent visual and haptic feedback is an important way to improve the user experience when interacting with virtual objects. However, the perception provided in Augmented Reality (AR) mainly comes from visual cues and amorphous tactile feedback. This work explores how to simulate positional vibrotactile feedback (PVF) with multiple vibration motors when colliding with virtual objects in AR. By attaching spatially distributed vibration motors on a physical haptic proxy, users can obtain an augmented collision experience with positional vibration sensations from the contact point with virtual objects. We first developed a prototype system and conducted a user study to optimize the design parameters. Then we investigated the effect of PVF on user performance and experience in a virtual and real object alignment task in the AR environment. We found that this approach could significantly reduce the alignment offset between virtual and physical objects with tolerable task completion time increments. With the PVF cue, participants obtained a more comprehensive perception of the offset direction, more useful information, and a more authentic AR experience.

Intuitive Manipulation of Virtual Clay in Augmented Reality

In recent years, there has been a lot of research on how to achieve interaction between users and virtual objects using augmented reality. Interaction technologies in augmented reality need to enable users to handle virtual objects intuitively. In addition, since hands are the main means of interaction with objects in real life, it is also necessary to enable interaction operations with hands on virtual objects [1]. In order to make it possible to intuitively handle objects in virtual space using hands in real space, it is necessary to consider whether physical phenomena in real space and virtual space are correctly superimposed (physical consistency). In this study, we proposed a system that allows users to intuitively handle the deformation, movement, and merging of virtual objects in augmented reality. The system was then used by four university students to compare it with existing studies [2].

Three-dimensional depth estimation of virtual objects in augmented reality

Three-dimensional depth estimation of virtual objects in augmented reality

Wearable Haptic Device for Stiffness Rendering of Virtual Objects in Augmented Reality

We propose a novel wearable haptic device that can provide kinesthetic haptic feedback for stiffness rendering of virtual objects in augmented reality (AR). Rendering stiffness of objects using haptic feedback is crucial for realistic finger-based object manipulation, yet challenging particularly in AR due to the co-presence of a real hand, haptic device, and rendered AR objects in the scenes. By adopting passive actuation with a tendon-based transmission mechanism, the proposed haptic device can generate kinesthetic feedback strong enough for immersive manipulation and prevention of inter-penetration in a small-form-factor, while maximizing the wearability and minimizing the occlusion in AR usage. A selective locking module is adopted in the device to allow for the rendering of the elasticity of objects. We perform an experimental study of two-finger grasping to verify the efficacy of the proposed haptic device for finger-based manipulation in AR. We also quantitatively compare/articulate the effects of different types of feedbacks across haptic and visual sense (i.e., kinesthetic haptic feedback, vibrotactile haptic feedback, and visuo-haptic feedback) for stiffness rendering of virtual objects in AR for the first time.

Using the Visuo-Haptic Illusion to Perceive and Manipulate Different Virtual Objects in Augmented Reality

The prop-based 3D virtual object manipulation method is widely used for interaction in Augmented Reality (AR) due to its convenience and flexibility. However, when the represented virtual object is different from the physical prop, the look and feel of the object are not well aligned. To address this problem, we present a dynamic finger remapping approach to creating a visuo-haptic illusion that dynamically adjusts the presented virtual hand posture to fit different sizes and shapes of virtual objects in AR. The finger movement toward a physical prop is synchronously remapped to the movement of the virtual fingers towards the corresponding virtual object. We developed a system that enables users to perceive consistent visual and tactile feedback while grasping and releasing various virtual objects represented by a physical prop. We conducted a user study to explore the effect of this visuo-haptic illusion on the perceived size of virtual objects, setting the sizes of the rendered virtual object and the physical prop as independent variables. We found that the perceived size of a virtual object varied with its rendered size in an almost linear fashion, while the physical prop size did not significantly affect the perception. We also conducted a second study to compare our system with a current prop-based method on virtual object manipulation. The results indicated that the remapped hands could effectively improve the realism and naturalness of the experience.

Application of Monocular Direct Vision Odometry in Augmented Reality

In recent years, the unlabeled augmented reality system has been gradually applied to various mobile devices, among which stable, accurate, and fast registration is the key to realizing this function. For this technique, this paper introduces camera exposure parameters and puts the data association and pose estimation into a unified nonlinear optimization problem. Moreover, the direct monocular vision odometer is transplanted into the augmented reality system through the position adjustment module. We compare it with the traditional visual odometry method that matches the feature points. The results show that this improved method can be used to track more quickly and build a more visual semi-dense point cloud map, which can be used to support the registration and tracking of virtual objects in augmented reality.

Understanding Multimodal User Gesture and Speech Behavior for Object Manipulation in Augmented Reality Using Elicitation.

The primary objective of this research is to understand how users manipulate virtual objects in augmented reality using multimodal interaction (gesture and speech) and unimodal interaction (gesture). Through this understanding, natural-feeling interactions can be designed for this technology. These findings are derived from an elicitation study employing Wizard of Oz design aimed at developing user-defined multimodal interaction sets for building tasks in 3D environments using optical see-through augmented reality headsets. The modalities tested are gesture and speech combined, gesture only, and speech only. The study was conducted with 24 participants. The canonical referents for translation, rotation, and scale were used along with some abstract referents (create, destroy, and select). A consensus set of gestures for interactions is provided. Findings include the types of gestures performed, the timing between co-occurring gestures and speech (130 milliseconds), perceived workload by modality (using NASA TLX), and design guidelines arising from this study. Multimodal interaction, in particular gesture and speech interactions for augmented reality headsets, are essential as this technology becomes the future of interactive computing. It is possible that in the near future, augmented reality glasses will become pervasive.

Hidden Surface Removal for Interactions between User's Bare Hands and Virtual Objects in Augmented Reality

Hidden Surface Removal for Interactions between User's Bare Hands and Virtual Objects in Augmented Reality

A Fundamental Study on Hidden Surface Removal for Interactions between User’s Bare Hands and Virtual Objects in Augmented Reality

A Fundamental Study on Hidden Surface Removal for Interactions between User’s Bare Hands and Virtual Objects in Augmented Reality

Hidden Surface Removal for Interaction between Hand and Virtual Objects in Augmented Reality

Hidden Surface Removal for Interaction between Hand and Virtual Objects in Augmented Reality

Adding Physical Properties to 3D Models in Augmented Reality for Realistic Interactions Experiments

Augmented Reality is the combination of virtual objects (created by computer i.e. video, texts or 3D computer models) overlay on top of real world image. Applications of Augmented Reality can be ranged from advertising, edutainment, education, engineering, medicine to industrial manufacturing. In basic applications, like in advertisement or games, users only see the actions or interact with part of the screen designed for initiate some actions. In order to make users have realistic experiences, the interaction amongst virtual objects in Augmented Reality must be restricted to the law of Physics. Virtual objects can have their own dimensions, volumes or weights. When interaction between virtual objects occurred, the collision for example, they should not penetrate each other. The objects will react to each other by the law of Physics. With this concept, all kinds of experiments can be tested or practiced without spending a lot of fortunes with the real setup ranging from simple science experiment, medical training or even assembly process of equipment. In this research, Unity 3D game engine is used on Vuforia platform. Unity is a fully integrated development engine for creating games and other interactive 3D content and Vuforia platform make it possible to write a single native application that runs on almost all smartphones and tablets. To test the concept, 8 pieces of virtual 3D puzzle modules were created using 8 markers. Each virtual module was assigned with physical properties such dimensions, shapes and positions. When assemble the puzzle, each piece of the marker must be able to move around so that the virtual modules can fit to each other. By lifting and rotating the markers, the virtual module will snap with the other proper virtual part, forming virtual 3D puzzle. The virtual module will not penetrate each other because they have their own territory due to their dimensions. With this experiment, users will have a realistic feeling on assembling the virtual model. The concept can be implemented for experiments that are dangerous or expensive to setup. Experiments related to interaction between objects such as physics and chemistry experiments, engineering and medical training are the main targets for using this kind of technology.

Vision-Based Hand Detection for Registration of Virtual Objects in Augmented Reality

This paper presents a markerless Augmented Reality (AR) framework which utilizes outstretched hand for registration of virtual objects in the real environment. Hand detection methods used in this work are purely based on computer vision algorithms to detect bare hand without assistance from markers or any other devices such as mechanical devices and magnetic devices. We use a stereo camera to capture video images, so that the depth information of the hand can be constructed. Skin color segmentation is employed to segment the hand region from the images. Instead of fiducial markers, the center of the palm and fingertips are tracked in real time. Incorporating the depth information computed, the 3D positions of these hand features are then used to estimate the 6DOF camera pose with respect to the hand, which in turn allows the virtual objects to be augmented onto the palm accurately. This method increases the ease of manipulation of AR objects. Users can inspect and manipulate the AR objects in an intuitive way by using their bare hands.