Encountered-type Haptic Display Research Articles

Extension of Contact Initiation Range in Encountered-Type Haptic Display Using MR Fluid

Extension of Contact Initiation Range in Encountered-Type Haptic Display Using MR Fluid

Effects of Physical Hardness on the Perception of Rendered Stiffness in an Encountered-Type Haptic Display.

Rendering stable hard surfaces is an important problem in haptics; current haptic devices cannot render hard objects and free space together. In our previous work, we addressed these limitations using an encountered-type haptic display system, which showed significant improvements compared to traditional rendering methods. In our approach, we attach a plate with the desired hardness to the kinesthetic device's end-effector, which the user interacts with using an untethered stylus. This method allows us to directly change the hardness of the end-effector based on the rendered object. In this paper, we evaluate how changing the hardness of the end-effector can mask the device's stiffness and affect the user's perception of the interaction. Our human subject experiment results indicate that when the end-effector is made of a hard material, it is difficult for users to perceive the stiffness change rendered by the device. On the other hand, this stiffness change is easily distinguished when the end-effector is made of a soft material. These results show promise for our combined hardness-stiffness display in avoiding the limitations of haptic devices when rendering hard surfaces.

A Novel Method for Surface Exploration by 6-DOF Encountered-Type Haptic Display Towards Virtual Palpation

Surface exploration in virtual reality has a large potential to enrich the user's experience. It could for example be used to train and simulate medical palpation. During palpation, users tap, indent, and rub the surface of a sample to estimate the underlying properties. However, up to now there is no good approach to render such intricate interaction realistically. This paper introduces 6 degrees of freedom (DoF) encountered-type haptic display technology for simulating surface exploration tasks. Among the different phases of exploration, this article focuses on the 'in-contact sliding' phase. Two novel control approaches to render sliding over a virtual surface are elaborated. A first rendering method generates lateral frictional forces as the finger slides over the surface. A second method adjusts the inclination of the end-effector to render tissue properties. With both methods a stiff nodule embedded in a soft tissue was prepared. User experiments were carried out to find proper parameter and intensity ranges and to confirm the feasibility of the new rendering schemes. Participants indicated that both rendering schemes felt realistic. Compared to earlier work, where only the vertical stiffness was altered, lower thresholds to detect and localise embedded virtual nodules were found. Users also made fewer errors in detecting nodule edges. Furthermore, the method that used end-effector inclination allowed faster discovery of the nodule's edges. It is expected that approaches that combine both rendering methods could provide an even more realistic feel.

Synthesizing the Roughness of Textured Surfaces for an Encountered-Type Haptic Display Using Spatiotemporal Encoding.

Encountered-type haptic rendering provides realistic, free-to-touch, and move-and-collide haptic sensation to a user. However, inducing haptic-texture sensation without complicated tactile actuators is challenging for encountered-type haptic rendering. In this article, we propose a novel texture synthesizing method for an encountered-type haptic display using spatial and temporal encoding of roughness, which provides both active and passive touch sensation requiring no complicated tactile actuation. Focused on macro-scale roughness perception, we geometrically model the textured surface with a grid of hemiellipsoidal bumps, which can provide a variety of perceived roughness as the user explores the surface with one's bare hand. Our texture synthesis method is based on two important hypotheses. First, we assume that perceptual roughness can be spatially encoded along the radial direction of a textured surface with hemiellipsoidal bumps. Second, perceptual roughness temporally varies with the relative velocity of a scanning human hand with respect to the surface. To validate these hypotheses on our spatiotemporal encoding method, we implemented an encountered-type haptic texture rendering system using an off-the-shelf collaborative robot that can also track the user's hand using IR sensors. We performed psychophysical user tests with 25 participants and verified the main effects of spatiotemporal encoding of a textured model on the user's roughness perception. Our empirical experiments imply that the users perceive a more rough texture as the surface orientation or the relative hand motion increases. Based on these findings, we show that our visuo-haptic system can synthesize an appropriate level of roughness corresponding to diverse visual textures by suitably choosing encoding values.

Visuo-Haptic Mixed Reality Simulation Using Unbound Handheld Tools

Visuo-haptic mixed reality (VHMR) adds virtual objects to a real scene and enables users to see and also touch them via a see-through display and a haptic device. Most studies with kinesthetic feedback use general-purpose haptic devices, which require the user to continuously hold an attached stylus. This approach constrains users to the mechanical limits of the device even when it is not needed. In this paper, we propose a novel VHMR concept with an encountered-type haptic display (ETHD), which consists of a precision hexapod positioner and a six-axis force/torque transducer. The main contribution is that the users work with unbound real-life tools with tracking markers. ETHD’s end-effector remains inside the virtual object and follows the tooltip to engage only during an interaction. We have developed a simulation setup and experimentally evaluated the relative accuracy and synchronization of the three major processes, namely tool tracking, haptic rendering, and visual rendering. The experiments successfully build-up to a simple simulation scenario where a tennis ball with a fixed center is deformed by the user.

Visual Guidance for a Spatial Discrepancy Problem of in Encountered-Type Haptic Display

In virtual environments, spatial discrepancies between visual and haptic scenes negatively impact user performance and experience. This paper shows how spatial discrepancies due to pose differences can occur in a haptic augmented virtuality system with an encountered-type haptic display. To mitigate this problem, we propose visual guidance, an algorithm that dynamically manipulates the visual scene to compensate for discrepancies. The effectiveness of this algorithm was verified in a pair of studies involving a button pressing task and spatial discrepancies between ±150 mm and ±40°. Experimental results show that discrepant trials using the technique yield error rates and a number of speed peaks (representing the number of targeting movements) that are comparable to those attained in trials with zero spatial discrepancy. This result was also achieved without requiring a dedicated adaptation or training process, ensuring the algorithm can be used immediately by users. A pair of follow-up studies also indicates the algorithm has little impact on subjective ratings of simulator sickness, suggesting that sporadic use of the algorithm will not negatively affect user’s experience of a virtual environment. We believe that the visual guidance algorithm presented in this paper can be used to create more useful and compelling experiences in various haptic training applications incorporating encountered-type haptic displays.

ENTROPiA: Towards Infinite Surface Haptic Displays in Virtual Reality Using Encountered-Type Rotating Props

In this article, we propose an approach towards an infinite surface haptic display. Our approach, named ENcountered-Type ROtating Prop Approach (ENTROPiA) is based on a cylindrical spinning prop attached to a robot's end-effector serving as an encountered-type haptic display (ETHD). This type of haptic display permits the users to have an unconstrained, free-hand contact with a surface being provided by a robotic device for the users' to encounter a surface to be touched. In our approach, the sensation of touching a virtual surface is given by an interaction technique that couples with the sliding movement of the prop under the users' finger by tracking their hand location and establishing a path to be explored. This approach enables large motion for a larger surface rendering, permits to render multi-textured haptic feedback, and leverages the ETHD approach introducing large motion and sliding/friction sensations. As a part of our contribution, a proof of concept was designed for illustrating our approach. A user study was conducted to assess the perception of our approach showing a significant performance for rendering the sensation of touching a large flat surface. Our approach could be used to render large haptic surfaces in applications such as rapid prototyping for automobile design.