Desktop Haptic Device Research Articles

Study of the Effectiveness of a Wearable Haptic Interface With Cutaneous and Vibrotactile Feedback for VR-Based Teleoperation.

The control principle of teleoperated robotic systems is often not very intuitive, resulting in substantial cognitive load for the operator. Besides, the teleoperation of robotic systems requires stable and convenient visual feedback for the operator. Better spatio-temporal robot coordination can be achieved by providing the operator with high-fidelity multimodal haptic feedback. Using the advantages of virtual reality (VR) and haptic technology, we can improve the quality of teleoperation and increase the level of user involvement when operating the system. This article focuses on studying the effectiveness of the developed wearable haptic interface, vDeltaGlove, that provides multimodal haptic feedback when controlling a robotic arm through a virtual environment (VE). We evaluated the performance of vDeltaGlove in the series of teleoperation tasks. vDeltaGlove interface showed comparable characteristics with the Omega.7 desktop haptic device in terms of accuracy and outreached the performance of operation with VIVE controller. Besides, the developed interface showed the superior evaluation in terms of user experience. The proposed technology suggests a novel way of human-robot interaction (HRI) to achieve intuitive and immersive robot control.

Differences in coordination between dominant and non-dominant hands in tele-operation.

The intuitive tele-operation of industrial robot arms is necessary for the teaching of autonomous movement. We developed a novel interface, namely the iFeel Desktop Haptic Device, for operating robots intuitively. However, when a user uses two interfaces with two hands, there are differences in coordination between the dominant and non-dominant hands. In this paper, we investigated the differences in coordination between dominant and non-dominant hands using two devices for the development of cooperative control. In an experiment, when the participants manipulated the two interfaces to operate a virtual tracking system, we measured the tracking error in each degree of freedom (i.e., X, Y, Z, pitch, yaw, and roll directions). The results show that there were significant differences between the dominant and non-dominant hands for movement in the X, Y, Z, and pitch directions. We conclude that the operations that involve more body parts have a greater difference between dominant and non-dominant hands.

Haptic Zoom: An Interaction Model for Desktop Haptic Devices with Limited Workspace

Haptic devices can be used to feel through the sense of touch what the user is watching in a virtual scene. Force feedback devices provide kinesthetic information enabling the user to touch virtual objects. However, the most reasonably priced devices of this type are the desktop ones, which have a limited workspace that does not allow a natural and convenient interaction with virtual scenes due to the difference in size between them and the workspace. In this paper, a brand-new interaction model addressing this problem is proposed. It is called Haptic Zoom and it is based on performing visual and haptic amplifications of regions of interest. These amplifications allow the user to decide whether s/he wants more freedom in movements or an accurate interaction with a specific element inside the scene. An evaluation has been carried out comparing this technique and two well-known desktop haptic device techniques. Preliminary results showed that haptic zoom can be more useful than other techniques at accuracy tasks.

Haptic Decorating on the Surface of Virtual Clay Model

A novel haptic decorating method on the surface of virtual clay model is proposed. The relationship between brush deformation and endured force is researched for the first time by applying the spring-mass model to construct the 3D brush model. Then, the collision detection between virtual hairy brush and virtual clay model is researched based on collision algorithm of weighted average distance. When the hairy brush initially collides with 3D exterior, the tactility is simulated and the interactive virtual painting on the 3D exterior is carried out practically. The 3D brush stroke is formed by superimposing 3D brush footprints along the painting direction and controlling the stress of the brush. The ink quantity in the brush footprint is determined according to the proposed positive correlation between the exerted pressure on brush and outflow ink quantity of the brush. A painting storage method is also presented for storing and displaying 3D stroke painting results. The proposed method has been successfully applied in the 3D virtual painting system based on real-time force feedback technology. With this system, the 3D brush strokes with 3D half-dry and ink diffusion results can be painted with a Phantom Desktop haptic device, which effectively enhance reality to users.

A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technology

A novel 3D interactive painting method for Chinese calligraphy and painting based on force feedback technology is proposed. The relationship between the force exerted on the brush and the resulting brush deformation is analyzed and a spring-mass model is used to build a model of the 3D Chinese brush. The 2D brush footprint between the brush and the plane of the paper or object is calculated according to the deformation of the 3D brush when force is exerted on the 3D brush. Then the 3D brush footprint is obtained by projecting the 2D brush footprint onto the surface of the 3D object in real time, and a complete 3D brushstroke is obtained by superimposing 3D brush footprints along the painting direction. The proposed method has been successfully applied in a virtual 3D interactive drawing system based on force feedback technology. In this system, users can paint 3D brushstrokes in real time with a Phantom Desktop haptic device, which can effectively serve as a virtual reality interface to the simulated painting environment for users.

A prototype telerobotic platform for live transmission line maintenance: Review of design and development

This paper reports technical design of a novel experimental test facility, using haptic-enabled teleoperation of robotic manipulators, for live transmission line maintenance. The goal is to study and develop appropriate techniques in repair overhead power transmission lines by allowing linemen to wirelessly guide a remote manipulator, installed on a crane bucket, to execute dexterous maintenance tasks, such as twisting a tie wire around a cable. Challenges and solutions for developing such a system are outlined. The test facility consists of a PHANToM Desktop haptic device (master site), an industrial hydraulic manipulator (slave site) mounted atop a Stewart platform, and a wireless communication channel connecting the master and slave sites. The teleoperated system is tested under different force feedback schemes, while the base is excited and the communication channel is delayed and/or lossy to emulate realistic network behaviors. The force feedback schemes are: virtual fixture, augmentation force and augmented virtual fixture. Performance of each scheme is evaluated under three measures: task completion time, number of failed trials and displacement of the slave manipulator end-effector. The developed test rig has been shown to be successful in performing haptic-enabled teleoperation for live-line maintenance in a laboratory setting. The authors aim at establishing a benchmark test facility for objective evaluation of ideas and concepts in the teleoperation of live-line maintenance tasks.

Desktop Haptic Interface for Simulation of Hand-Tremor.

This paper presents a haptic system that is conceived to support the design process of a class of products or services in order to make them more accessible to people affected by hand tremor diseases. The main aim is to foster the designer empathy allowing her/him to directly feel the effect of the impairment in first person. Specifically, a desktop haptic device is employed to induce a programmable hand-tremor, that is typically observed in people affected by some kind of neurological diseases, on healthy subjects (i.e., the designers). The developed tool is based on a wrist-attached haptic interface with a workspace that is comparable to that of the arm of the user. Such device is able to exert controlled forces on the user's wrist and induces a hand-tremor whose frequency and amplitude are correlated with those measured on impaired people. The control of the device is based on a custom trajectory-tracking algorithm that takes as input tremor signals that are acquired on patients using an optical motion tracking system. In this paper, we present the employed haptic system, the structure of the control system and the experimental validation of the controller done through the acquisition of data on six patients affected by Parkinson's disease.

The Simulation of the Brush Stroke Based on Force Feedback Technology

A novel simulation method of the brush stroke is proposed by applying force feedback technology to the virtual painting process. The relationship between force and the brush deformation is analyzed, and the spring-mass model is applied to construct the brush model, which can realistically simulate the brush morphological changes according to the force exerted on it. According to the deformation of the brush model at a sampling point, the brush footprint between the brush and the paper is calculated in real time. Then, the brush stroke is obtained by superimposing brush footprints along sampling points, and the dynamic painting of the brush stroke is implemented. The proposed method has been successfully applied to the virtual painting system based on the force feedback technology. In this system, users can implement the painting in real time with a Phantom Desktop haptic device, which can effectively enhance reality to users.

Haptics Assisted Virtual Assembly

Assembly is one of the most vital processes in manufacturing, and it has been extensively studied. Virtual reality systems are becoming eminent to simulate, analyze, and optimize the assembly process. During the design phase of product development cycle, even before any physical prototype is created, haptic technologies empower the user to feel the force feedback from the digital world, resulting into a more intuitive way to simulate the assembly process. This research explains the development of a haptic virtual reality platform to plan, perform, and assess virtual assemblies. The system permits realtime handling and interaction of virtual components. The practicability of using a desktop haptic virtual environment as a design tool for assessing assembly operations is investigated. The system combines various software packages including OpenHaptics, PhysX, and OpenGL/GLUT libraries to explore the advantages and limitations of combining haptics with physically based modelling. Single-handed force feedback is obtained through Phantom Desktop haptic device. A case study of blower house assembly is performed to assess the ability of system to handle complex part interactions.

A New Redundant-DOF Wearable Master Device with Force Feedback

In this paper, a new redundant degree-of-freedom wearable haptic device is developed and presented, which combines the advantages of the arm exoskeleton and the desktop haptic device. The haptic device has capabilities of large working space and high stiffness, the design of the wearable can reduce operators’ fatigue and increase the comfort of the operation. This paper also includes the analysis of workspace based on the kinematic analysis. Dynamics model of the haptic device has been established to get the torques of the driven motors of every joint. Lately, the virtual prototype model was established in ADAMS to get the simulations results, which lays the foundation for further force-feedback experiments.

A new desk-top encounter-type haptic device with an actively driven pen-tablet LCD panel

In conventional haptic devices for virtual reality (VR) systems, a user interacts with a scene by handling a tool (such as a pen) using a mechanical device (i.e. an end-effector-type haptic device). In the case that the device can ‘mimic’ a VR object, the user can interact directly with the VR object without the mechanical constraint of a device (i.e. an encounter-type haptic device). A new challenge of an encounter-type haptic device is displaying the visuals and haptic information simultaneously on a single device. We are proposing a new desk-top encounter-type haptic device with an actively driven pen-tablet LCD panel. The proposed device is capable of providing pseudo-3D visuals and haptic information on a single device. As the result, the system provides to the user a sense of interaction with a real object. To develop a proof-of-concept prototype, a compact parallel mechanism was developed and implemented. The aim of this research is to propose a new concept in haptic research. In this paper, the concept, the prototype, and some preliminary evaluation tests with the proposed system are presented.