Human Haptic System Research Articles

An Overview of Wearable Haptic Technologies and Their Performance in Virtual Object Exploration.

We often interact with our environment through manual handling of objects and exploration of their properties. Object properties (OP), such as texture, stiffness, size, shape, temperature, weight, and orientation provide necessary information to successfully perform interactions. The human haptic perception system plays a key role in this. As virtual reality (VR) has been a growing field of interest with many applications, adding haptic feedback to virtual experiences is another step towards more realistic virtual interactions. However, integrating haptics in a realistic manner, requires complex technological solutions and actual user-testing in virtual environments (VEs) for verification. This review provides a comprehensive overview of recent wearable haptic devices (HDs) categorized by the OP exploration for which they have been verified in a VE. We found 13 studies which specifically addressed user-testing of wearable HDs in healthy subjects. We map and discuss the different technological solutions for different OP exploration which are useful for the design of future haptic object interactions in VR, and provide future recommendations.

Multimodal Haptic Display for Virtual Reality: A Survey

Human haptic perception system is complex, involving both cutaneous and kinesthetic receptors. These receptors work together and enable human to perceive the external world. To simulate immersive interaction with virtual objects in virtual reality scenarios haptic devices are desired to reproduce multiproperties of virtual objects, support multigestures of human hands to perform fine manipulation, produce haptic stimuli for simultaneously stimulating multireceptors (including cutaneous and kinesthetic receptors) of human haptic channel, and thus invoke realistic compound haptic sensations. In recent years, such multimodal haptic devices have emerged. In this paper, we survey the latest progress on multimodal haptic devices, identify the gaps, and put forward future research directions on the topic.

Bodywide fluctuations support manual exploration: Fractal fluctuations in posture predict perception of heaviness and length via effortful touch by the hand

The human haptic perceptual system respects a bodywide organization that responds to local stimulation through full-bodied coordination of nested tensions and compressions across multiple nonoverlapping scales. Under such an organization, the suprapostural task of manually hefting objects to perceive their heaviness and length should depend on roots extending into the postural control for maintaining upright balance on the ground surface. Postural sway of the whole body should thus carry signatures predicting what the hand can extract by hefting an object. We found that fractal fluctuations in Euclidean displacement in the participants' center of pressure (CoP) contributed to perceptual judgments by moderating how the participants' hand picked up the informational variable of the moment of inertia. The role of fractality in CoP displacement in supporting heaviness and length judgments increased across trials, indicating that the participants progressively implicate their fractal scaling in their perception of heaviness and length. Traditionally, we had to measure fractality in hand movements to predict perceptual judgments by manual hefting. However, our findings suggest that we can observe what is happening at hand in the relatively distant-from-hand measure of CoP. Our findings reveal the complex relationship through which posture supports manual exploration, entailing perception of the intended properties of hefted objects (heaviness or length) putatively through the redistribution of forces throughout the body.

Haptic Codecs for the Tactile Internet

The Tactile Internet will enable users to physically explore remote environments and to make their skills available across distances. An important technological aspect in this context is the acquisition, compression, transmission, and display of haptic information. In this paper, we present the fundamentals and state of the art in haptic codec design for the Tactile Internet. The discussion covers both kinesthetic data reduction and tactile signal compression approaches. We put a special focus on how limitations of the human haptic perception system can be exploited for efficient perceptual coding of kinesthetic and tactile information. Further aspects addressed in this paper are the multiplexing of audio and video with haptic information and the quality evaluation of haptic communication solutions. Finally, we describe the current status of the ongoing IEEE standardization activity P1918.1.1 which has the ambition to standardize the first set of codecs for kinesthetic and tactile information exchange across communication networks.

Modeling Touch and Palpation Using Autoregressive Models.

The human haptic system uses a set of reproducible and subconscious hand maneuvers to identify objects. Similar subconscious maneuvers are used during medical palpation for screening and diagnosis. The goal of this work was to develop a mathematical model that can be used to describe medical palpation techniques. Palpation data were measured using a two-dimensional array of force sensors. A novel algorithm for estimating the hand position from force data was developed. The hand position data were then modeled using multivariate autoregressive models. Analysis of these models provided palpation direction and frequency as well as palpation type. The models were tested and validated using three different data sets: simulated data, a simplified experiment in which participant followed a known pattern, and breast simulator palpation data. Simulated data showed that the minimal error in estimating palpation direction and frequency is achieved when the sampling frequency is five to ten times the palpation frequency. The classification accuracy was for the simplified experiment and for the breast simulator data. Proper palpation is one of the vital components of many hands-on clinical examinations. In this study, an algorithm for characterizing medical palpation was developed. The algorithm measured palpation frequency and direction for the first time and provided classification of palpation type. These newly developed models can be used for quantifying and assessing clinical technique, and consequently, lead to improved performance in palpation-based exams. Furthermore, they provide a general tool for the study of human haptics.

Adaptive GPU-accelerated force calculation for interactive rigid molecular docking using haptics

Molecular docking systems model and simulate in silico the interactions of intermolecular binding. Haptics-assisted docking enables the user to interact with the simulation via their sense of touch but a stringent time constraint on the computation of forces is imposed due to the sensitivity of the human haptic system. To simulate high fidelity smooth and stable feedback the haptic feedback loop should run at rates of 500Hz to 1kHz. We present an adaptive force calculation approach that can be executed in parallel on a wide range of Graphics Processing Units (GPUs) for interactive haptics-assisted docking with wider applicability to molecular simulations. Prior to the interactive session either a regular grid or an octree is selected according to the available GPU memory to determine the set of interatomic interactions within a cutoff distance. The total force is then calculated from this set. The approach can achieve force updates in less than 2ms for molecular structures comprising hundreds of thousands of atoms each, with performance improvements of up to 90 times the speed of current CPU-based force calculation approaches used in interactive docking. Furthermore, it overcomes several computational limitations of previous approaches such as pre-computed force grids, and could potentially be used to model receptor flexibility at haptic refresh rates.

On the Edge: Haptic Discrimination of Edge Sharpness

The increasing ubiquity of haptic displays (e.g., smart phones and tablets) necessitates a better understanding of the perceptual capabilities of the human haptic system. Haptic displays will soon be capable of locally deforming to create simple 3D shapes. This study investigated the sensitivity of our haptic system to a fundamental component of shapes: edges. A novel set of eight high quality shape stimuli with test edges that varied in sharpness were fabricated in a 3D printer. In a two alternative, forced choice task, blindfolded participants were presented with two of these shapes side by side (one the reference, the other selected randomly from the remaining set of seven) and after actively exploring the test edge of each shape with the tip of their index finger, reported which shape had the sharper edge. We used a model selection approach to fit optimal psychometric functions to performance data, and from these obtained just noticeable differences and Weber fractions. In Experiment 1, participants performed the task with four different references. With sharpness defined as the angle at which one surface meets the horizontal plane, the four JNDs closely followed Weber’s Law, giving a Weber fraction of 0.11. Comparisons to previously reported Weber fractions from other haptic manipulations (e.g. amplitude of vibration) suggests we are sufficiently sensitive to changes in edge sharpness for this to be of potential utility in the design of future haptic displays. In Experiment 2, two groups of participants performed the task with a single reference but different exploration strategies; one was limited to a single touch, the other unconstrained and free to explore as they wished. As predicted, the JND in the free exploration condition was lower than that in the single touch condition, indicating exploration strategy affects sensitivity to edge sharpness.

Haptic discrimination of different types of pencils during writing

Professional artists seem to develop a preference for certain types of pencils and paper (Akyuz 1995). While theaesthetic outcome may be the obvious reason for this preference, haptic feedback may also play a role in selecting media (Prytherch and Jerrard 2001, 2003). This suggestion implies that artists may be sensitive to vibrotactile signals resulting from the interaction between pencil and paper during drawing. Tribological tests showed that H-range leads generate more resistance than B-range pencils when writing on a standard 80 g/m2 paper. Moreover, a constant stimulus 2IFC procedure showed that Fine Arts students found it easier to discriminate between H-range and HB than B-range and an HB. This suggests that the human haptic system may be sensitive to the vibrotactile signals generated by the differences in resistance resulting from the interaction of leads with the paper's textured surface. Implications for pencil manufacturing and simulations of virtual writing are discussed. Statement of Relevance: The study assesses the tactile sensitivity of Fine Artists to the physical properties of the interaction between different types of lead and a standard printing paper. The results may help in designing more responsive drawing instruments as well as more realistic virtual drawing interfaces.

Perception-based lossy haptic compression considerations for velocity-based interactions

The ability of technology to transmit multi-media is very dependent on compression techniques. In particular lossy compression has been used in image compression (jpeg) audio compression (mp3) and video compression (mpg) to allow the transmission of audio and video over broadband network connections. Recently the sense of touch or haptics is becoming more important with its addition in computer games or in cruder applications such as vibrations in a cell phone. As haptic technology improves the ability to transmit compressed force sensations becomes more critical. Most lossy audio and visual compression techniques rely on the lack of sensitivity in humans to pick up detailed information in certain scenarios. Similarly limitations in the sensitivity of human touch could be exploited to create haptic models with much less detail and thus requiring smaller bandwidth. The focus of this paper is on the force thresholds of the human haptic system that can be used in a psychophysically motivated lossy haptic (force) compression technique. Most of the research in this field has measured the just noticeable difference (JND) of the human haptic system with a human user in static interaction with a stationary rigid object. In this paper our focus involves cases where the human user or the object are in relative motion. An example of such an application would be the haptic rendering of the user's hand in contact with of a high-viscous material or interacting with a highly deformable object. Thus an approach is presented to measure the force threshold based on the velocity of the user's hand motion. Two experiments are conducted to detect the absolute force threshold (AFT) of the human haptic system using methodologies from the field of psychophysics. The AFTs are detected for three different ranges of velocity of the user's hand motion. This study implies that when a user's hand is in motion fewer haptic details are required to be stored calculated or transmitted. Finally the implications of this study on a more complete future study will be discussed.

In vivo friction study of human skin: Influence of moisturizers on different anatomical sites

In order to understand the human haptic system, the mechanical characterization of skin contact is an important task. As the skin constitutes itself a surface, it is convenient to describe the problem using a contacting surface analysis, especially concerning the friction which occurs when the skin interacts with other surfaces. Several published works have shown that the analysis of the friction response of the skin can provide an indirect way to assess the skin condition. The present study uses a new approach to evaluate in vivo the human friction measured by direct sliding action with an increase of the normal load. Two moisturizer ointments, petrolatum and glycerin, were applied in two anatomical sites of the individual submitted to this study. In order to evaluate hydration effects, this study also incorporates a direct characterization of the moisture content measuring the transepidermal water loss (TEWL). The effect of the moisturizers as a function of time after the application was studied for different anatomical sites. The normal compression and the tangential forces were measured using a three-dimensional force sensor while slipping the skin over a spherical glass surface. The skin hydration was concomitantly monitored by measuring the TEWL.

Neural network models of haptic shape perception

Three different models of tactile shape perception inspired by the human haptic system were tested using an 8 d.o.f. robot hand with 45 tactile sensors. One model is based on the tensor product of different proprioceptive and tactile signals and a self-organizing map (SOM). The two other models replace the tensor product operation with a novel self-organizing neural network, the Tensor-Multiple Peak Self-Organizing Map (T-MPSOM). The two T-MPSOM models differ in the procedure employed to calculate the neural activation. The computational models were trained and tested with a set of objects consisting of hard spheres, blocks and cylinders. All the models learned to map different shapes to different areas of the SOM, and the tensor product model as well as one of the T-MPSOM models also learned to discriminate individual test objects.

High Fidelity Haptic Rendering

The human haptic system, among all senses, provides unique and bidirectional communication between humans and their physical environment. Yet, to date, most human-computer interactive systems have focused primarily on the graphical rendering of visual information and, to a lesser extent, on the display of auditory information. Extending the frontier of visual computing, haptic interfaces, or force feedback devices, have the potential to increase the quality of human-computer interaction by accommodating the sense of touch. They provide an attractive augmentation to visual display and enhance the level of understanding of complex data sets. They have been effectively used for a number of applications including molecular docking, manipulation of nano-materials, surgical training, virtual prototyping, and digital sculpting. Compared with visual and auditory display, haptic rendering has extremely demanding computational requirements. In order to maintain a stable system while displaying smooth and realistic forces and torques, high haptic update rates in the range of 500-1000 Hz or more are typically used. Haptics present many new challenges to researchers and developers in computer graphics and interactive techniques. Some of the critical issues include the development of novel data structures to encode shape and material properties, as well as new techniques for geometry processing, data analysis, physical modeling, and haptic visualization.

The Role of Haptics in Immersive Telecommunication Environments

This paper explores the role of haptics in immersive telecommunication applications and analyzes the contribution of haptics to the sense of presence in a variety of applications. Based on the concept of embodied presence, a new construct, resonance between the human cognitive-body system and the streaming sensory information from the environment, is suggested to be a principal factor in "presence." Resonance is defined as the level of mutual synergy between sensory information and action, relative to the physical environment. It occurs when the sensory flow supports action. Since the human haptic system is unique in that it both perceives sensations from the environment and acts on the environment, it has a central role in resonance and in presence. Haptics in the natural world supports efficient bodily action and, in a tacit way, supports development of higher reasoning skills. This requires resonance and embodied presence. The current visual-haptic gap between levels of technological development creates a bottleneck in developing fully tele-immersive applications.

Phantom-based haptic interaction with virtual objects

In 1993, haptic interaction with computers took a significant step forward with the development of the Phantom haptic interface. This simple device has spawned a new field analogous to computer graphics-computer haptics-defined as the discipline concerned with the techniques and processes associated with generating and displaying synthesized haptic stimuli to the human user. Inspired by the authors' previous work in interpreting robot touch sensor information and study of human touch perception, the Phantom interface permits users to feel the forces of interaction they would encounter while touching objects with the end of a stylus or the tip of their finger. The resulting sensations prove startling, and many first-time users are quite surprised at the compelling sense of physical presence they encounter when touching virtual objects. To appreciate why the Phantom system succeeded where others failed, you need to understand the nature and functioning of the human haptic system.

Formation of an Equivalence Class Incorporating Haptic Stimuli

Nine verbally competent adult participants (three male and six female) were exposed to a stimulus equivalence training procedure. Using a matching-to-sample procedure they learned to match three haptically perceived stimuli (B1, B2, and B3) to three nonsense syllables (A1, A2, and A3), and three different nonsense syllables (C1, C2, and C3) to the haptically perceived stimuli. The haptically perceived stimuli were three different wooden blocks each weighing 500 g, attached to cylindrical wooden handles 31 cm long and 2 cm in diameter. Participants perceived these stimuli by wielding them in their right hands for 5 sees. Eight participants successfully completed training, of these seven demonstrated that they had formed equivalence classes by responding with greater than 80% accuracy on tests for four emergent relations: B-A symmetry, C-B symmetry, A-C transitivity, and C-A combined symmetry and transitivity. These findings provide an empirical demonstration of the formation of equivalence classes involving stimuli perceived via the human haptic system and extend the applicability of the equivalence approach.

Toward a computational model of constraint-driven exploration and haptic object identification.

A conceptual model of the human haptic system in relation to object identification is presented. The model encompasses major architectural elements including representations of haptically accessible object properties and exploratory procedures (EPs)--dedicated movement patterns that are specialized to extract particular properties. These architectural units are related in processing-specific ways. Properties are associated with exploratory procedures in keeping with the extent to which a given procedure delivers information about a given property. The EPs are associated with one another in keeping with their compatibility, as determined by parameters of motor execution and interactions with the object and the workspace. The resulting architecture is treated as a system of constraints which guide the exploration of an object during the course of identification. The selection of the next step in a sequence of exploration requires that constraints be optimally satisfied. A network approach to constraint satisfaction is implemented and shown to account for a number of previous empirical results concerning the time course of exploration, object classification speed, and incidental learning about object properties. This system has potential applications for robotic haptic exploration.