Passive Touch Research Articles

Feeling senseless sensations: a crossmodal EEG study of mismatched tactile and visual experiences in virtual reality

Objective.To create highly immersive experiences in virtual reality (VR) it is important to not only include the visual sense but also to involve multimodal sensory input. To achieve optimal results, the temporal and spatial synchronization of these multimodal inputs is critical. It is therefore necessary to find methods to objectively evaluate the synchronization of VR experiences with a continuous tracking of the user.Approach.In this study a passive touch experience was incorporated in a visual-tactile VR setup using VR glasses and tactile sensations in mid-air. Inconsistencies of multimodal perception were intentionally integrated into a discrimination task. The participants' electroencephalogram (EEG) was recorded to obtain neural correlates of visual-tactile mismatch situations.Main results.The results showed significant differences in the event-related potentials (ERP) between match and mismatch situations. A biphasic ERP configuration consisting of a positivity at 120 ms and a later negativity at 370 ms was observed following a visual-tactile mismatch.Significance.This late negativity could be related to the N400 that is associated with semantic incongruency. These results provide a promising approach towards the objective evaluation of visual-tactile synchronization in virtual experiences.

Poster Session: Neural Correlates of the Visual Expectation of Active and Passive Touch.

The sense of touch is frequently paired with a visual stimulus that provides information on how the sensation will be experienced. This is true for both active touch-when a person moves to touch an object-and passive touch-when an object moves to touch a person. However, limited research has been conducted on how active and passive touch are processed by the cortex, as well as how prediction of the sensory experience influences that processing. Here, we use electroencephalography (EEG) to measure cortical activity while virtual reality creates the visual expectation of touching an object that is paired with vibrotactile feedback. In the active condition, the participant will reach toward and receive tactile input from the virtual object. In the passive condition, the virtual object will move toward and provide tactile input to the participant. This experiment will measure an electrophysiological phenomenon called the mismatch negativity (MMN), a distinct deflection in the EEG waveform shown to index a deviation from an established pattern in sensory stimuli. To elicit an MMN, we will manipulate the duration of the vibrotactile stimuli, with 80% being 100 ms long and 20% being 160 ms long. Our experiment is the first to assess the MMN in an active tactile context. Preliminary data (n=4) show a robust N1 component and MMN in response to active and passive touch. Further data collection is ongoing.

Friction and neuroimaging of active and passive tactile touch

Two types of exploratory touch including active sliding and passive sliding are usually encountered in the daily life. The friction behavior of the human finger against the surface of objects is important in tactile perception. The neural mechanisms correlating to tribological behavior are not fully understood. This study investigated the tactile response of active and passive finger friction characterized with functional near-infrared spectroscopy (fNIRS). The friction test and fNIRS test were performed simultaneously using the tactile stimulus of polytetrafluoroethylene (PTFE) specimens. Results showed that the sliding modes did not obviously influence the friction property of skin. While three cortex regions were activated in the prefrontal cortex (PFC), showing a higher activation level of passive sliding. This revealed that the tribological performance was not a simple parameter to affect tactile perception, and the difference in cortical hemodynamic activity of active and passive touch was also recognised. The movement-related blood flow changes revealed the role of PFC in integrating tactile sensation although there was no estimation task on roughness perception.

Faster Indentation Influences Skin Deformation To Reduce Tactile Discriminability of Compliant Objects.

To discriminate the compliance of soft objects, we rely upon spatiotemporal cues in the mechanical deformation of the skin. However, we have few direct observations of skin deformation over time, in particular how its response differs with indentation velocities and depths, and thereby helps inform our perceptual judgments. To help fill this gap, we develop a 3D stereo imaging method to observe contact of the skin's surface with transparent, compliant stimuli. Experiments with human-subjects, in passive touch, are conducted with stimuli varying in compliance, indentation depth, velocity, and time duration. The results indicate that contact durations greater than 0.4 s are perceptually discriminable. Moreover, compliant pairs delivered at higher velocities are more difficult to discriminate because they induce smaller differences in deformation. In a detailed quantification of the skin's surface deformation, we find that several, independent cues aid perception. In particular, the rate of change of gross contact area best correlates with discriminability, across indentation velocities and compliances. However, cues associated with skin surface curvature and bulk force are also predictive, for stimuli more and less compliant than skin, respectively. These findings and detailed measurements seek to inform the design of haptic interfaces.

S1 represents multisensory contexts and somatotopic locations within and outside the bounds of the cortical homunculus

Recent literature suggests that tactile events are represented in the primary somatosensory cortex (S1) beyond its long-established topography; in addition, the extent to which S1 is modulated by vision remains unclear. To better characterize S1, human electrophysiological data were recorded during touches to the forearm or finger. Conditions included visually observed physical touches, physical touches without vision, and visual touches without physical contact. Two major findings emerge from this dataset. First, vision strongly modulates S1 area 1, but only if there is a physical element to the touch, suggesting that passive touch observation is insufficient to elicit neural responses. Second, despite recording in a putative arm area of S1, neural activity represents both arm and finger stimuli during physical touches. Arm touches are encoded more strongly and specifically, supporting the idea that S1 encodes tactile events primarily through its topographic organization but also more generally, encompassing other areas of the body.

In-vehicle technology to prevent drunk driving: Public acceptance required for successful deployment

Drinking and driving contributes to between one-quarter and one-third of motor vehicle fatalities worldwide, resulting in an estimated 273,000 deaths annually (ITF, 2017). Over the years, multiple, mostly non–vehicle–based, countermeasures have been implemented to reduce deaths from drinking and driving. Despite their implementation and success, drunk driving continues on an unacceptable scale. In-vehicle technology like the Driver Alcohol Detection System for Safety (DADSS), which can prevent alcohol-impaired driving at the source, can be an important part of a safe system approach. In 2020, an online survey was conducted in the US, with 1001 subjects, about public acceptance of the development and deployment of in-vehicle technology. The results showed a positive acceptance of passive touch systems and breath systems. Limitations of this study and future challenges will be discussed.

'Contact' as a Manifestation of Sensorimotor Empathy: The Experience of Expert Écuyers in Interaction with Horses

Chemero's concept of sensorimotor empathy offers a relevant introduction to the study of human/non-human relationships. This article proposes an empirical characterization of this phenomenon occurring in human–horse interactions through the notion of 'contact', which is a core concept in the technical tradition of the equestrian world. According to the assumptions of 4E cognition, we approach the notion of contact with a broader meaning than how it is usually defined, i.e.as the connection of the rider's hand with the horse's mouth. We state that contact involves the whole body and that it is not a passive touch but a dynamic one. Contact is intersubjective, meaning that its quality depends on the two agents of the interaction: the human and the horse. Within such an interaction, sensorimotor empathy allows the human and the horse to understand through the body and to fine-tune with each other to bring about 'good contact'.

Sensory attenuation from action observation

A central claim of many embodied approaches to cognition is that understanding others' actions is achieved by covertly simulating the observed actions and their consequences in one's own motor system. If such a simulation occurs, it may be accomplished through forward models, a component of the motor system already known to perform simulations of actions and their consequences in order to support sensory-monitoring of one's own actions. Forward-model simulations cause an attenuation of sensory intensity, so if the simulations hypothesized by embodied cognition are indeed provided by forward models, then action observation should trigger this sensory attenuation. To test this hypothesis, the experiments reported here measured the perceived intensity of a touch sensation on the finger when participants observed an active touch (a finger reaching to touch a ball) vs. a passive touch (a ball rolling to touch an unmoving finger). The touch sensation was perceived as less intense during observation of active touch in comparison with observation of passive touch, providing evidence that forward models are indeed engaged during action observation. The strength of this sensory attenuation is compared and contrasted with a well-established sensory-amplification effect caused by visual attention. This sensory-amplification effect has not generally been considered in studies related to sensory attenuation in action observation, which may explain conflicting results reported in the field.

Enhancing touch sensibility by sensory retraining in a sensory discrimination task via haptic rendering.

Stroke survivors are commonly affected by somatosensory impairment, hampering their ability to interpret somatosensory information. Somatosensory information has been shown to critically support movement execution in healthy individuals and stroke survivors. Despite the detrimental effect of somatosensory impairments on performing activities of daily living, somatosensory training—in stark contrast to motor training—does not represent standard care in neurorehabilitation. Reasons for the neglected somatosensory treatment are the lack of high-quality research demonstrating the benefits of somatosensory interventions on stroke recovery, the unavailability of reliable quantitative assessments of sensorimotor deficits, and the labor-intensive nature of somatosensory training that relies on therapists guiding the hands of patients with motor impairments. To address this clinical need, we developed a virtual reality-based robotic texture discrimination task to assess and train touch sensibility. Our system incorporates the possibility to robotically guide the participants' hands during texture exploration (i.e., passive touch) and no-guided free texture exploration (i.e., active touch). We ran a 3-day experiment with thirty-six healthy participants who were asked to discriminate the odd texture among three visually identical textures –haptically rendered with the robotic device– following the method of constant stimuli. All participants trained with the passive and active conditions in randomized order on different days. We investigated the reliability of our system using the Intraclass Correlation Coefficient (ICC). We also evaluated the enhancement of participants' touch sensibility via somatosensory retraining and compared whether this enhancement differed between training with active vs. passive conditions. Our results showed that participants significantly improved their task performance after training. Moreover, we found that training effects were not significantly different between active and passive conditions, yet, passive exploration seemed to increase participants' perceived competence. The reliability of our system ranged from poor (in active condition) to moderate and good (in passive condition), probably due to the dependence of the ICC on the between-subject variability, which in a healthy population is usually small. Together, our virtual reality-based robotic haptic system may be a key asset for evaluating and retraining sensory loss with minimal supervision, especially for brain-injured patients who require guidance to move their hands.

Local Neuronal Responses to Intracortical Microstimulation in Rats' Barrel Cortex Are Dependent on Behavioral Context

The goal of cortical neuroprosthetics is to imprint sensory information as precisely as possible directly into cortical networks. Sensory processing, however, is dependent on the behavioral context. Therefore, a specific behavioral context may alter stimulation effects and, thus, perception. In this study, we reported how passive vs. active touch, i.e., the presence or absence of whisker movements, affects local field potential (LFP) responses to microstimulation in the barrel cortex in head-fixed behaving rats trained to move their whiskers voluntarily. The LFP responses to single-current pulses consisted of a short negative deflection corresponding to a volley of spike activity followed by a positive deflection lasting ~100 ms, corresponding to long-lasting suppression of spikes. Active touch had a characteristic effect on this response pattern. While the first phase including the negative peak remained stable, the later parts consisting of the positive peak were considerably suppressed. The stable phase varied systematically with the distance of the electrode from the stimulation site, pointing to saturation of neuronal responses to electrical stimulation in an intensity-dependent way. Our results suggest that modulatory effects known from normal sensory processing affect the response to cortical microstimulation as well. The network response to microstimulation is highly amenable to the behavioral state and must be considered for future approaches to imprint sensory signals into cortical circuits with neuroprostheses.

Individual Performance in Compliance Discrimination is Constrained by Skin Mechanics but Improved under Active Control.

Tactile acuity differs between individuals, likely a function of several interrelated factors. The extent of the impact of skin mechanics on individual differences is unclear. Herein, we investigate if differences in skin elasticity between individuals impact their ability to distinguish compliant spheres near limits of discriminability. After characterizing hyperelastic material properties of their skin in compression, the participants were asked to discriminate spheres varying in elasticity and curvature, which generate non-distinct cutaneous cues. Simultaneous biomechanical measurements were used to dissociate the relative contributions from skin mechanics and volitional movements in modulating individuals' tactile sensitivity. The results indicate that, in passive touch, individuals with softer skin exhibit larger gross contact areas and higher perceptual acuity. In contrast, in active touch, where exploratory movements are behaviorally controlled, individuals with harder skin evoke relatively larger gross contact areas, which improve and compensate for deficits in their acuity as observed in passive touch. Indeed, these participants exhibit active control of their fingertip movements that improves their acuity, amidst the inherent constraints of their less elastic finger pad skin.

Individual differences impacting skin deformation and tactile discrimination with compliant elastic surfaces.

Individual differences in tactile acuity are observed within and between age cohorts. Such differences in acuity may be attributed to various sources, including aspects of nervous system, skin mechanics, finger size, cognitive and behavioral factors, etc. This work considers individual differences, within a younger cohort of participants, in discriminating compliant surfaces. These participants exhibit a range of finger size and stiffness. Interestingly, both their finger size and stiffness well predict their discriminative performance, where softer/smaller fingers outperform stiffer/larger fingers. Stereo imaging captured biomechanical cues in the skin's deformation, including contact area and penetration depth, and their change rates. In those individuals with stiffer/larger fingers, who perceptually performed worse, we observed less distinguishable contact areas and eccentricities, compared to softer/smaller fingers. These particular cues well predicted individual differences observed in perceptual discrimination. In comparison, with two other cues, curvature and penetration depth, the imaging readily distinguished the compliant surfaces irrespective of finger stiffness/size, not aligned with discrimination. In conclusion, in passive touch, we find that individuals with softer/smaller fingers were better at discriminating compliances, and that certain skin deformation cues predict individual differences in perception.

Tactile Attention in One-to-One Performance: The effects of touch on participant experience

This article details the perceptual effects of physical contact during one-to-one performance. It considers the impact of sustained touch between a solo performer and an audience participant on the experience of the event in terms of self-awareness, collaborative exchange, and feelings of agency. Based on qualitative empirical data, Esling examines how the invitations of both active and passive touch work to enhance tactile attention for the audience participant, evaluating the implications of this heightened awareness on the psychophysical and affective experience of a one-to-one encounter in a performative context. This research is based on comparative data generated through a Practice-Based Research framework designed to test empirically the effects of sense-specific manipulations in immersive, one-to-one performance. Based on the tactile dramaturgy of All Good Things (2013), a work by Canadian company Vertical City, Esling developed a micro-performance to be experienced by random audience participants either with or without physical contact. In the control performances, participants listened to a performer tell an affective narrative without touch, yet in close proximity. In intervention performances, the participant held hands and touched knees with the performer. In both scenarios, participants completed a brief interview and written survey immediately following their experience. This research contributes to knowledge about how physical contact—as a dramaturgical strategy—shapes feelings of agency, attention, affect and bodily awareness, and performer–participant connection in one-to-one performance.

Constraints on the deformation of the vibrissa within the follicle

Nearly all mammals have a vibrissal system specialized for tactile sensation, composed of whiskers growing from sensor-rich follicles in the skin. When a whisker deflects against an object, it deforms within the follicle and exerts forces on the mechanoreceptors inside. In addition, during active whisking behavior, muscle contractions around the follicle and increases in blood pressure in the ring sinus will affect the whisker deformation profile. To date, however, it is not yet possible to experimentally measure how the whisker deforms in an intact follicle or its effects on different groups of mechanoreceptors. The present study develops a novel model to predict vibrissal deformation within the follicle sinus complex. The model is based on experimental results from a previous ex vivo study on whisker deformation within the follicle, and on a new histological analysis of follicle tissue. It is then used to simulate whisker deformation within the follicle during passive touch and active whisking. Results suggest that the most likely whisker deformation profile is “S-shaped,” crossing the midline of the follicle right below the ring sinus. Simulations of active whisking indicate that an increase in overall muscle stiffness, an increase in the ratio between deep and superficial intrinsic muscle stiffness, and an increase in sinus blood pressure will all enhance tactile sensitivity. Finally, we discuss how the deformation profiles might map to the responses of primary afferents of each mechanoreceptor type. The mechanical model presented in this study is an important first step in simulating mechanical interactions within whisker follicles.

An elasticity-curvature illusion decouples cutaneous and proprioceptive cues in active exploration of soft objects.

Our sense of touch helps us encounter the richness of our natural world. Across a myriad of contexts and repetitions, we have learned to deploy certain exploratory movements in order to elicit perceptual cues that are salient and efficient. The task of identifying optimal exploration strategies and somatosensory cues that underlie our softness perception remains relevant and incomplete. Leveraging psychophysical evaluations combined with computational finite element modeling of skin contact mechanics, we investigate an illusion phenomenon in exploring softness; where small-compliant and large-stiff spheres are indiscriminable. By modulating contact interactions at the finger pad, we find this elasticity-curvature illusion is observable in passive touch, when the finger is constrained to be stationary and only cutaneous responses from mechanosensitive afferents are perceptible. However, these spheres become readily discriminable when explored volitionally with musculoskeletal proprioception available. We subsequently exploit this phenomenon to dissociate relative contributions from cutaneous and proprioceptive signals in encoding our percept of material softness. Our findings shed light on how we volitionally explore soft objects, i.e., by controlling surface contact force to optimally elicit and integrate proprioceptive inputs amidst indiscriminable cutaneous contact cues. Moreover, in passive touch, e.g., for touch-enabled displays grounded to the finger, we find those spheres are discriminable when rates of change in cutaneous contact are varied between the stimuli, to supplant proprioceptive feedback.

Effects of visual and auditory cues on haptic illusions for active and passive touches in mixed reality

The haptic illusion literature suggests that individuals’ haptic experiences rely not only on tactile signals, but on visual and auditory stimulation as well. Given that mixed reality (MR) technologies often harness realistic visual and auditory but not haptic stimulation, it is important to understand how visual and auditory signals shape haptic experiences. We examined whether visual and auditory cues in MR can enhance tactile sensation, including perceptions of roughness and stiffness on virtual gadgets, in the absence of haptic signals. A laboratory experiment showed that tactile perception of mobile gadgets in motion was influenced by both visual and auditory cues when the motion of the gadget was generated by participants (i.e., active touch), but only by auditory cues when participants observed the gadget moving (i.e., passive touch). The results indicate that visual and auditory cues can be employed to facilitate haptic experiences of virtual objects in virtual reality, with auditory cues being potentially applicable to a broader context than visual cues.

Experience-driven remodeling of S1 digit representation in awake monkeys: the challenge of comparing active and passive touch

Many studies have compared active and passive touch to understand how motor action shapes touch perception. Current views emphasize the difficulties in making such a comparison and promote investigating how motor strategies enable the filtering out of sensory inputs to reshape touch perception. Cybulska-Klosowicz et al. (Cybulska-Klosowicz A, Tremblay F, Jiang W, Bourgeon S, Meftah E-M, Chapman CE. J Neurophysiol 123: 1072-1089, 2020) suggest that primary somatosensory (S1) cortical remodeling of digit representation occurs during active touch. Here, alternative interpretations are proposed, and the relevance of studying multidigit scanning is emphasized.

Proprioceptively displayed interfaces: aiding non-visual on-body input through active and passive touch

On-body input interfaces that can be used accurately without visual attention could have a wide range of applications where vision is needed for a primary task: emergency responders, pilots, astronauts, and people with vision impairments could benefit by making interfaces accessible. This paper describes a between-participant study (104 participants) to determine how well users can locate e-textile interface discrete target touch points on the forearm without visual attention. We examine whether the addition of active touch embroidery and passive touch nubs (metal snaps with vibro-tactile stimulation) helps in locating input touch points accurately. We found that touch points towards the middle of the interface on the forearm were more difficult to touch accurately than at the ends. We also found that the addition of vibro-tactile stimulation aids in the accuracy of touch interactions by over 9% on average, and by almost 17% in the middle of the interface.

Friction sensing mechanisms for perception and motor control: passive touch without sliding may not provide perceivable frictional information.

Perception of the frictional properties of a surface contributes to the multidimensional experience of exploring various materials; we slide our fingers over a surface to feel it. In contrast, during object manipulation, we grip objects without such intended exploratory movements. Given that we are aware of the slipperiness of objects or tools that are held in the hand, we investigated whether the initial contact between the fingertip skin and the surface of the object is sufficient to provide this consciously perceived frictional information. Using a two-alternative forced-choice protocol, we examined human capacity to detect frictional differences using touch, when two otherwise structurally identical surfaces were brought in contact with the immobilized finger perpendicularly or under an angle (20° or 30°) to the skin surface (passive touch). An ultrasonic friction reduction device was used to generate three different frictions over each of three flat surfaces with different surface structure: 1) smooth glass, 2) textured surface with dome-shaped features, and 3) surface with sharp asperities (sandpaper). Participants (n = 12) could not reliably indicate which of the two surfaces was more slippery under any of these conditions. In contrast, when slip was induced by moving the surface laterally by a total of 5 mm (passive slip), participants could clearly perceive frictional differences. Thus making contact with the surface, even with moderate tangential forces, was not enough to perceive frictional differences, instead conscious perception required a sufficient size slip.NEW & NOTEWORTHY This study contributes to understanding how frictional information is obtained and used by the brain. When the skin is contacting surfaces of identical topography but varying frictional properties, the deformation pattern is different; however, available sensory cues did not get translated into perception of frictional properties unless a sufficiently large lateral movement was present. These neurophysiological findings may inform how to design and operate haptic devices relying on friction modulation principles.

Synthesizing the Roughness of Textured Surfaces for an Encountered-Type Haptic Display Using Spatiotemporal Encoding.

Encountered-type haptic rendering provides realistic, free-to-touch, and move-and-collide haptic sensation to a user. However, inducing haptic-texture sensation without complicated tactile actuators is challenging for encountered-type haptic rendering. In this article, we propose a novel texture synthesizing method for an encountered-type haptic display using spatial and temporal encoding of roughness, which provides both active and passive touch sensation requiring no complicated tactile actuation. Focused on macro-scale roughness perception, we geometrically model the textured surface with a grid of hemiellipsoidal bumps, which can provide a variety of perceived roughness as the user explores the surface with one's bare hand. Our texture synthesis method is based on two important hypotheses. First, we assume that perceptual roughness can be spatially encoded along the radial direction of a textured surface with hemiellipsoidal bumps. Second, perceptual roughness temporally varies with the relative velocity of a scanning human hand with respect to the surface. To validate these hypotheses on our spatiotemporal encoding method, we implemented an encountered-type haptic texture rendering system using an off-the-shelf collaborative robot that can also track the user's hand using IR sensors. We performed psychophysical user tests with 25 participants and verified the main effects of spatiotemporal encoding of a textured model on the user's roughness perception. Our empirical experiments imply that the users perceive a more rough texture as the surface orientation or the relative hand motion increases. Based on these findings, we show that our visuo-haptic system can synthesize an appropriate level of roughness corresponding to diverse visual textures by suitably choosing encoding values.