Tactile Cues Research Articles

Transfer of Tactile Learning to Untrained Body Parts: Emerging Cortical Mechanisms.

Pioneering investigations in the mid-19th century revealed that the perception of tactile cues presented to the surface of the skin improves with training, which is referred to as tactile learning. Surprisingly, tactile learning also occurs for body parts and skin locations that are not physically involved in the training. For example, after training of a finger, tactile learning transfers to adjacent untrained fingers. This suggests that the transfer of tactile learning follows a somatotopic pattern and involves brain regions such as the primary somatosensory cortex (S1), in which the trained and untrained body parts and skin locations are represented close to each other. However, other results showed that transfer occurs between body parts that are not represented close to each other in S1-for example, between the hand and the foot. These and similar findings have led to the suggestion of additional cortical mechanisms to explain the transfer of tactile learning. Here, different mechanisms are reviewed, and the extent to which they can explain the transfer of tactile learning is discussed. What all of these mechanisms have in common is that they assume a representational or functional relationship between the trained and untrained body parts and skin locations. However, none of these mechanisms alone can explain the complex pattern of transfer results, and it is likely that different mechanisms interact to enable transfer, perhaps in concert with higher somatosensory and decision-making areas.

A Crayfish-Inspired Sensor Fusion Platform for Super Additive Integration of Visual, Chemical, and Tactile Information.

The concept of cross-sensor modulation, wherein one sensor modality can influence another's response, is often overlooked in traditional sensor fusion architectures, leading to missed opportunities for enhancing data accuracy and robustness. In contrast, biological systems, such as aquatic animals like crayfish, demonstrate superior sensor fusion through multisensory integration. These organisms adeptly integrate visual, tactile, and chemical cues to perform tasks such as evading predators and locating prey. Drawing inspiration from this, we propose a neuromorphic platform that integrates graphene-based chemitransistors, monolayer molybdenum disulfide (MoS2) based photosensitive memtransistors, and triboelectric tactile sensors to achieve "Super-Additive" responses to weak chemical, visual, and tactile cues and demonstrate contextual response modulation, also referred to as the "Inverse Effectiveness Effect." We hold the view that integrating bio-inspired sensor fusion principles across various modalities holds promise for a wide range of applications.

Comparison of externally and internally guided dance movement to address mobility, cognition, and psychosocial function in people with Parkinson's disease and freezing of gait: a case series.

The aim of this study is to explore the impact of internally guided (IG) versus externally guided (EG) adapted tango (AT) dance training (i.e., dancing the IG "Leader" role or the EG "Follower" role), on motor and non-motor functions in individuals with Parkinson's disease and freezing of gait (PD-FOG). The "Leader" role, a proxy for IG movements, conveys direction, timing, and amplitude of steps with tactile cues. The "Follower" role, a proxy for EG movements, detects and responds to the leader's tactile cues. Six participants were randomly assigned to the IG ("Leader") or EG ("Follower") roles for 20, 90-min AT lessons over 12 weeks. Participants were assessed for PD-specific and non-PD-specific functions before and twice after the end of the 12-week intervention, at 1-week and 1-month post-intervention. EG participants improved and/or maintained performance on more outcomes across all domains than IG participants. Five participants improved in PD motor symptoms, dynamic gait, global cognitive function, and the FOG Questionnaire immediately or 1 month after intervention. All participants expressed positive attitudes toward the intervention, including improvements in walking, balance, and endurance. AT training in the follower role may benefit individuals with PD-FOG to a greater extent compared to the leader role. This case series study could inform additional research with the goal of enhancing physical therapy or music-based therapy approaches for addressing PD-FOG.

Hey, What's Going On?

Highly Automated Vehicles offer a new level of independence to people who are blind or visually impaired. However, due to their limited vision, gaining knowledge of the surrounding traffic can be challenging. To address this issue, we conducted an interactive, participatory workshop (N=4) to develop an auditory interface and OnBoard- a tactile interface with expandable elements - to convey traffic information to visually impaired people. In a user study with N=14 participants, we explored usability, situation awareness, predictability, and engagement with OnBoard and the auditory interface. Our qualitative and quantitative results show that tactile cues, similar to auditory cues, are able to convey traffic information to users. In particular, there is a trend that participants with reduced visual acuity showed increased engagement with both interfaces. However, the diversity of visual impairments and individual information needs underscores the importance of a highly tailored multimodal approach as the ideal solution.

Tactile cues compensate for unbalanced vestibular cues during progression on inclined surfaces

A previous study demonstrated that rodents on an inclined square platform traveled straight vertically or horizontally and avoided diagonal travel. Through behavior they aligned their head with the horizontal plane, acquiring similar bilateral vestibular cues – a basic requirement for spatial orientation and a salient feature of animals in motion. This behavior had previously been shown to be conspicuous in Tristram's jirds. Here, therefore jirds were challenged by testing their travel behavior on a circular arena inclined at 0°-75°. Our hypothesis was that if, as typical to rodents, the jirds would follow the curved arena wall, they would need to display a compensating mechanism to enable traveling in such a path shape, which involves a tilted frontal head axis and unbalanced bilateral vestibular cues. We found that with the increase in inclination, the jirds remained more in the lower section of the arena (geotaxis). When tested on the steep inclinations, however, their travel away from the arena wall was strictly straight up or down, in contrast to the curved paths that followed the circular arena wall. We suggest that traveling along a circular path while maintaining contact with the wall (thigmotaxis), provided tactile information that compensated for the unbalanced bilateral vestibular cues present when traveling along such curved inclined paths. In the latter case, the frontal plane of the head was in a diagonal posture in relation to gravity, a posture that was avoided when traveling away from the wall.

Sensory perception of rivals has trait-dependent effects on plasticity in Drosophila melanogaster.

The social environment has myriad effects on individuals, altering reproduction, immune function, cognition, and aging. Phenotypic plasticity enables animals to respond to heterogeneous environments such as the social environment but requires that they assess those environments accurately. It has been suggested that combinations of sensory cues allow animals to respond rapidly and accurately to changeable environments, but it is unclear whether the same sensory inputs are required in all traits that respond to a particular environmental cue. Drosophila melanogaster males, in the presence of rival males, exhibit a consistent behavioral response by extending mating duration. However, exposure to a rival also results in a reduction in their lifespan, a phenomenon interpreted as a trade-off associated with sperm competition strategies. D. melanogaster perceive their rivals by using multiple sensory cues; interfering with at least two olfactory, auditory, or tactile cues eliminates the extension of mating duration. Here, we assessed whether these same cues were implicated in the lifespan reduction. Removal of combinations of auditory and olfactory cues removed the extended mating duration response to a rival, as previously found. However, we found that these manipulations did not alter the reduction in lifespan of males exposed to rivals or induce any changes in activity patterns, grooming, or male-male aggression. Therefore, our analysis suggests that lifespan reduction is not a cost associated with the behavioral responses to sperm competition. Moreover, this highlights the trait-specific nature of the mechanisms underlying plasticity in response to the same environmental conditions.

Exploring the effect of fingertip aero-haptic feedforward cues in directing eyes-free target acquisition in VR

BackgroundThe sense of touch plays a crucial role in interactive behavior within virtual spaces, particularly when visual attention is absent. Although haptic feedback has been widely used to compensate for the lack of visual cues, the use of tactile information as a predictive feedforward cue to guide hand movements remains unexplored and lacks theoretical understanding. MethodsThis study introduces a fingertip aero-haptic rendering method to investigate its effectiveness in directing hand movements during eyes-free spatial interactions. The wearable device incorporates a multichannel micro-airflow chamber to deliver adjustable tactile effects on the fingertips. ResultsThe first study verified that tactile directional feedforward cues significantly improve user capabilities in eyes-free target acquisition and that users rely heavily on haptic indications rather than spatial memory to control their hands. A subsequent study examined the impact of enriched tactile feedforward cues on assisting users in determining precise target positions during eyes-free interactions, and assessed the required learning efforts. ConclusionsThe haptic feedforward effect holds great practical promise in eyeless design for virtual reality. We aim to integrate cognitive models and tactile feedforward cues in the future, and apply richer tactile feedforward information to alleviate users' perceptual deficiencies.

Multimodal zero-shot learning for tactile texture recognition

Tactile sensing plays an irreplaceable role in robotic material recognition. It enables robots to distinguish material properties such as their local geometry and textures, especially for materials like textiles. However, most tactile recognition methods can only classify known materials that have been touched and trained with tactile data, yet cannot classify unknown materials that are not trained with tactile data. To solve this problem, we propose a tactile Zero-Shot Learning framework to recognise materials when they are touched for the first time, using their visual and semantic information, without requiring tactile training samples. The biggest challenge in tactile Zero-Shot Learning is to recognise disjoint classes between training and test materials, i.e., the test materials that are not among the training ones. To bridge this gap, the visual modality, providing tactile cues from sight, and semantic attributes, giving high-level characteristics, are combined together and act as a link to expose the model to these disjoint classes. Specifically, a generative model is learnt to synthesise tactile features according to corresponding visual images and semantic embeddings, and then a classifier can be trained using the synthesised tactile features for zero-shot recognition. Extensive experiments demonstrate that our proposed multimodal generative model can achieve a high recognition accuracy of 83.06% in classifying materials that were not touched before. The robotic experiment demo and the FabricVST dataset are available at https://sites.google.com/view/multimodalzsl.

Effects of Verbal and Tactile Cues on Gluteal Force Production and Broad Jump Distance.

Verbal and tactile cues can increase muscle activity, force production, and kinematics. Several studies demonstrate the effects of verbal and tactile cues on upper extremity muscles, while relatively few examined lower extremity muscles, specifically the gluteals. Studies that observed changes in gluteal function from verbal and tactile cues examined muscle activity via electromyography rather than force production or functional activities such as jumping. The purpose of this study was to measure the effects of verbal and tactile cues on gluteal force production and broad jump distance. Cross-Sectional cohort. Gluteus maximus force production and broad jump distance were tested in forty-two healthy male and female university students at baseline and after verbal and tactile cues given in random order. Gluteus maximus force was measured using handheld dynamometry and reported in kilograms. Verbal cues included "push, push, push" before both tests. The examiner provided tactile cues to the gluteus maximus before force production testing, and the participant provided tactile cues to both gluteus maximus muscles before performing the broad jump. Performance on the broad jump was measured in centimeters. Descriptive statistics and test-retest reliability via Pearson correlation coefficients were calculated, differences in performance between sexes were analyzed with an independent t-test, and changes in force production and jump distance from baseline were analyzed using a one-way ANOVA. Mean gluteus maximus force production following verbal cues significantly increased (p = 0.000) by 13.48% (3.83 kg) compared to the control condition, while gluteal force production following the tactile cues was not significantly different. Broad jump distance following the verbal cues significantly increased (p = 0.000) 3.99% (7.71 cm) compared to the control condition and significantly increased (p = 0.000) by 2.95% (5.71 cm) following the tactile cues. There were no significant differences in performances between males and females. The test-retest reliability of all measurements was 0.97-0.99. Verbal cues significantly increased gluteus maximus force production and broad jump distance. Tactile cues significantly increased broad jump distance but had no significant effect on gluteus maximus force. These results have implications for clinical testing and athletic performance when gluteus maximus force and jump distance are concerned. 3.

Data-Driven 3-D Tactile Cues With Intermediate Soft Interfaces Toward Training Needle Insertions

Data-Driven 3-D Tactile Cues With Intermediate Soft Interfaces Toward Training Needle Insertions

The multichannel vibrotactile gloves: A transmodal technology to feel sound through touch

Development of devices for transmitting sounds through touch is motivated by needs coming from diverse disciplines. Hard-of-hearing individuals could benefit from vibrations to overcome the limitations of existing hearing technologies. Adding tactile cues can be useful for all in contexts where the acoustic information is limited due to sounds coming from multiple sources or noise. The potential sensory augmentation provided by the technology is also interesting in an entertainment context in order to offer immersive experiences. A transdisciplinary approach based on a framework recently developed in our laboratory was used to design this technology that enables the transmission of acoustic signals through touch. Validation experiments were carried out via electro-acoustic measurements as well as behavioral measurements in human subjects (n = 5). Electro-acoustic and behavioral measures support that the system provides uniform stimulation across hands and actuators. The frequency response curve as well as the summation effect measured via behavioral threshold measurements support that the tactile receptors are accurately stimulated by the devices. The multichannel vibrotactile gloves offer the flexibility to transmit diverse acoustic features to individual actuators, making them a valuable tool for research and a prospective technology capable of substituting, compensating, or extending sensory perception.

Auditory influence on stickiness perception: an fMRI study of multisensory integration.

This study explored how the human brain perceives stickiness through tactile and auditory channels, especially when presented with congruent or incongruent intensity cues. In our behavioral and functional MRI (fMRI) experiments, we presented participants with adhesive tape stimuli at two different intensities. The congruent condition involved providing stickiness stimuli with matching intensity cues in both auditory and tactile channels, whereas the incongruent condition involved cues of different intensities. Behavioral results showed that participants were able to distinguish between the congruent and incongruent conditions with high accuracy. Through fMRI searchlight analysis, we tested which brain regions could distinguish between congruent and incongruent conditions, and as a result, we identified the superior temporal gyrus, known primarily for auditory processing. Interestingly, we did not observe any significant activation in regions associated with somatosensory or motor functions. This indicates that the brain dedicates more attention to auditory cues than to tactile cues, possibly due to the unfamiliarity of conveying the sensation of stickiness through sound. Our results could provide new perspectives on the complexities of multisensory integration, highlighting the subtle yet significant role of auditory processing in understanding tactile properties such as stickiness.

Tactile cues are more intrinsically linked to motor timing than visual cues in visual-tactile sensorimotor synchronization.

Many tasks require precise synchronization with external sensory stimuli, such as driving a car. This study investigates whether combined visual-tactile information provides additional benefits to movement synchrony over separate visual and tactile stimuli and explores the relationship with the temporal binding window for multisensory integration. In Experiment 1, participants completed a sensorimotor synchronization task to examine movement variability and a simultaneity judgment task to measure the temporal binding window. Results showed similar synchronization variability between visual-tactile and tactile-only stimuli, but significantly lower than visual only. In Experiment 2, participants completed a visual-tactile sensorimotor synchronization task with cross-modal stimuli presented inside (stimulus onset asynchrony 80 ms) and outside (stimulus-onset asynchrony 400 ms) the temporal binding window to examine temporal accuracy of movement execution. Participants synchronized their movement with the first stimulus in the cross-modal pair, either the visual or tactile stimulus. Results showed significantly greater temporal accuracy when only one stimulus was presented inside the window and the second stimulus was outside the window than when both stimuli were presented inside the window, with movement execution being more accurate when attending to the tactile stimulus. Overall, these findings indicate there may be a modality-specific benefit to sensorimotor synchronization performance, such that tactile cues are weighted more strongly than visual information as tactile information is more intrinsically linked to motor timing than visual information. Further, our findings indicate that the visual-tactile temporal binding window is related to the temporal accuracy of movement execution.

Ovipositional responses of tortricid moths to sugars, salts and neem oil

Oviposition is essential in the life history of insects and is mainly mediated by chemical and tactile cues present on the plant surface. Oviposition deterrents or stimulants can modify insect oviposition and be employed in pest control. Relatively few gustatory oviposition stimuli have been described for tortricid moths. In this study the effect of NaCl, KCl, sucrose, fructose and neem oil on the number of eggs laid by Cydia pomonella (L.), Grapholita molesta (Busck) and Lobesia botrana (Dennis & Schifermüller) was tested in laboratory arenas containing filter papers loaded with 3 doses of a given stimulus and solvent control. In general, salts increased oviposition at the mid dose (102 M) and sugars reduced it at the highest dose (103 mM), but these effects depended on the species. Neem oil dramatically reduced the number of eggs laid as the dose increased, but the lowest neem oil dose (0.1% v/v) increased L. botrana oviposition relative to solvent control. Our study shows that ubiquitous plant chemicals modify tortricid moth oviposition under laboratory conditions, and that neem oil is a strong oviposition deterrent. The oviposition arena developed in this study is a convenient tool to test the effect of tastants on the oviposition behavior of tortricid moths.

Virtually simulated interpersonal touch negatively affects perceived closeness and social affiliation to an avatar partner

Interpersonal touch is an essential component of human non-verbal communication, facilitating social affiliation and bonding. With the widespread use of digital interfaces and online platforms in all realms of human interactions, there are fewer opportunities for communicating through touch. Popular online platforms that virtually simulate human interactions rely primarily on visual and auditory modalities, providing limited or no capacity for the exchange of tactile cues. Previous studies of virtual interactions have explored the simulation of social touch using haptic devices, but little is known about how the visual representation of interpersonal touch is perceived and integrated into a virtual social experience. In two studies we examined how the exchange of virtual touch mediated by simulated 3-dimensional human characters, or avatars, within an online virtual environment influenced affiliation towards an unfamiliar interaction partner. Surprisingly, the exchange of virtual touch negatively affected the perceived closeness and affiliation to the partner and the social evaluation of the interaction but did not affect the level of physiological arousal during the interaction. These results indicate that the visual representation of social touch is sufficient to virtually communicate touch-related cues that impact social affiliation, but the influence of touch may be dependent on the interaction context.

Spatiotemporal congruency modulates weighting of visuotactile information in displacement judgments.

Combining or integrating information from multiple senses often provides richer and more reliable estimates for the perception of objects and events. In daily life, sensory information from the same source often is in close spatiotemporal proximity. This can be an important determinant of whether and how multisensory signals are combined. The introduction of advanced technical display systems allows to present multisensory information in virtual environments. However, technical displays can lack the spatiotemporal fidelity of the real world due the rendering delays. Thus, any spatiotemporal incongruency could alter how information is combined. In the current study we tested this by investigating if and how spatially and temporally discrepant tactile displacement cues can supplement imprecise visual displacement cues. Participants performed a visual displacement task with visual and tactile displacement cues under spatial and temporal incongruency conditions. We modelled how participants combined visual and tactile information in visuotactile condition using their performance in visual only condition. We found that temporal incongruency lead to an increase in tactile weights although they were correlated with the congruency condition. In contrast, the spatial incongruency led to individual differences altering cue combination strategies. Our results illustrate the importance of spatiotemporal congruency for combining tactile and visual cues when making visual displacement judgments. Given the altered cue combination strategies and individual differences, we recommend developers to adopt individual spatiotemporal calibration procedures to improve the efficiency of the sensory augmentation.

Sonification for Personalised Gait Intervention.

Mobility challenges threaten physical independence and good quality of life. Often, mobility can be improved through gait rehabilitation and specifically the use of cueing through prescribed auditory, visual, and/or tactile cues. Each has shown use to rectify abnormal gait patterns, improving mobility. Yet, a limitation remains, i.e., long-term engagement with cueing modalities. A paradigm shift towards personalised cueing approaches, considering an individual's unique physiological condition, may bring a contemporary approach to ensure longitudinal and continuous engagement. Sonification could be a useful auditory cueing technique when integrated within personalised approaches to gait rehabilitation systems. Previously, sonification demonstrated encouraging results, notably in reducing freezing-of-gait, mitigating spatial variability, and bolstering gait consistency in people with Parkinson's disease (PD). Specifically, sonification through the manipulation of acoustic features paired with the application of advanced audio processing techniques (e.g., time-stretching) enable auditory cueing interventions to be tailored and enhanced. These methods used in conjunction optimize gait characteristics and subsequently improve mobility, enhancing the effectiveness of the intervention. The aim of this narrative review is to further understand and unlock the potential of sonification as a pivotal tool in auditory cueing for gait rehabilitation, while highlighting that continued clinical research is needed to ensure comfort and desirability of use.

Blind people can actively manipulate virtual objects with a novel tactile device

Frequently in rehabilitation, visually impaired persons are passive agents of exercises with fixed environmental constraints. In fact, a printed tactile map, i.e. a particular picture with a specific spatial arrangement, can usually not be edited. Interaction with map content, instead, facilitates the learning of spatial skills because it exploits mental imagery, manipulation and strategic planning simultaneously. However, it has rarely been applied to maps, mainly because of technological limitations. This study aims to understand if visually impaired people can autonomously build objects that are completely virtual. Specifically, we investigated if a group of twelve blind persons, with a wide age range, could exploit mental imagery to interact with virtual content and actively manipulate it by means of a haptic device. The device is mouse-shaped and designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. Spatial information can be mentally constructed by integrating local tactile cues, given by the device, with global proprioceptive cues, given by hand and arm motion. The experiment consisted of a bi-manual task, in which one hand explored some basic virtual objects and the other hand acted on a keyboard to change the position of one object in real-time. The goal was to merge basic objects into more complex objects, like a puzzle. The experiment spanned different resolutions of the tactile information. We measured task accuracy, efficiency, usability and execution time. The average accuracy in solving the puzzle was 90.5%. Importantly, accuracy was linearly predicted by efficiency, measured as the number of moves needed to solve the task. Subjective parameters linked to usability and spatial resolutions did not predict accuracy; gender modulated the execution time, with men being faster than women. Overall, we show that building purely virtual tactile objects is possible in absence of vision and that the process is measurable and achievable in partial autonomy. Introducing virtual tactile graphics in rehabilitation protocols could facilitate the stimulation of mental imagery, a basic element for the ability to orient in space. The behavioural variable introduced in the current study can be calculated after each trial and therefore could be used to automatically measure and tailor protocols to specific user needs. In perspective, our experimental setup can inspire remote rehabilitation scenarios for visually impaired people.

Detection of tactile-based error-related potentials (ErrPs) in human-robot interaction.

Robot learning based on implicitly extracted error detections (e.g., EEG-based error detections) has been well-investigated in human-robot interaction (HRI). In particular, the use of error-related potential (ErrP) evoked when recognizing errors is advantageous for robot learning when evaluation criteria cannot be explicitly defined, e.g., due to the complex behavior of robots. In most studies, erroneous behavior of robots were recognized visually. In some studies, visuo-tactile stimuli were used to evoke ErrPs or a tactile cue was used to indicate upcoming errors. To our knowledge, there are no studies in which ErrPs are evoked when recognizing errors only via the tactile channel. Hence, we investigated ErrPs evoked by tactile recognition of errors during HRI. In our scenario, subjects recognized errors caused by incorrect behavior of an orthosis during the execution of arm movements tactilely. EEG data from eight subjects was recorded. Subjects were asked to give a motor response to ensure error detection. Latency between the occurrence of errors and the response to errors was expected to be short. We assumed that the motor related brain activity is timely correlated with the ErrP and might be used from the classifier. To better interpret and test our results, we therefore tested ErrP detections in two additional scenarios, i.e., without motor response and with delayed motor response. In addition, we transferred three scenarios (motor response, no motor response, delayed motor response). Response times to error was short. However, high ErrP-classification performance was found for all subjects in case of motor response and no motor response condition. Further, ErrP classification performance was reduced for the transfer between motor response and delayed motor response, but not for the transfer between motor response and no motor response. We have shown that tactilely induced errors can be detected with high accuracy from brain activity. Our preliminary results suggest that also in tactile ErrPs the brain response is clear enough such that motor response is not relevant for classification. However, in future work, we will more systematically investigate tactile-based ErrP classification.

Haptic feedback in a virtual crowd scenario improves the emotional response

Research has shown that incorporating haptics into virtual environments can increase sensory fidelity and provide powerful and immersive experiences. However, current studies on haptics in virtual interactions primarily focus on one-on-one scenarios, while kinesthetic haptic interactions in large virtual gatherings are underexplored. This study aims to investigate the impact of kinesthetic haptics on eliciting emotional responses within crowded virtual reality (VR) scenarios. Specifically, we examine the influence of type or quality of the haptic feedback on the perception of positive and negative emotions. We designed and developed different combinations of tactile and torque feedback devices and evaluated their effects on emotional responses. To achieve this, we explored different combinations of haptic feedback devices, including “No Haptic,” “Tactile Stimulus” delivering tactile cues, and “Haptic Stimulus” delivering tactile and torque cues, in combination with two immersive 360-degree video crowd scenarios, namely, “Casual Crowd” and “Aggressive Crowd.” The results suggest that varying the type or quality of haptic feedback can evoke different emotional responses in crowded VR scenarios. Participants reported increased levels of nervousness with Haptic Stimulus in both virtual scenarios, while both Tactile Stimulus and Haptic Stimulus were negatively associated with pleasantness and comfort during the interaction. Additionally, we observed that participants’ sense of touch being real was enhanced in Haptic Stimulus compared to Tactile Stimulus. The “Haptic Stimulus” condition had the most positive influence on participants’ sense of identification with the crowd.