Active Tactile Exploration Research Articles

Perceptual Constancy in the Speed Dependence of Friction During Active Tactile Exploration.

Fingertip friction is a key component of tactile perception. In active tactile exploration, friction forces depend on the applied normal force and on the sliding speed chosen. We have investigated whether humans perceive the speed dependence of friction for textured surfaces of materials, which show either increase or decrease of the friction coefficient with speed. Participants perceived the decrease or increase when the relative difference in friction coefficient between fast and slow sliding speed was more than 20%. The fraction of comparison judgments which were in agreement with the measured difference in friction coefficient did not depend on variations in the applied normal force. The results indicate a perceptual constancy for fingertip friction with respect to self-generated variations of sliding speed and applied normal force.

From Skin Mechanics to Tactile Neural Coding: Predicting Afferent Neural Dynamics During Active Touch and Perception.

First order cutaneous neurons allow object recognition, texture discrimination, and sensorimotor feedback. Their function is well-investigated under passive stimulation while their role during active touch or sensorimotor control is understudied. To understand how human perception and sensorimotor controlling strategy depend on cutaneous neural signals under active tactile exploration, the finite element (FE) hand and Izhikevich neural dynamic model were combined to predict the cutaneous neural dynamics and the resulting perception during a discrimination test. Using in-vivo microneurography generated single afferent recordings, 75% of the data was applied for the model optimization and another 25% was used for validation. By using this integrated numerical model, the predicted tactile neural signals of the single afferent fibers agreed well with the microneurography test results, achieving the out-of-sample values of 0.94 and 0.82 for slowly adapting type I (SAI) and fast adapting type I unit (FAI) respectively. Similar discriminating capability with the human subject was achieved based on this computational model. Comparable performance with the published numerical model on predicting the cutaneous neural response under passive stimuli was also presented, ensuring the potential applicability of this multi-level numerical model in studying the human tactile sensing mechanisms during active touch. The predicted population-level 1st order afferent neural signals under active touch suggest that different coding strategies might be applied to the afferent neural signals elicited from different cutaneous neurons simultaneously.

Apparent Randomness of the Normal-Force Dependence of the Coefficient of Friction between a Bare Finger and Artificial Skin under Active Tactile Exploration

When a finger actively slides over a surface, contact conditions including the contact area, sliding speed, and finger moisture naturally fluctuate. These random fluctuations lead to an apparent change of frictional properties and influence tactile pleasantness. Nonetheless, this probabilistic behavior has not been explicitly analyzed in previous studies on human fingertips. This study investigates the dependence of the coefficients of kinetic friction on the normal force produced by sliding a bare finger over different artificial skins with seven levels of hardness. The coefficient of friction was modeled as a power function of the normal force. An experimental study that involved sliding a finger over artificial skin surfaces was carried out under two conditions: the fingertip being wiped by a dry cloth or a cloth soaked in ethanol. Although the exponential term was assumed to be nearly constant for identical tribological conditions, we observed that the exponent varied randomly and could be negative, zero, or positive. This can be attributed to the variation of gross finger deformation that was not controlled during the observation. The probability density function of the exponent depended on the moisture content of the finger and object hardness. The variability of the exponent was higher for a soft material than it was for a harder material. In other words, for the softer materials, the exponent appears more random. Furthermore, the exponent tended to be positive and the coefficient of friction increased with the normal force when the finger was wiped with ethanol. These findings play an important role in understanding the frictional forces produced during skin–skin contact in terms of determining the root cause of random variations in the dependence of the coefficient of friction on the normal force.

Active tactile exploration and tactually induced turning in tethered walking stick insects.

Many animals use their tactile sense for active exploration and tactually guided behaviors such as near-range orientation. In insects, tactile sensing is often intimately linked to locomotion, resulting in the orchestration of several concurrent active movements, including turning of the entire body, rotation of the head, and searching or sampling movements of the antennae. The present study aims at linking the sequence of tactile contact events to associated changes of all three kinds of these active movements (body, head and antennae). To do so, we chose the Indian stick insect Carausius morosus, an organism commonly used to study sensory control of locomotion. Methodologically, we combined recordings of walking speed, heading, whole-body kinematics and antennal contact sequences during stationary, tethered walking and controlled presentation of an 'artificial twig' for tactile exploration. Our results show that object presentation episodes as brief as 5s are sufficient to allow for a systematic investigation of tactually induced turning behavior in walking stick insects. Animals began antennating the artificial twig within 0.5 s, and altered the beating fields of both antennae in a position-dependent manner. This change was mainly carried by a systematic shift of the head-scape joint movement and accompanied by associated changes in contact likelihood, contact location and sampling direction of the antennae. The turning tendency of the insect also depended on stimulus position, whereas the active, rhythmic head rotation remained unaffected by stimulus presentation. We conclude that the azimuth of contact location is a key parameter of active tactile exploration and tactually induced turning in stick insects.

Input of hair field afferents to a descending interneuron.

In insects the tactile sense is important for near-range orientation and is involved in various behaviors. Nocturnal insects, such as the stick insect Carausius morosus, continuously explore their surroundings by actively moving their antennae when walking. Upon antennal contact with objects, stick insects show a targeted front-leg movement. As this reaction occurs within 40 ms, descending transfer of information from the brain to the thorax needs to be fast. So far, a number of descending interneurons have been described that may be involved in this reach-to-grasp behavior. One of these is the contralateral ON-type velocity-sensitive neuron (cONv). cONv was found to encode antennal joint-angle velocity during passive movement. Here, we characterize the transient response properties of cONv, including its dependence on joint angle range and direction. As antennal hair field afferent terminals were shown to arborize close to cONv dendrites, we test whether antennal hair fields contribute to the joint-angle velocity encoding of cONv. To do so, we conducted bilateral extracellular recordings of both cONv interneurons per animal before and after hair field ablations. Our results show that cONv responses are highly transient, with velocity-dependent differences in delay and response magnitude. As yet, the steady state activity level was maintained until the stop of antennal movement, irrespective of movement velocity. Hair field ablation caused a moderate but significant reduction of movement-induced cONv firing rate by up to 40%. We conclude that antennal proprioceptive hair fields contribute to the velocity-tuning of cONv, though further antennal mechanoreceptors must be involved, too.NEW & NOTEWORTHY Active tactile exploration and tactually induced behaviors are important for many animals. They require descending information transfer about tactile sensor movement to thoracic networks. Here, we investigate response properties and afferent input to the identified descending interneuron cONv in stick insects. cONv may be involved in tactually induced reach-to-grasp movements. We show that cONv response delay, transient and steady state are velocity-dependent and that antennal proprioceptive hair fields contribute to the velocity encoding of cONv.

EEG-based texture roughness classification in active tactile exploration with invariant representation learning networks

During daily activities, humans use their hands to grasp surrounding objects and perceive sensory information which are also employed for perceptual and motor goals. Multiple cortical brain regions are known to be responsible for sensory recognition, perception and motor execution during sensorimotor processing. While various research studies particularly focus on the domain of human sensorimotor control, the relation and processing between motor execution and sensory processing is not yet fully understood. Main goal of our work is to discriminate textured surfaces varying in their roughness levels during active tactile exploration using simultaneously recorded electroencephalogram (EEG) data, while minimizing the variance of distinct motor exploration movement patterns. We perform an experimental study with eight healthy participants who were instructed to use the tip of their dominant hand index finger while rubbing or tapping three different textured surfaces with varying levels of roughness. We use an adversarial invariant representation learning neural network architecture that performs EEG-based classification of different textured surfaces, while simultaneously minimizing the discriminability of motor movement conditions (i.e., rub or tap). Results show that the proposed approach can discriminate between three different textured surfaces with accuracies up to 70%, while suppressing movement related variability from learned representations.

Independent representations of self-motion and object location in barrel cortex output.

During active tactile exploration, the dynamic patterns of touch are transduced to electrical signals and transformed by the brain into a mental representation of the object under investigation. This transformation from sensation to perception is thought to be a major function of the mammalian cortex. In primary somatosensory cortex (S1) of mice, layer 5 (L5) pyramidal neurons are major outputs to downstream areas that influence perception, decision-making, and motor control. We investigated self-motion and touch representations in L5 of S1 with juxtacellular loose-seal patch recordings of optogenetically identified excitatory neurons. We found that during rhythmic whisker movement, 54 of 115 active neurons (47%) represented self-motion. This population was significantly more modulated by whisker angle than by phase. Upon active touch, a distinct pattern of activity was evoked across L5, which represented the whisker angle at the time of touch. Object location was decodable with submillimeter precision from the touch-evoked spike counts of a randomly sampled handful of these neurons. These representations of whisker angle during self-motion and touch were independent, both in the selection of which neurons were active and in the angle-tuning preference of coactive neurons. Thus, the output of S1 transiently shifts from a representation of self-motion to an independent representation of explored object location during active touch.

End-to-End Tactile Feedback Loop: From Soft Sensor Skin Over Deep GRU-Autoencoders to Tactile Stimulation

Tactile feedback is a key sensory channel that contributes to our ability to perform precise manipulations. In this regard, sensor skin provides robots with the sense of touch making them increasingly capable of dexterous object manipulation. However, in applications like teleoperation, the complex sensory input of an infinite number of different textures must be projected to the human user's skin in a meaningful manner. In addressing this issue, a deep gated recurrent unit-based autoencoder (GRU-AE) that captured the perceptual dimensions of tactile textures in latent space was deployed to implicitly understand unseen textures. The expression of unknown textures in this latent space allowed for the definition of a control law to effectively drive tactile displays and to convey tactile feedback in a psycho-physically meaningful manner. The approach was experimentally verified by evaluating the prediction performance of the GRU-AE on seen and unseen data that were gathered during active tactile exploration of objects commonly encountered in daily living. A user study on a custom-made tactile display was conducted in which real tactile perceptions in response to active tactile object exploration were compared to the emulated tactile feedback using the proposed tactile feedback loop. The results suggest that the deep GRU-AE for tactile display control offers an effective and intuitive method for efficient end-to-end tactile feedback during active tactile texture exploration.

Creating a neuroprosthesis for active tactile exploration of textures

Intracortical microstimulation (ICMS) of the primary somatosensory cortex (S1) can produce percepts that mimic somatic sensation and, thus, has potential as an approach to sensorize prosthetic limbs. However, it is not known whether ICMS could recreate active texture exploration-the ability to infer information about object texture by using one's fingertips to scan a surface. Here, we show that ICMS of S1 can convey information about the spatial frequencies of invisible virtual gratings through a process of active tactile exploration. Two rhesus monkeys scanned pairs of visually identical screen objects with the fingertip of a hand avatar-controlled first via a joystick and later via a brain-machine interface-to find the object with denser virtual gratings. The gratings consisted of evenly spaced ridges that were signaled through individual ICMS pulses generated whenever the avatar's fingertip crossed a ridge. The monkeys learned to interpret these ICMS patterns, evoked by the interplay of their voluntary movements and the virtual textures of each object, to perform a sensory discrimination task. Discrimination accuracy followed Weber's law of just-noticeable differences (JND) across a range of grating densities; a finding that matches normal cutaneous sensation. Moreover, 1 monkey developed an active scanning strategy where avatar velocity was integrated with the ICMS pulses to interpret the texture information. We propose that this approach could equip upper-limb neuroprostheses with direct access to texture features acquired during active exploration of natural objects.

Bayesian Tactile Exploration for Compliant Docking With Uncertain Shapes

This paper presents a Bayesian approach for active tactile exploration of a planar shape in the presence of both localization and shape uncertainty. The goal is to dock the robot's end-effector against the shape-reaching a point of contact that resists a desired load-with as few probing actions as possible. The proposed method repeatedly performs inference, planning, and execution steps. Given a prior probability distribution over object shape and sensor readings from previously executed motions, the posterior distribution is inferred using a novel and efficient Hamiltonian Monte Carlo method. The optimal docking site is chosen to maximize docking probability, using a closed-form probabilistic simulation that accepts rigid and compliant motion models under Coulomb friction. Numerical experiments demonstrate that this method requires fewer exploration actions to dock than heuristics and information-gain strategies.

The Perception of Ultrasonic Square Reductions of Friction With Variable Sharpness and Duration.

The human perception of square ultrasonic modulation of the finger-surface friction was investigated during active tactile exploration by using short frictional cues of varying duration and sharpness. In a first experiment, we asked participants to discriminate the transition time and duration of short square ultrasonic reductions of friction. They proved very sensitive to discriminate millisecond differences in these two parameters with the average psychophysical thresholds being 2.3-2.4 ms for both parameters. A second experiment focused on the perception of square friction reductions with variable transition times and durations. We found that for durations of the stimulation larger than 90 ms, participants often perceived three or four edges when only two stimulations were presented while they consistently felt two edges for signals shorter than 50 ms. A subsequent analysis of the contact forces induced by these ultrasonic stimulations during slow and fast active exploration showed that two identical consecutive ultrasonic pulses can induce significantly different frictional dynamics especially during fast motion of the finger. These results confirm the human sensitivity to transient frictional cues and suggest that the human perception of square reductions of friction can depend on their sharpness and duration as well as on the speed of exploration.

Both stiff and compliant: morphological and biomechanical adaptations of stick insect antennae for tactile exploration.

Active tactile exploration behaviour is constrained to a large extent by the morphological and biomechanical properties of the animal's somatosensory system. In the model organism Carausius morosus, the main tactile sensory organs are long, thin, seemingly delicate, but very robust antennae. Previous studies have shown that these antennae are compliant under contact, yet stiff enough to maintain a straight shape during active exploration. Overcritical damping of the flagellum, on the other hand, allows for a rapid return to the straight shape after release of contact. Which roles do the morphological and biomechanical adaptations of the flagellum play in determining these special mechanical properties? To investigate this question, we used a combination of biomechanical experiments and numerical modelling. A set of four finite-element (FE) model variants was derived to investigate the effect of the distinct geometrical and material properties of the flagellum on its static (bending) and dynamic (damping) characteristics. The results of our numerical simulations show that the tapered shape of the flagellum had the strongest influence on its static biomechanical behaviour. The annulated structure and thickness gradient affected the deformability of the flagellum to a lesser degree. The inner endocuticle layer of the flagellum was confirmed to be essential for explaining the strongly damped return behaviour of the antenna. By highlighting the significance of two out of the four main structural features of the insect flagellum, our study provides a basis for mechanical design of biomimetic touch sensors tuned to become maximally flexible while quickly resuming a straight shape after contact.

Tactile information improves visual object discrimination in kea, Nestor notabilis, and capuchin monkeys, Sapajus spp.

In comparative visual cognition research, the influence of information acquired by nonvisual senses has received little attention. Systematic studies focusing on how the integration of information from sight and touch can affect animal perception are sparse. Here, we investigated whether tactile input improves visual discrimination ability of a bird, the kea, and capuchin monkeys, two species with acute vision, and known for their tendency to handle objects. To this end, we assessed whether, at the attainment of a criterion, accuracy and/or learning speed in the visual modality were enhanced by haptic (i.e. active tactile) exploration of an object. Subjects were trained to select the positive stimulus between two cylinders of the same shape and size, but with different surface structures. In the Sight condition, one pair of cylinders was inserted into transparent Plexiglas tubes. This prevented animals from haptically perceiving the objects' surfaces. In the Sight and Touch condition, one pair of cylinders was not inserted into transparent Plexiglas tubes. This allowed the subjects to perceive the objects' surfaces both visually and haptically. We found that both kea and capuchins (1) showed comparable levels of accuracy at the attainment of the learning criterion in both conditions, but (2) required fewer trials to achieve the criterion in the Sight and Touch condition. Moreover, this study showed that both kea and capuchins can integrate information acquired by the visual and tactile modalities. To our knowledge, this represents the first evidence of visuotactile integration in a bird species. Overall, our findings demonstrate that the acquisition of tactile information while manipulating objects facilitates visual discrimination of objects in two phylogenetically distant species.

Active tactile exploration with uncertainty and travel cost for fast shape estimation of unknown objects

In this paper, active tactile exploration for object shape estimation is explored. A prior work suggested to touch the most uncertain part of the estimated shape for minimizing the required number of touches. In this paper, it is pointed out that it may not be the best approach for fast estimation. We propose a novel criterion in active touch point selection for fast estimation, which considers both uncertainty of shape estimation and travel cost to touch. Our method employs a Gaussian process implicit surface model to learn the object shape from tactile information, which allows us to evaluate the uncertainty of the shape estimation with an analytic form. To estimate the travel costs for all the touch candidates, our method utilizes a computationally-efficient graph-based path planning method based on stochastic optimal control theory. Simulations with 2D and 3D objects and real-robot experiments with a 7DOF robot arm and a single finger device equipped with a tactile sensor are conducted. Experimental results verify the effectiveness of our method for fast tactile object shape estimation as compared to passive exploration and active exploration that touches the most uncertain part of the estimated shape.

Tactile Perception for Stroke Induce Changes in Electroencephalography

Objective/BackgroundTactile perception is a basic way to obtain and evaluate information about an object. The purpose of this study was to examine the effects of tactile perception on brain activation using two different tactile explorations, passive and active touches, in individuals with chronic hemiparetic stroke.MethodsTwenty patients who were diagnosed with stroke (8 right brain damaged, 12 left brain damaged) participated in this study. The tactile perception was conducted using passive and active explorations in a sitting position. To determine the neurological changes in the brain, this study measured the brain waves of the participants using electroencephalography (EEG).ResultsThe relative power of the sensory motor rhythm on the right prefrontal lobe and right parietal lobe was significantly greater during the active tactile exploration compared to the relative power during the passive exploration in the left damaged hemisphere. Most of the measured brain areas showed nonsignificantly higher relative power of the sensory motor rhythm during the active tactile exploration, regardless of which hemisphere was damaged.ConclusionThe results of this study provided a neurophysiological evidence on tactile perception in individuals with chronic stroke. Occupational therapists should consider an active tactile exploration as a useful modality on occupational performance in rehabilitation training.

Whisking Kinematics Enables Object Localization in Head-Centered Coordinates Based on Tactile Information from a Single Vibrissa

During active tactile exploration with their whiskers (vibrissae), rodents can rapidly orient to an object even though there are very few proprioceptors in the whisker muscles. Thus a long-standing question in the study of the vibrissal system is how the rat can localize an object in head-centered coordinates without muscle-based proprioception. We used a three-dimensional model of whisker bending to simulate whisking motions against a peg to investigate the possibility that the 3D mechanics of contact from a single whisker are sufficient for localization in head-centered coordinates. Results show that for nearly all whiskers in the array, purely tactile signals at the whisker base – as would be measured by mechanoreceptors, in whisker-centered coordinates – could be used to determine the location of a vertical peg in head-centered coordinates. Both the “roll” and the “elevation” components of whisking kinematics contribute to the uniqueness and resolution of the localization. These results offer an explanation for a behavioral study showing that rats can more accurately determine the horizontal angle of an object if one column, rather than one row, of whiskers is spared.

Prediction of primary somatosensory neuron activity during active tactile exploration.

Primary sensory neurons form the interface between world and brain. Their function is well-understood during passive stimulation but, under natural behaving conditions, sense organs are under active, motor control. In an attempt to predict primary neuron firing under natural conditions of sensorimotor integration, we recorded from primary mechanosensory neurons of awake, head-fixed mice as they explored a pole with their whiskers, and simultaneously measured both whisker motion and forces with high-speed videography. Using Generalised Linear Models, we found that primary neuron responses were poorly predicted by whisker angle, but well-predicted by rotational forces acting on the whisker: both during touch and free-air whisker motion. These results are in apparent contrast to previous studies of passive stimulation, but could be reconciled by differences in the kinematics-force relationship between active and passive conditions. Thus, simple statistical models can predict rich neural activity elicited by natural, exploratory behaviour involving active movement of sense organs.

Stable phase-shift despite quasi-rhythmic movements: a CPG-driven dynamic model of active tactile exploration in an insect.

An essential component of autonomous and flexible behavior in animals is active exploration of the environment, allowing for perception-guided planning and control of actions. An important sensory system involved is active touch. Here, we introduce a general modeling framework of Central Pattern Generators (CPGs) for movement generation in active tactile exploration behavior. The CPG consists of two network levels: (i) phase-coupled Hopf oscillators for rhythm generation, and (ii) pattern formation networks for capturing the frequency and phase characteristics of individual joint oscillations. The model captured the natural, quasi-rhythmic joint kinematics as observed in coordinated antennal movements of walking stick insects. Moreover, it successfully produced tactile exploration behavior on a three-dimensional skeletal model of the insect antennal system with physically realistic parameters. The effect of proprioceptor ablations could be simulated by changing the amplitude and offset parameters of the joint oscillators, only. As in the animal, the movement of both antennal joints was coupled with a stable phase difference, despite the quasi-rhythmicity of the joint angle time courses. We found that the phase-lead of the distal scape-pedicel (SP) joint relative to the proximal head-scape (HS) joint was essential for producing the natural tactile exploration behavior and, thus, for tactile efficiency. For realistic movement patterns, the phase-lead could vary within a limited range of 10–30° only. Tests with artificial movement patterns strongly suggest that this phase sensitivity is not a matter of the frequency composition of the natural movement pattern. Based on our modeling results, we propose that a constant phase difference is coded into the CPG of the antennal motor system and that proprioceptors are acting locally to regulate the joint movement amplitude.

Perspectives and Limitations of Current Theories in Neuroscience and Cosmology in Describing “Full, Conscious and Actual Participation in Liturgical Celebrations”

Mother Church earnestly desires that all the faithful should be led to that fully conscious, and active participation in liturgical celebrations which is demanded by the very nature of the liturgy....

Central drive and proprioceptive control of antennal movements in the walking stick insect

In terrestrial locomotion, active touch sensing is an important source of near-range information. Walking stick insects show active tactile exploration behaviour by continuously sampling the ambient space with their antennae. Here, we identify central and proprioceptive contributions to the control of this behaviour. First, we investigate the potential role of synaptic drive to central neural networks using pilocarpine, an agonist of muscarinic acetylcholine receptors. In an in situ preparation, pilocarpine induced rhythmic antennal movements with a persisting pattern of inter-joint coordination, matching that seen in intact walking animals, albeit with lower cycle frequency. After de-cerebration, stick insects were still able to walk but no longer moved their antennae during walking. Here, pilocarpine still induced antennal movement, suggesting that synaptic drive to central neural networks involved in antennal movement generation occurred in the brain and not in the suboesophageal ganglion. During intact walking, these networks are likely to receive activation by ascending input. Second, we show persistent coupling of both antennal joints during intact walking, with the distal scape–pedicel joint (SP) always leading the proximal head–scape joint (HS). Ablation of joint proprioceptors had no effect on this overall pattern of inter-joint coordination but could affect the magnitude of the phase-lag. Third, we revise the description of antennal hair fields and show that complete ablation of all seven hair fields strongly affects antennal movements. Ablating dorsal hair fields mainly affected the working-ranges of antennal joints: Ablation of the dorso-medial pedicellar hair plate caused a ventral shift of the SP working-range. Ablation of the dorsal scapal hair plate considerably expanded the dorsal HS working-range, and, in combination with ablation of pedicellar hair fields, increased the SP working-range, too. We conclude that the working-ranges of both joints are under proprioceptive control of dorsal antennal hair fields. Thus, both synaptic drive to central neural networks and proprioceptive feedback are involved in the control of active tactile exploration behaviour in stick insects.