Type Of Sensory Feedback Research Articles

A Machine Learning Approach to Classifying EEG Data Collected with or without Haptic Feedback during a Simulated Drilling Task.

Artificial Intelligence (AI), computer simulations, and virtual reality (VR) are increasingly becoming accessible tools that can be leveraged to implement training protocols and educational resources. Typical assessment tools related to sensory and neural processing associated with task performance in virtual environments often rely on self-reported surveys, unlike electroencephalography (EEG), which is often used to compare the effects of different types of sensory feedback (e.g., auditory, visual, and haptic) in simulation environments in an objective manner. However, it can be challenging to know which aspects of the EEG signal represent the impact of different types of sensory feedback on neural processing. Machine learning approaches offer a promising direction for identifying EEG signal features that differentiate the impact of different types of sensory feedback during simulation training. For the current study, machine learning techniques were applied to differentiate neural circuitry associated with haptic and non-haptic feedback in a simulated drilling task. Nine EEG channels were selected and analyzed, extracting different time-domain, frequency-domain, and nonlinear features, where 360 features were tested (40 features per channel). A feature selection stage identified the most relevant features, including the Hurst exponent of 13-21 Hz, kurtosis of 21-30 Hz, power spectral density of 21-30 Hz, variance of 21-30 Hz, and spectral entropy of 13-21 Hz. Using those five features, trials with haptic feedback were correctly identified from those without haptic feedback with an accuracy exceeding 90%, increasing to 99% when using 10 features. These results show promise for the future application of machine learning approaches to predict the impact of haptic feedback on neural processing during VR protocols involving drilling tasks, which can inform future applications of VR and simulation for occupational skill acquisition.

A Sensory Feedback Neural Stimulator Prototype for Both Implantable and Wearable Applications.

The restoration of sensory feedback is one of the current challenges in the field of prosthetics. This work, following the analysis of the various types of sensory feedback, aims to present a prototype device that could be used both for implantable applications to perform PNS and for wearable applications, performing TENS, to restore sensory feedback. The two systems are composed of three electronic boards that are presented in detail, as well as the bench tests carried out. To the authors' best knowledge, this work presents the first device that can be used in a dual scenario for restoring sensory feedback. Both the implantable and wearable versions respected the expected values regarding the stimulation parameters. In its implantable version, the proposed system allows simultaneous and independent stimulation of 30 channels. Furthermore, the capacity of the wearable version to elicit somatic sensations was evaluated on healthy participants demonstrating performance comparable with commercial solutions.

Fusion of dual modalities of non-invasive sensory feedback for object profiling with prosthetic hands.

Either non-invasive somatotopic or substitute sensory feedback is capable of conveying a single modality of sensory information from prosthetic hands to amputees. However, the neurocognitive ability of amputees to integrate multi-modality sensory information for functional discrimination is unclear. The purpose of this study was to assess the fusion of non-invasive somatotopic tactile and substitute aperture feedbacks for profile perception of multiple physical features during grasping objects. Two left transradial amputees with somatotopic evoked tactile sensation (ETS) of five fingers participated in the study. The tactile information of prosthetic hand was provided to amputees by the ETS feedback elicited on the stump projected finger map. Hand aperture information was conveyed to amputees with substitute electrotactile stimulation on the forearm or upper arm. Two types of sensory feedback were integrated to a commercial prosthetic hand. The efficacy of somatotopic ETS feedback on object length identification task was assessed with or without substitute aperture stimulation. The object size identification task was utilized to assess how ETS stimulation at the stump may affect aperture perception with stimulation on the ipsilateral upper arm or forearm. Finally, the task of identifying combined length and size was conducted to evaluate the ability of amputees to integrate the dual modalities of sensory feedback for perceiving profile features. The study revealed that amputee subjects can effectively integrate the ETS feedback with electrotactile substitutive feedback for object profile discrimination. Specifically, ETS was robust to provide object length information with electrotactile stimulation at either the forearm or upper arm. However, electrotactile stimulation at the upper arm for aperture perception was less susceptible to the interference of ETS stimulation than at the forearm. Amputee subjects are able to combine somatotopic ETS and aperture feedbacks for identifying multi-dimensional features in object profiling. The two sensory streams of information can be fused effectively without mutual interference for functional discrimination.

Sensory Organization Test Conditions Influence Postural Strategy Rather than Footwear or Workload.

Background: Postural strategies such as ankle, hip, or combined ankle-hip strategies are used to maintain optimal postural stability, which can be influenced by the footwear type and physiological workload. Purpose: This paper reports previously unreported postural strategy scores during the six conditions of the sensory organization test (SOT). Methods: Fourteen healthy males (age: 23.6 ± 1.2 years; height: 181 ± 5.3 cm; mass: 89.2 ± 14.6 kg) were tested for postural strategy adopted during SOT in three types of occupational footwear (steel-toed work boot, tactical work boot, low-top work shoe) every 30 min during a 4-h simulated occupational workload. Postural strategy scores were analyzed using repeated measures analysis of variance at 0.05 alpha level. Results: Significant differences among postural strategy scores were only evident between SOT conditions, and but not between footwear type or the workload. Conclusions: Findings indicate that occupational footwear and occupational workload did not cause a significant change in reliance on postural strategies. The significant changes in postural strategy scores were due to the availability of accurate and/or conflicting sensory feedback during SOT conditions. In SOT conditions where all three types of sensory feedback was available, the ankle strategy was predominantly adopted, while more reliance on hip strategy occurred in conditions with absent or conflicting sensory feedback.

Impact of Experimental Tonic Pain on Corrective Motor Responses to Mechanical Perturbations.

Movement is altered by pain, but the underlying mechanisms remain unclear. Assessing corrective muscle responses following mechanical perturbations can help clarify these underlying mechanisms, as these responses involve spinal (short-latency response, 20-50 ms), transcortical (long-latency response, 50-100 ms), and cortical (early voluntary response, 100-150 ms) mechanisms. Pairing mechanical (proprioceptive) perturbations with different conditions of visual feedback can also offer insight into how pain impacts on sensorimotor integration. The general aim of this study was to examine the impact of experimental tonic pain on corrective muscle responses evoked by mechanical and/or visual perturbations in healthy adults. Two sessions (Pain (induced with capsaicin) and No pain) were performed using a robotic exoskeleton combined with a 2D virtual environment. Participants were instructed to maintain their index in a target despite the application of perturbations under four conditions of sensory feedback: (1) proprioceptive only, (2) visuoproprioceptive congruent, (3) visuoproprioceptive incongruent, and (4) visual only. Perturbations were induced in either flexion or extension, with an amplitude of 2 or 3 Nm. Surface electromyography was recorded from Biceps and Triceps muscles. Results demonstrated no significant effect of the type of sensory feedback on corrective muscle responses, no matter whether pain was present or not. When looking at the effect of pain on corrective responses across muscles, a significant interaction was found, but for the early voluntary responses only. These results suggest that the effect of cutaneous tonic pain on motor control arises mainly at the cortical (rather than spinal) level and that proprioception dominates vision for responses to perturbations, even in the presence of pain. The observation of a muscle-specific modulation using a cutaneous pain model highlights the fact that the impacts of pain on the motor system are not only driven by the need to unload structures from which the nociceptive signal is arising.

Sensory feedback in music performer–instrument interactions

Musical performance involves the production of highly accurate sequences of movements in space and time. During a performance, real-time auditory, visual, somatosensory (tactile and kinematic), and movement-related information of the outcome of an action provided within the different sensory systems is integrated into a coherent percept and fed back to the motor system. These sensory feedback mechanisms are, therefore, crucial to maintaining the fluency of production. However, how and to what extent do these feedback mechanisms influence music performance and learning? A growing area of research has investigated the role of different types of sensory feedback on the musicians’ performance. The aim of this integrative review is to overview the recent literature on the role of sensory feedback on music performance, focusing particularly on the individual interaction between musician and instrument. In the first section, we review recent findings regarding the role of auditory, visual, and somatosensory (tactile and kinesthetic) feedback on music performance considering each sensory modality separately. To finalize, we briefly discuss the implications of these findings to support learning and pedagogical practice.

Handwriting on a tablet screen: Role of visual and proprioceptive feedback in the control of movement by children and adults

Tablets are increasingly being used in schools for a variety of handwriting tasks. Given that the control of handwriting relies on both visual and proprioceptive feedback, especially in younger writers, this raises the question of whether the texture of the tablet surface affects graphomotor execution. A series of recent studies found that when the smoothness of a tablet screen modifies proprioceptive feedback, the impact on graphomotor execution varies according to the level of the writer’s handwriting skills. However, as the writing on the screen remained visible in these studies, participants may have compensated for the decrease in proprioceptive feedback by relying more heavily on visual information. The aim of the present study was therefore to unravel the respective contributions of different types of sensory feedback during handwriting development and, consequently, the compensatory role of visual information when children and adults have to write on a tablet. To this end, we asked second and fifth graders and adult participants to write letters and pseudowords on a plastic board placed on top of a tablet screen. Participants wrote on either the smooth or the granular side of the plastic board (manipulation of surface friction), and with normal vision or behind a shield that hid the hand and handwriting from direct view (manipulation of vision). Kinematic parameters and legibility were recorded to assess handwriting performances. Results revealed a significant interaction between proprioceptive and visual feedback on letter size, pen speed and legibility, regardless of participants’ age. Furthermore, reducing the visual and proprioceptive feedback had a greater effect on the children’s handwriting performances than on those of adults. Overall, the present study provides new insight into the contribution of the different types of sensory feedback and their interaction with handwriting development. In addition, our results on the impact of tablet surface on graphomotor execution will serve as useful pointers for improving the design of this tool for children, such as increasing the degree of friction of the screen surface.

Helping older pedestrians navigate in the city: comparisons of visual, auditory and haptic guidance instructions in a virtual environment

ABSTRACTPreserving older pedestrians’ navigation skills in urban environments is a challenge for maintaining their quality of life. However, existing aids do not take into account older people’s perceptual and cognitive declines nor their user experience, and they call upon sensory modalities that are already used during walking. The present study was aimed at comparing different guidance instructions using visual, auditory, and haptic feedback in order to identify the most efficient and best accepted one(s). Sixteen middle-age (non-retired) adults, 21 younger-old (young-retired) adults, and 21 older-old (old-retired) adults performed a navigation task in a virtual environment. The task was performed with visual feedback (directional arrows superimposed on the visual scenes), auditory feedback (sounds in the left/right ear), haptic feedback (vibrotactile information delivered by a wristband), combinations of different types of sensory feedback, or a paper map. The results showed that older people benefited from the sensory guidance instructions, as compared to the paper map. Visual and auditory feedbacks were associated with better performance and user experience than haptic feedback or the paper map, and the benefits were the greatest among the older-old participants, even though the paper-map familiarity was appreciated. Several recommendations for designing pedestrian navigation aids are proposed.

Embodied neurofeedback with an anthropomorphic robotic hand.

Neurofeedback-guided motor imagery training (NF-MIT) has been suggested as a promising therapy for stroke-induced motor impairment. Whereas much NF-MIT research has aimed at signal processing optimization, the type of sensory feedback given to the participant has received less attention. Often the feedback signal is highly abstract and not inherently coupled to the mental act performed. In this study, we asked whether an embodied feedback signal is more efficient for neurofeedback operation than a non-embodiable feedback signal. Inspired by the rubber hand illusion, demonstrating that an artificial hand can be incorporated into one’s own body scheme, we used an anthropomorphic robotic hand to visually guide the participants’ motor imagery act and to deliver neurofeedback. Using two experimental manipulations, we investigated how a participant’s neurofeedback performance and subjective experience were influenced by the embodiability of the robotic hand, and by the neurofeedback signal’s validity. As pertains to embodiment, we found a promoting effect of robotic-hand embodiment in subjective, behavioral, electrophysiological and electrodermal measures. Regarding neurofeedback signal validity, we found some differences between real and sham neurofeedback in terms of subjective and electrodermal measures, but not in terms of behavioral and electrophysiological measures. This study motivates the further development of embodied feedback signals for NF-MIT.

The ecology of self-monitoring effects on memory of verbal productions: Does speaking to someone make a difference?

Experiments involving verbal self-monitoring show that memory for spoken words varies with types of sensory feedback: memory is better when words are spoken aloud than when they are lip-synched or covertly produced. Such effects can be explained by the Central Monitoring Theory (CMT) via a process that matches a forward model reflecting expected sensory effects of practiced forms and sensory information during speech. But CMT oversees factors of shared attention as achieved by speaker-listener gaze, and implies that sensory feedback may not affect the learning of unpracticed forms (non-words). These aspects of CMT were examined in two experiments of self-monitoring focusing on oro-sensory feedback. In Experiment 1 we show that varying feedback creates differential effects on memory for spoken words and that speaker-listener gaze alters these effects. Using non-words, Experiment 2 shows the absence of differential feedback effects. The results confirm CMT but suggest the need to refine the theory in terms of processes that mediate attention.

Upper Limb Asymmetries in the Matching of Proprioceptive Versus Visual Targets

The purpose of the current study was to determine the extent to which "sensory dominance" exists in right-handers with respect to the utilization of proprioceptive versus visual feedback. Thirteen right-handed adults performed two target-matching tasks using instrumented manipulanda. In the proprioceptive matching task, the left or right elbow of blindfolded subjects was passively extended by a torque motor system to a target position and held for 3 s before being returned to the start position. The target angle was then matched with either the ipsilateral or contralateral arm. In the second task, visual matching, circular targets were briefly projected to either side of a visual fixation point located in front of the subject. Subjects then matched the target positions with a laser pointer by moving either the ipsilateral or contralateral arm. Overall, marked arm differences in accuracy were seen based on the type of sensory feedback used for target presentation. For the proprioceptive matching task errors were smaller for the nonpreferred left arm, whereas during the visual matching task smaller errors were found for the preferred right arm. These results suggest a left arm/right hemisphere advantage for proprioceptive feedback processing and a right arm/left hemisphere advantage for visual information processing. Such asymmetries may reflect fundamental differences between the two arm/hemisphere systems during the performance of bimanual tasks where the preferred arm requires visual guidance to manipulate an object, whereas the nonpreferred stabilizes that object on the basis of proprioceptive feedback.

High performance haptic device for force rendering in textile exploration

The HAPTEX system aims to develop a new multi-sensory environment for the immersive exploration of textiles. HAPTEX is based on a multi-layer/multi-thread architecture that optimizes the computational speed and integrates three different types of sensory feedback: vision, tactile and haptic. Such kind of environment is suitable for demanding VR applications such as the online marketing of novel textiles or garments, however it requires the design of a high performance multi-point haptic interface. The present work focuses on the haptic device design and describes how demanding requirements can be met by integrating on a high performance device a force sensor to achieve closed loop control. The methodology for the dimensioning of a motion based explicit force control on the basis of the dynamic parameters will be discussed and the specific implementation for the HAPTEX system presented.

Modeling biological motor control for human locomotion with functional electrical stimulation

This paper develops a novel control system for functional electrical stimulation (FES) locomotion, which aims to generate normal locomotion for paraplegics via FES. It explores the possibility of applying ideas from biology to engineering. The neural control mechanism of the biological motor system, the central pattern generator, has been adopted in the control system design. Some artificial control techniques such as neural network control, fuzzy logic, control and impedance control are incorporated to refine the control performance. Several types of sensory feedback are integrated to endow this control system with an adaptive ability. A musculoskeletal model with 7 segments and 18 muscles is constructed for the simulation study. Satisfactory simulation results are achieved under this FES control system, which indicates a promising technique for the potential application of FES locomotion in future.

Effects of mental practice and body position on the accuracy of blind visual-kinesthetic positioning.

Ware (2) and Ware and Barnhill (3) have demonstrated that practice alone with indirect subject control and practice with different types of sensory feedback and direct subject control leads to an increase in the perceptual accuracy of intermediate visualkinesthetic position. The research was conducted while the subject was sitting with head tilted or standing. The present study extended practice to include mental practice (1) and to include the supine as well as the standing position. Fifty-two undergraduate psychology students from 18 to 44 yr. of age were randomly assigned to a mental practice or a control condition. Within each condition, half of the students performed in the standing and then the supine position and the others in the opposite order. Details of the apparatus were described earlier (3). The device was 4 ft. in diameter with a double-pointed rod that pivoted in the middle to allow free movement around 360. All students, tested individually, were shown that device. Control students were allowed l0'min. to relax before performing while the other students were guided through 10 min. of mental practice on the device. The students were then blindfolded, and the device was adjusted so the center of the rod was parallel to the base of the sternum. Starting in a standing or supine position, they adjusted the rod randomly to the 12 clock positions. Seventeen practice trials and 12 test trials were given for each of the body positions. Accuracy was measured in degrees discrepancy from the assigned clock positions. The amount of mental practice used here was not effective in significantly increasing blind positioning accuracy. Subsequent research might focus on more mental practice time and actual performance before mental practice. The positioning accuracy for the standing position was, however, significantly better than the supine body position using constant errors (PI,* = 8.00, P < .01), with means and standard deviations, respectively, being M = -2.83, SD = 2.93 and M = -5.08, SD = 2.80. A significant interaction was found between position and trials (&.a = 7.31, P < .01). The difference between the means in the vertical body positions for the practice trials (M = -2.85, SD = 2.36) and the test trials (M = -2.82, SD = 3.17) was minimal, while the difference between the means in the supine position (M = -5.53, SD = 6.28) and (M = -4.62, SD = 4.84) indicates some learning. The unfamiliarity of performing blindfolded plus being in a supine position may have accounted for the significant main effect. Research should test the effect of extended blind training while supine on positioning accuracy.