Unimodal Feedback Research Articles

Evidence for Layer-Specific Connectional Heterogeneity in the Mouse Auditory Corticocollicular System.

The auditory cortex (AC) sends long-range projections to virtually all subcortical auditory structures. One of the largest and most complex of these-the projection between AC and inferior colliculus (IC; the corticocollicular pathway)-originates from layer 5 and deep layer 6. Though previous work has shown that these two corticocollicular projection systems have different physiological properties and network connectivities, their functional organization is poorly understood. Here, using a combination of traditional and viral tracers combined with in vivo imaging in both sexes of the mouse, we observed that layer 5 and layer 6 corticocollicular neurons differ in their areas of origin and termination patterns. Layer 5 corticocollicular neurons are concentrated in primary AC, while layer 6 corticocollicular neurons emanate from broad auditory and limbic areas in the temporal cortex. In addition, layer 5 sends dense projections of both small and large (>1 µm2 area) terminals to all regions of nonlemniscal IC, while layer 6 sends small terminals to the most superficial 50-100 µm of the IC. These findings suggest that layer 5 and 6 corticocollicular projections are optimized to play distinct roles in corticofugal modulation. Layer 5 neurons provide strong, rapid, and unimodal feedback to the nonlemniscal IC, while layer 6 neurons provide heteromodal and limbic modulation diffusely to the nonlemniscal IC. Such organizational diversity in the corticocollicular pathway may help to explain the heterogeneous effects of corticocollicular manipulations and, given similar diversity in corticothalamic pathways, may be a general principle in top-down modulation.SIGNIFICANCE STATEMENT We demonstrate that a major descending system in the brain is actually two systems. That is, the auditory corticocollicular projection, which exerts considerable influence over the midbrain, comprises two projections: one from layer 5 and the other from layer 6. The layer 6 projection is diffusely organized, receives multisensory inputs, and ends in small terminals; while the layer 5 projection is derived from a circumscribed auditory cortical area and ends in large terminals. These data suggest that the varied effects of cortical manipulations on the midbrain may be related to effects on two disparate systems. These findings have broader implications because other descending systems derive from two layers. Therefore, a duplex organization may be a common motif in descending control.

Visual and somatosensory feedback mechanisms of precision manual motor control in autism spectrum disorder

BackgroundIndividuals with autism spectrum disorder (ASD) show deficits processing sensory feedback to reactively adjust ongoing motor behaviors. Atypical reliance on visual and somatosensory feedback each have been reported during motor behaviors in ASD suggesting that impairments are not specific to one sensory domain but may instead reflect a deficit in multisensory processing, resulting in reliance on unimodal feedback. The present study tested this hypothesis by examining motor behavior across different visual and somatosensory feedback conditions during a visually guided precision grip force test.MethodsParticipants with ASD (N = 43) and age-matched typically developing (TD) controls (N = 23), ages 10–20 years, completed a test of precision gripping. They pressed on force transducers with their index finger and thumb while receiving visual feedback on a computer screen in the form of a horizontal bar that moved upwards with increased force. They were instructed to press so that the bar reached the level of a static target bar and then to hold their grip force as steadily as possible. Visual feedback was manipulated by changing the gain of the force bar. Somatosensory feedback was manipulated by applying 80 Hz tendon vibration at the wrist to disrupt the somatosensory percept. Force variability (standard deviation) and irregularity (sample entropy) were examined using multilevel linear models.ResultsWhile TD controls showed increased force variability with the tendon vibration on compared to off, individuals with ASD showed similar levels of force variability across tendon vibration conditions. Individuals with ASD showed stronger age-associated reductions in force variability relative to controls across conditions. The ASD group also showed greater age-associated increases in force irregularity relative to controls, especially at higher gain levels and when the tendon vibrator was turned on.ConclusionsOur findings that disrupting somatosensory feedback did not contribute to changes in force variability or regularity among individuals with ASD suggests a reduced ability to integrate somatosensory feedback information to guide ongoing precision manual motor behavior. We also document stronger age-associated gains in force control in ASD relative to TD suggesting delayed development of multisensory feedback control of motor behavior.

The Role of Unimodal Feedback Pathways in Gender Perception During Activation of Voice and Face Areas.

Cross-modal effects provide a model framework for investigating hierarchical inter-areal processing, particularly, under conditions where unimodal cortical areas receive contextual feedback from other modalities. Here, using complementary behavioral and brain imaging techniques, we investigated the functional networks participating in face and voice processing during gender perception, a high-level feature of voice and face perception. Within the framework of a signal detection decision model, Maximum likelihood conjoint measurement (MLCM) was used to estimate the contributions of the face and voice to gender comparisons between pairs of audio-visual stimuli in which the face and voice were independently modulated. Top–down contributions were varied by instructing participants to make judgments based on the gender of either the face, the voice or both modalities (N = 12 for each task). Estimated face and voice contributions to the judgments of the stimulus pairs were not independent; both contributed to all tasks, but their respective weights varied over a 40-fold range due to top–down influences. Models that best described the modal contributions required the inclusion of two different top–down interactions: (i) an interaction that depended on gender congruence across modalities (i.e., difference between face and voice modalities for each stimulus); (ii) an interaction that depended on the within modalities’ gender magnitude. The significance of these interactions was task dependent. Specifically, gender congruence interaction was significant for the face and voice tasks while the gender magnitude interaction was significant for the face and stimulus tasks. Subsequently, we used the same stimuli and related tasks in a functional magnetic resonance imaging (fMRI) paradigm (N = 12) to explore the neural correlates of these perceptual processes, analyzed with Dynamic Causal Modeling (DCM) and Bayesian Model Selection. Results revealed changes in effective connectivity between the unimodal Fusiform Face Area (FFA) and Temporal Voice Area (TVA) in a fashion that paralleled the face and voice behavioral interactions observed in the psychophysical data. These findings explore the role in perception of multiple unimodal parallel feedback pathways.

Tactile discrimination of material properties: application to virtual buttons for professional appliances

An experiment is described that tested the possibility to classify wooden, plastic, and metallic objects based on reproduced auditory and vibrotactile stimuli. The results show that recognition rates are considerably above chance level with either unimodal auditory or vibrotactile feedback. Supported by those findings, the possibility to render virtual buttons for professional appliances with different tactile properties was tested. To this end, a touchscreen device was provided with various types of vibrotactile feedback in response to the sensed pressing force and location of a finger. Different virtual buttons designs were tested by user panels who performed a subjective evaluation on perceived tactile properties and materials. In a first implementation, virtual buttons were designed reproducing the vibration recordings of real materials used in the classification experiment: mainly due to hardware limitations of our prototype and the consequent impossibility to render complex vibratory signals, this approach did not prove successful. A second implementation was then optimized for the device capabilities, moreover introducing surface compliance effects and button release cues: the new design led to generally high quality ratings, clear discrimination of different buttons and unambiguous material classification. The lesson learned was that various material and physical properties of virtual buttons can be successfully rendered by characteristic frequency and decay cues if correctly reproduced by the device.

On the global attractor of delay differential equations with unimodal feedback not satisfying the negative Schwarzian derivative condition

We study the size of the global attractor for a delay differential equation with unimodal feedback. We are interested in extending and complementing a dichotomy result by Liz and Rost, which assumed that the Schwarzian derivative of the nonlinear feedback is negative in a certain interval. Using recent stability results for difference equations, we obtain a stability dichotomy for the original delay differential equation in the situation wherein the Schwarzian derivative of the nonlinear term may change sign. We illustrate the applicability of our results with several examples.

Audio Feedback Associated With Body Movement Enhances Audio and Somatosensory Spatial Representation.

In the last years, the positive impact of sensorimotor rehabilitation training on spatial abilities has been taken into account, e.g., providing evidence that combined multimodal compared to unimodal feedback improves responsiveness to spatial stimuli. To date, it still remains unclear to which extent spatial learning is influenced by training conditions. Here we investigated the effects of active and passive audio-motor training on spatial perception in the auditory and proprioceptive domains on 36 healthy young adults. First, to investigate the role of voluntary movements on spatial perception, we compared the effects of active vs. passive multimodal training on auditory and proprioceptive spatial localization. Second, to investigate the effectiveness of unimodal training conditions on spatial perception, we compared the impact of only proprioceptive or only auditory sensory feedback on spatial localization. Finally, to understand whether the positive effects of multimodal and unimodal trainings generalize to the untrained part, both dominant and non-dominant arms were tested. Results indicate that passive multimodal training (guided movement) is more beneficial than active multimodal training (active exploration) and only in passive condition the improvement is generalized also on the untrained hand. Moreover, we found that combined audio-motor training provides the strongest benefit because it significantly affects both auditory and somatosensory localization, while the effect of a single feedback modality is limited to a single domain, indicating a cross-modal influence of the two domains. Therefore, the use of multimodal feedback is more efficient in improving spatial perception. These results indicate that combined sensorimotor signals are effective in recalibrating auditory and proprioceptive spatial perception and that the beneficial effect is mainly due to the combination of auditory and proprioceptive spatial cues.

Considerations on Effective Feedback in Computerized Speech Training for Dysarthric Speakers.

Introduction: In this article, we consider the role of feedback in computerized speech training for patients with dysarthric speech due to acquired neurological disorders such as Parkinson's disease and stroke. Methods: Based on literature from different fields, we review several issues that play a role when designing feedback for computerized speech training, including serious games. Results: Which speech dimensions (e.g., articulation, loudness) to target in computerized speech feedback, and at what level of detail to provide the feedback, depend on the focus of the specific speech therapy and the technical feasibility of providing reliable speech feedback. Furthermore, feedback that provides knowledge of results generally appears equally effective as knowledge of performance feedback, and is more easily provided in computerized speech training systems. Implicit feedback can be more motivating than explicit feedback (e.g., in serious games), but may be harder to understand. Multimodal feedback is preferred over unimodal feedback to ensure that the feedback message is optimally perceived. Mild negative task-oriented feedback can enhance effort but should be balanced with positive feedback, such as feedback referring to patients' progress. Finally, a balance should be found between the motivational advantages of high-frequency immediate feedback (e.g., in serious games) and the advantages of low-frequency and delayed feedback in preventing patients from becoming dependent on augmented feedback. Conclusions: Several aspects play a role in designing feedback for computerized speech training for dysarthric speakers. Decisions on these aspects should be made carefully, accounting for the specific characteristics of the patient group that is targeted, the focus of the specific speech therapy, and the technological possibilities that are available.

Biofeedback intervention effects for people with cerebral palsy: Insights from a systematic review

Cerebral palsy (CP) is a neuromuscular condition affecting 1 in 400 children that limits activities of daily living. Essential elements to improving function are feedback and repetition. Feedback about a motor performance communicated back to the individual (e.g. biofeedback) can be a powerful tool for improving autonomy and self-efficacy. However, the most effective mechanisms of biofeedback, particularly for people with CP remain unknown. This study aimed to identify the qualities of biofeedback interventions most effective for people with cerebral palsy (CP) through systematic review. Eight databases and references from relevant articles were searched. Included studies had participants diagnosed with CP and any quantitative study design with N > 3. Studies were evaluated using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework. Interventions needed to provide external feedback about the movement or performance. For available studies, effect sizes were compared to study characteristics (intervention duration/intensity, and feedback type). Fifty-seven of the 205 full-texts reviewed were included. Overall, 79% of studies and 63% of measures showed post-intervention improvement. Studies with positive effects ( r = 0.47 ± 0.26) were longer, averaging 8 weeks and 150 minutes/week compared to studies with no changes ( r = 0.28 ± 0.26), which were 3 weeks and 80 minutes/week ( Fig. 1 ). These studies also used multi-modal feedback (audio and visual) more commonly than unimodal feedback. This study shows that biofeedback interventions can be effective for people with CP. The confidence in the effect would be strengthened by a thoughtful paradigm, a standardized outcome toolbox, and adequate practice intensity. These insights could raise intervention efficacy to help people with CP improve motor activities.

A Noninvasive Brain-Computer Interface for Real-Time Speech Synthesis: The Importance of Multimodal Feedback.

We conducted a study of a motor imagery brain-computer interface (BCI) using electroencephalography to continuously control a formant frequency speech synthesizer with instantaneous auditory and visual feedback. Over a three-session training period, sixteen participants learned to control the BCI for production of three vowel sounds (/ textipa i/ [heed], / textipa A/ [hot], and / textipa u/ [who'd]) and were split into three groups: those receiving unimodal auditory feedback of synthesized speech, those receiving unimodal visual feedback of formant frequencies, and those receiving multimodal, audio-visual (AV) feedback. Audio feedback was provided by a formant frequency artificial speech synthesizer, and visual feedback was given as a 2-D cursor on a graphical representation of the plane defined by the first two formant frequencies. We found that combined AV feedback led to the greatest performance in terms of percent accuracy, distance to target, and movement time to target compared with either unimodal feedback of auditory or visual information. These results indicate that performance is enhanced when multimodal feedback is meaningful for the BCI task goals, rather than as a generic biofeedback signal of BCI progress.

The angular gyrus is a supramodal comparator area in action-outcome monitoring.

Predicting and processing the sensory consequences of one's own actions is essential to enable successful interactions with the environment. Previous studies have suggested that the angular gyrus detects discrepancies between predicted and actual action consequences, at least for unimodal feedback. However, most actions lead to multisensory consequences, raising the question whether previous models can sufficiently explain action-outcome processing. Here, we investigated neural comparator processes during detection of delays between action and unimodal or bimodal consequences in human subjects with fMRI, using parametric and connectivity analyses. Participants had to perform button presses, which led to the presentation of either a dot on the screen, a tone, or both, presented with a variable delay after the button press. Participants were asked to judge whether there was a delay between action and feedback. Activity in the angular gyrus correlated positively with delay for both visual, auditory, and audio-visual action consequences. Furthermore, the angular gyrus was functionally connected with midline structures such as the posterior cingulate cortex and precuneus in all conditions. Our results show that the angular gyrus is (1) a supramodal area, sensitive to delays in multiple modalities, and (2) functionally connected with self-referential areas during delay detection of both unimodal and bimodal action consequences. Overall, our results suggest that the angular gyrus functions as a mediator between perception and interpretation, and that this process is remarkably similar for unimodal and bimodal action consequences.

Bounded global Hopf branches for stage-structured differential equations with unimodal feedback

We consider a class of stage-structured differential equations with unimodal feedback. By using the time delay as a bifurcation parameter, we show that the number of local Hopf bifurcation values is finite. Furthermore, we analytically prove that these local Hopf bifurcation values are neatly paired, and each pair is jointed by a bounded global Hopf branch. We use the well-known Mackey–Glass equation with a stage structure as an illustrative example to demonstrate that bounded global Hopf branches can induce interesting and rich dynamics. As the delay increases over a finite interval, the stage-structured Mackey–Glass equation exhibits certain symmetric dynamic patterns: the solutions evolve from a stable equilibrium to sustained stable periodic oscillations, to chaotic-like aperiodic oscillations and back to sustained stable periodic oscillations, to a stable equilibrium.

Global dynamics of a state-dependent delay model with unimodal feedback

We obtain the global attractivity of nonnegative stationary states for a parameterized state-dependent delay equation with unimodal feedback. Under certain mild conditions, we show that the equation with unimodal type nonlinearity can generate rich dynamics as the parameter varies. To be specific, global attractivity of the positive stationary state is obtained in a set of nonnegative bounded continuous functions, when the stationary state is less than a value implicitly determined by a condition on the unimodal feedback. The general results of global attractivity are illustrated through two examples arising from population dynamics. Moreover, Hopf bifurcations are demonstrated in the examples when the positive stationary states lose global attractivity.

Dynamics of a nonstandard finite-difference scheme for delay differential equations with unimodal feedback

In this article, by a nonstandard finite-difference (NSFD) scheme we study the dynamics of the delay differential equation with unimodal feedback. First, under three cases local stability of the equilibria is discussed according to Schur polynomial and Hopf bifurcation theory of discrete system. Then, the explicit algorithms for determining the direction of the Hopf bifurcation and the stability of the bifurcating periodic solutions are derived, using the normal form method and center manifold theorem. In Section 4, numerical example using Nicholson’s blowflies equation is provided to illustrate the theoretical results. Finally, it demonstrates significant superiority of nonstandard finite-difference scheme than Euler method under the means of describing approximately the dynamics of the original system.

On the global attractor of delay differential equations with unimodal feedback

We give bounds for the global attractor of the delay differential equation $x'(t) =-\mu x(t)+f(x(t-\tau))$, where $f$ is unimodal and has negative Schwarzian derivative. If $f$ and $\mu$ satisfy certain condition, then, regardless of the delay, all solutions enter the domain where f is monotone decreasing and the powerful results for delayed monotone feedback can be applied to describe the asymptotic behaviour of solutions. In this situation we determine the sharpest interval that contains the global attractor for any delay. In the absence of that condition, improving earlier results, we show that if the d5A5Aelay is sufficiently small, then all solution enter the domain where $f'$ is negative. Our theorems then are illustrated by numerical examples using Nicholson's blowflies equation and the Mackey-Glass equation.

Domain-decomposition method for the global dynamics of delay differential equations with unimodal feedback

The dynamics generated by the delay differential equation with unimodal feedback is studied. The existence of the global attractor is shown and bounds of the attractor are given. We find attractive invariant intervals and give sufficient conditions that guarantee that all solutions enter the domain where f ′ is negative with respect to a positive equilibrium, so the results for delayed monotone feedback can be applied to describe the asymptotic behaviour of solutions. In particular, the existence of heteroclinic orbits from the trivial equilibrium to a periodic orbit oscillating around the positive equilibrium is established. Numerical examples using Nicholson's blowflies equation and the Mackey–Glass equation are provided to illustrate the main results.

Multimodal feedback: an assessment of performance and mental workload

Multimodal interfaces offer great potential to humanize interactions with computers by employing a multitude of perceptual channels. This paper reports on a novel multimodal interface using auditory, haptic and visual feedback in a direct manipulation task to establish new recommendations for multimodal feedback, in particular uni-, bi- and trimodal feedback. A close examination of combinations of uni-, bi- and trimodal feedback is necessary to determine which enhances performance without increasing workload. Thirty-two participants were asked to complete a task consisting of a series of ‘drag-and-drops’ while the type of feedback was manipulated. Each participant was exposed to three unimodal feedback conditions, three bimodal feedback conditions and one trimodal feedback condition that used auditory, visual and haptic feedback alone, and in combination. Performance under the different conditions was assessed with measures of trial completion time, target highlight time and a self-reported workload assessment captured by the NASA Task Load Index (NASA-TLX). The findings suggest that certain types of bimodal feedback can enhance performance while lowering self-perceived mental demand.

Foundation for improved interaction by individuals with visual impairments through multimodal feedback

Through an investigation of how the performance of people who have normal visual capabilities is affected by unimodal, bimodal, and trimodal feedback, this research establishes a foundation for presenting effective feedback to enhance the performance of individuals who have visual impairments. Interfaces that employ multiple feedback modalities, such as auditory, haptic, and visual, can enhance user performance for individuals with barriers limiting one or more channels of perception, such as a visual impairment. Results obtained demonstrate the effects of different feedback combinations on mental workload, accuracy, and performance time. Future, similar studies focused on participants with visual impairments will be grounded in this work.