Bidirectional Brain-machine Interfaces Research Articles

A new full closed-loop brain-machine interface approach based on neural activity: A study based on modeling and experimental studies

BackgroundThe bidirectional brain-machine interfaces algorithms are machines that decode neural response in order to control the external device and encode position of artificial limb to proper electrical stimulation, so that the interface between brain and machine closes. Most BMI researchers typically consider four basic elements: recording technology to extract brain activity, decoding algorithm to translate brain activity to the predicted movement of the external device, external device (prosthetic limb such as a robotic arm), and encoding interface to convert the motion of the external machine to set of the electrical stimulation of the brain. New methodIn this paper, we develop a novel approach for bidirectional brain-machine interface (BMI). First, we propose a neural network model for sensory cortex (S1) connected to the neural network model of motor cortex (M1) considering the topographic mapping between S1 and M1. We use 4-box model in S1 and 4-box in M1 so that each box contains 500 neurons. Individual boxes include inhibitory and excitatory neurons and synapses. Next, we develop a new BMI algorithm based on neural activity. The main concept of this BMI algorithm is to close the loop between brain and mechaical external device. ResultsThe sensory interface as encoding algorithm convert the location of the external device (artificial limb) into the electrical stimulation which excite the S1 model. The motor interface as decoding algorithm convert neural recordings from the M1 model into a force which causes the movement of the external device. We present the simulation results for the on line BMI which means that there is a real time information exchange between 9 boxes and 4 boxes of S1-M1 network model and the external device. Also, off line information exchange between brain of five anesthetized rats and externnal device was performed. The proposed BMI algorithm has succeeded in controlling the movement of the mechanical arm towards the target area on simulation and experimental data, so that the BMI algorithm shows acceptable WTPE and the average number of iterations of the algorithm in reaching artificial limb to the target region.Comparison with existing methods and Conclusions: In order to confirm the simulation results the 9-box model of S1-M1 network was developed and the valid “spike train” algorithm, which has good results on real data, is used to compare the performance accuracy of the proposed BMI algorithm versus “spike train” algorithm on simulation and off line experimental data of anesthetized rats. Quantitative and qualitative results confirm the proper performance of the proposed algorithm compared to algorithm “spike train” on simulations and experimental data.

State-Dependent Decoding Algorithms Improve the Performance of a Bidirectional BMI in Anesthetized Rats.

Brain-machine interfaces (BMIs) promise to improve the quality of life of patients suffering from sensory and motor disabilities by creating a direct communication channel between the brain and the external world. Yet, their performance is currently limited by the relatively small amount of information that can be decoded from neural activity recorded form the brain. We have recently proposed that such decoding performance may be improved when using state-dependent decoding algorithms that predict and discount the large component of the trial-to-trial variability of neural activity which is due to the dependence of neural responses on the network's current internal state. Here we tested this idea by using a bidirectional BMI to investigate the gain in performance arising from using a state-dependent decoding algorithm. This BMI, implemented in anesthetized rats, controlled the movement of a dynamical system using neural activity decoded from motor cortex and fed back to the brain the dynamical system's position by electrically microstimulating somatosensory cortex. We found that using state-dependent algorithms that tracked the dynamics of ongoing activity led to an increase in the amount of information extracted form neural activity by 22%, with a consequently increase in all of the indices measuring the BMI's performance in controlling the dynamical system. This suggests that state-dependent decoding algorithms may be used to enhance BMIs at moderate computational cost.

A Bidirectional Brain-Machine Interface Featuring a Neuromorphic Hardware Decoder.

Bidirectional brain-machine interfaces (BMIs) establish a two-way direct communication link between the brain and the external world. A decoder translates recorded neural activity into motor commands and an encoder delivers sensory information collected from the environment directly to the brain creating a closed-loop system. These two modules are typically integrated in bulky external devices. However, the clinical support of patients with severe motor and sensory deficits requires compact, low-power, and fully implantable systems that can decode neural signals to control external devices. As a first step toward this goal, we developed a modular bidirectional BMI setup that uses a compact neuromorphic processor as a decoder. On this chip we implemented a network of spiking neurons built using its ultra-low-power mixed-signal analog/digital circuits. On-chip on-line spike-timing-dependent plasticity synapse circuits enabled the network to learn to decode neural signals recorded from the brain into motor outputs controlling the movements of an external device. The modularity of the BMI allowed us to tune the individual components of the setup without modifying the whole system. In this paper, we present the features of this modular BMI and describe how we configured the network of spiking neuron circuits to implement the decoder and to coordinate it with the encoder in an experimental BMI paradigm that connects bidirectionally the brain of an anesthetized rat with an external object. We show that the chip learned the decoding task correctly, allowing the interfaced brain to control the object's trajectories robustly. Based on our demonstration, we propose that neuromorphic technology is mature enough for the development of BMI modules that are sufficiently low-power and compact, while being highly computationally powerful and adaptive.

A non-linear mapping algorithm shaping the control policy of a bidirectional brain machine interface.

Motor brain-machine interfaces (BMIs) transform neural activities recorded directly from the brain into motor commands to control the movements of an external object by establishing an interface between the central nervous system (CNS) and the device. Bidirectional BMIs are closed-loop systems that add a sensory channel to provide the brain with an artificial feedback signal produced by the interaction between the device and the external world. Taking inspiration from the functioning of the spinal cord in mammalians, in our previous works we designed and developed a bidirectional BMI that uses the neural signals recorded form rats' motor cortex to control the movement of an external object. We implemented a decoding interface based on the approximation of a predefined force field with a central attractor point. Now we consider a non-linear transformation that allows to design a decoder approximating force fields with arbitrary attractors. We describe here the non-linear mapping algorithm and preliminary results of its use with behaving rats.

Intracortical Brain-Machine Interfaces Advance Sensorimotor Neuroscience.

Brain-machine interfaces (BMIs) decode brain activity to control external devices. Over the past two decades, the BMI community has grown tremendously and reached some impressive milestones, including the first human clinical trials using chronically implanted intracortical electrodes. It has also contributed experimental paradigms and important findings to basic neuroscience. In this review, we discuss neuroscience achievements stemming from BMI research, specifically that based upon upper limb prosthetic control with intracortical microelectrodes. We will focus on three main areas: first, we discuss progress in neural coding of reaches in motor cortex, describing recent results linking high dimensional representations of cortical activity to muscle activation. Next, we describe recent findings on learning and plasticity in motor cortex on various time scales. Finally, we discuss how bidirectional BMIs have led to better understanding of somatosensation in and related to motor cortex.

A bidirectional brain-machine interface algorithm that approximates arbitrary force-fields.

We examine bidirectional brain-machine interfaces that control external devices in a closed loop by decoding motor cortical activity to command the device and by encoding the state of the device by delivering electrical stimuli to sensory areas. Although it is possible to design this artificial sensory-motor interaction while maintaining two independent channels of communication, here we propose a rule that closes the loop between flows of sensory and motor information in a way that approximates a desired dynamical policy expressed as a field of forces acting upon the controlled external device. We previously developed a first implementation of this approach based on linear decoding of neural activity recorded from the motor cortex into a set of forces (a force field) applied to a point mass, and on encoding of position of the point mass into patterns of electrical stimuli delivered to somatosensory areas. However, this previous algorithm had the limitation that it only worked in situations when the position-to-force map to be implemented is invertible. Here we overcome this limitation by developing a new non-linear form of the bidirectional interface that can approximate a virtually unlimited family of continuous fields. The new algorithm bases both the encoding of position information and the decoding of motor cortical activity on an explicit map between spike trains and the state space of the device computed with Multi-Dimensional-Scaling. We present a detailed computational analysis of the performance of the interface and a validation of its robustness by using synthetic neural responses in a simulated sensory-motor loop.

Neural Feedback for Instantaneous Spatiotemporal Modulation of Afferent Pathways in Bi-Directional Brain–Machine Interfaces

In bi-directional brain-machine interfaces (BMIs), precisely controlling the delivery of microstimulation, both in space and in time, is critical to continuously modulate the neural activity patterns that carry information about the state of the brain-actuated device to sensory areas in the brain. In this paper, we investigate the use of neural feedback to control the spatiotemporal firing patterns of neural ensembles in a model of the thalamocortical pathway. Control of pyramidal (PY) cells in the primary somatosensory cortex (S1) is achieved based on microstimulation of thalamic relay cells through multiple-input multiple-output (MIMO) feedback controllers. This closed loop feedback control mechanism is achieved by simultaneously varying the stimulation parameters across multiple stimulation electrodes in the thalamic circuit based on continuous monitoring of the difference between reference patterns and the evoked responses of the cortical PY cells. We demonstrate that it is feasible to achieve a desired level of performance by controlling the firing activity pattern of a few "key" neural elements in the network. Our results suggest that neural feedback could be an effective method to facilitate the delivery of information to the cortex to substitute lost sensory inputs in cortically controlled BMIs.

New perspectives on the dialogue between brains and machines

Brain-machine interfaces (BMIs) are mostly investigated as a means to provide paralyzed people with new communication channels with the external world. However, the communication between brain and artificial devices also offers a unique opportunity to study the dynamical properties of neural systems. This review focuses on bidirectional interfaces, which operate in two ways by translating neural signals into input commands for the device and the output of the device into neural stimuli. We discuss how bidirectional BMIs help investigating neural information processing and how neural dynamics may participate in the control of external devices. In this respect, a bidirectional BMI can be regarded as a fancy combination of neural recording and stimulation apparatus, connected via an artificial body. The artificial body can be designed in virtually infinite ways in order to observe different aspects of neural dynamics and to approximate desired control policies.

A brain-machine interface instructed by direct intracortical microstimulation

Brain–machine interfaces (BMIs) establish direct communication between the brain and artificial actuators. As such, they hold considerable promise for restoring mobility and communication in patients suffering from severe body paralysis. To achieve this end, future BMIs must also provide a means for delivering sensory signals from the actuators back to the brain. Prosthetic sensation is needed so that neuroprostheses can be better perceived and controlled. Here we show that a direct intracortical input can be added to a BMI to instruct rhesus monkeys in choosing the direction of reaching movements generated by the BMI. Somatosensory instructions were provided to two monkeys operating the BMI using either: (a) vibrotactile stimulation of the monkey's hands or (b) multi-channel intracortical microstimulation (ICMS) delivered to the primary somatosensory cortex (S1) in one monkey and posterior parietal cortex (PP) in the other. Stimulus delivery was contingent on the position of the computer cursor: the monkey placed it in the center of the screen to receive machine–brain recursive input. After 2 weeks of training, the same level of proficiency in utilizing somatosensory information was achieved with ICMS of S1 as with the stimulus delivered to the hand skin. ICMS of PP was not effective. These results indicate that direct, bi-directional communication between the brain and neuroprosthetic devices can be achieved through the combination of chronic multi-electrode recording and microstimulation of S1. We propose that in the future, bidirectional BMIs incorporating ICMS may become an effective paradigm for sensorizing neuroprosthetic devices.

A 5 $\mu$W/Channel Spectral Analysis IC for Chronic Bidirectional Brain–Machine Interfaces

This paper describes an amplification and spectral processing IC for extracting key bioelectrical signals, or ldquobiomarkersrdquo, which are expressed in the brain's field potentials. The intent is to explore using these biomarkers to drive prosthetic actuators or titrate therapy devices such as a deep-brain neurostimulator. The prototype IC uses 5 muW/channel to resolve signals on the order of 1 muV <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">rms</sub> . The four channels on the device provide independent spectral analysis from DC to 1 kHz, with variable bandwidth and power filtering characteristics. The noise floor and flexible spectral processing support a broad range of potential applications including sleep staging, Parkinson's disease, detection of movement intention for neuroprosthesis, and detection of high frequency ldquofast ripplesrdquo for exploring seizure prediction. To fully demonstrate the IC's functionality, we include results from a prototype ldquoclosed-looprdquo neurostimulator implementing adaptive titration of therapy based on measured field potential activity.