A comprehensive model-based framework for optimal design of biomimetic patterns of electrical stimulation for prosthetic sensation

Abstract

Objective. Touch and proprioception are essential to motor function as shown by the movement deficits that result from the loss of these senses, e.g. due to neuropathy of sensory nerves. To achieve a high-performance brain-controlled prosthetic arm/hand thus requires the restoration of somatosensation, perhaps through intracortical microstimulation (ICMS) of somatosensory cortex (S1). The challenge is to generate patterns of neuronal activation that evoke interpretable percepts. We present a framework to design optimal spatiotemporal patterns of ICMS (STIM) that evoke naturalistic patterns of neuronal activity and demonstrate performance superior to four previous approaches. Approach. We recorded multiunit activity from S1 during a center-out reach task (from proprioceptive neurons in Brodmann’s area 2) and during application of skin indentations (from cutaneous neurons in Brodmann’s area 1). We implemented a computational model of a cortical hypercolumn and used a genetic algorithm to design STIM that evoked patterns of model neuron activity that mimicked their experimentally-measured counterparts. Finally, from the ICMS patterns, the evoked neuronal activity, and the stimulus parameters that gave rise to it, we trained a recurrent neural network (RNN) to learn the mapping function between the physical stimulus and the biomimetic stimulation pattern, i.e. the sensory encoder to be integrated into a neuroprosthetic device. Main results. We identified ICMS patterns that evoked simulated responses that closely approximated the measured responses for neurons within 50 µm of the electrode tip. The RNN-based sensory encoder generalized well to untrained limb movements or skin indentations. STIM designed using the model-based optimization approach outperformed STIM designed using existing linear and nonlinear mappings. Significance. The proposed framework produces an encoder that converts limb state or patterns of pressure exerted onto the prosthetic hand into STIM that evoke naturalistic patterns of neuronal activation.