Individual Finger Control Research Articles

Extra-neural signals from severed nerves enable intrinsic hand movements in transhumeral amputations

Robotic prostheses controlled by myoelectric signals can restore limited but important hand function in individuals with upper limb amputation. The lack of individual finger control highlights the yet insurmountable gap to fully replacing a biological hand. Implanted electrodes around severed nerves have been used to elicit sensations perceived as arising from the missing limb, but using such extra-neural electrodes to record motor signals that allow for the decoding of phantom movements has remained elusive. Here, we showed the feasibility of using signals from non-penetrating neural electrodes to decode intrinsic hand and finger movements in individuals with above-elbow amputations. We found that information recorded with extra-neural electrodes alone was enough to decode phantom hand and individual finger movements, and as expected, the addition of myoelectric signals reduced classification errors both in offline and in real-time decoding.

Extended home use of an advanced osseointegrated prosthetic arm improves function, performance, and control efficiency

Objective. Full restoration of arm function using a prosthesis remains a grand challenge; however, advances in robotic hardware, surgical interventions, and machine learning are bringing seamless human-machine interfacing closer to reality. Approach. Through extensive data logging over 1 year, we monitored at-home use of the dexterous Modular Prosthetic Limb controlled through pattern recognition of electromyography (EMG) by an individual with a transhumeral amputation, targeted muscle reinnervation, and osseointegration (OI). Main results. Throughout the study, continuous prosthesis usage increased (1% per week, p < 0.001) and functional metrics improved up to 26% on control assessments and 76% on perceived workload evaluations. We observed increases in torque loading on the OI implant (up to 12.5% every month, p < 0.001) and prosthesis control performance (0.5% every month, p < 0.005), indicating enhanced user integration, acceptance, and proficiency. More importantly, the EMG signal magnitude necessary for prosthesis control decreased, up to 34.7% (p < 0.001), over time without degrading performance, demonstrating improved control efficiency with a machine learning-based myoelectric pattern recognition algorithm. The participant controlled the prosthesis up to one month without updating the pattern recognition algorithm. The participant customized prosthesis movements to perform specific tasks, such as individual finger control for piano playing and hand gestures for communication, which likely contributed to continued usage. Significance. This work demonstrates, in a single participant, the functional benefit of unconstrained use of a highly anthropomorphic prosthetic limb over an extended period. While hurdles remain for widespread use, including device reliability, results replication, and technical maturity beyond a prototype, this study offers insight as an example of the impact of advanced prosthesis technology for rehabilitation outside the laboratory.

Cortical Decoding of Individual Finger Group Motions Using ReFIT Kalman Filter.

Objective: To date, many brain-machine interface (BMI) studies have developed decoding algorithms for neuroprostheses that provide users with precise control of upper arm reaches with some limited grasping capabilities. However, comparatively few have focused on quantifying the performance of precise finger control. Here we expand upon this work by investigating online control of individual finger groups.Approach: We have developed a novel training manipulandum for non-human primate (NHP) studies to isolate the movements of two specific finger groups: index and middle-ring-pinkie (MRP) fingers. We use this device in combination with the ReFIT (Recalibrated Feedback Intention-Trained) Kalman filter to decode the position of each finger group during a single degree of freedom task in two rhesus macaques with Utah arrays in motor cortex. The ReFIT Kalman filter uses a two-stage training approach that improves online control of upper arm tasks with substantial reductions in orbiting time, thus making it a logical first choice for precise finger control.Results: Both animals were able to reliably acquire fingertip targets with both index and MRP fingers, which they did in blocks of finger group specific trials. Decoding from motor signals online, the ReFIT Kalman filter reliably outperformed the standard Kalman filter, measured by bit rate, across all tested finger groups and movements by 31.0 and 35.2%. These decoders were robust when the manipulandum was removed during online control. While index finger movements and middle-ring-pinkie finger movements could be differentiated from each other with 81.7% accuracy across both subjects, the linear Kalman filter was not sufficient for decoding both finger groups together due to significant unwanted movement in the stationary finger, potentially due to co-contraction.Significance: To our knowledge, this is the first systematic and biomimetic separation of digits for continuous online decoding in a NHP as well as the first demonstration of the ReFIT Kalman filter improving the performance of precise finger decoding. These results suggest that novel nonlinear approaches, apparently not necessary for center out reaches or gross hand motions, may be necessary to achieve independent and precise control of individual fingers.

Tendon displacements during voluntary and involuntary finger movements

In the human hand, independent movement control of individual fingers is limited. One potential cause for this is mechanical connections between the tendons and muscle bellies corresponding to the different fingers. The aim of this study was to determine the tendon displacement of the flexor digitorum superficialis (FDS) of both the instructed and the neighboring, non-instructed fingers during single finger flexion movements. In nine healthy subjects (age 22–29 years), instructed and non-instructed FDS finger tendon displacement of the index, middle and ring finger was measured using 2D ultrasound analyzed with speckle tracking software in two conditions: active flexion of all finger joints with all fingers free to move and active flexion while the non-instructed fingers were restricted. Our results of the free movement protocol showed an average tendon displacement of 27 mm for index finger flexion, 21 mm for middle finger flexion and 17 mm for ring finger flexion. Displacements of the non-instructed finger tendons (≈12 mm) were higher than expected based of the amount of non-instructed finger movement. In the restricted protocol, we found that, despite minimal joint movements, substantial non-instructed finger tendon displacement (≈9 mm) was still observed, which was interpreted as a result of tendon strain. When this strain component was subtracted from the tendon displacement of the non-instructed fingers during the free movement condition, the relationship between finger movement and tendon displacement of the instructed and non-instructed finger became comparable. Thus, when studying non-instructed finger tendon displacement it is important to take tendon strain into consideration.

Multichannel electrotactile feedback for simultaneous and proportional myoelectric control

Objective. Closing the loop in myoelectric prostheses by providing artificial somatosensory feedback to the user is an important need for prosthetic users. Previous studies investigated feedback strategies in combination with the control of one degree of freedom of simple grippers. Modern hands, however, are sophisticated multifunction systems. In this study, we assessed multichannel electrotactile feedback integrated with an advanced method for the simultaneous and proportional control of individual fingers of a dexterous hand. Approach. The feedback used spatial and frequency coding to provide information on the finger positions (normalized flexion angles). A comprehensive set of conditions have been investigated in 28 able-bodied subjects, including feedback modalities (visual, electrotactile and no feedback), control tasks (fingers and grasps), systems (virtual and real hand), control methods (ideal and realistic) and range of motion (low and high). The task for the subjects was to operate the hand using closed-loop myoelectric control and generate the desired movement (e.g., selected finger or grasp at a specific level of closure). Main results. The subjects could perceive the multichannel and multivariable electrotactile feedback and effectively exploit it to improve the control performance with respect to open-loop grasping. The improvement however depended on the reliability of the feedforward control, with less consistent control exhibiting performance trends that were more complex across the conditions. Significance. The results are promising for the potential application of advanced feedback to close the control loop in sophisticated prosthetic systems.

Proportional estimation of finger movements from high-density surface electromyography.

BackgroundThe importance to restore the hand function following an injury/disease of the nervous system led to the development of novel rehabilitation interventions. Surface electromyography can be used to create a user-driven control of a rehabilitation robot, in which the subject needs to engage actively, by using spared voluntary activation to trigger the assistance of the robot.MethodsThe study investigated methods for the selective estimation of individual finger movements from high-density surface electromyographic signals (HD-sEMG) with minimal interference between movements of other fingers. Regression was evaluated in online and offline control tests with nine healthy subjects (per test) using a linear discriminant analysis classifier (LDA), a common spatial patterns proportional estimator (CSP-PE), and a thresholding (THR) algorithm. In all tests, the subjects performed an isometric force tracking task guided by a moving visual marker indicating the contraction type (flexion/extension), desired activation level and the finger that should be moved. The outcome measures were mean square error (nMSE) between the reference and generated trajectories normalized to the peak-to-peak value of the reference, the classification accuracy (CA), the mean amplitude of the false activations (MAFA) and, in the offline tests only, the Pearson correlation coefficient (PCORR).ResultsThe offline tests demonstrated that, for the reduced number of electrodes (≤24), the CSP-PE outperformed the LDA with higher precision of proportional estimation and less crosstalk between the movement classes (e.g., 8 electrodes, median MAFA ~ 0.6 vs. 1.1 %, median nMSE ~ 4.3 vs. 5.5 %). The LDA and the CSP-PE performed similarly in the online tests (median nMSE < 3.6 %, median MAFA < 0.7 %), but the CSP-PE provided a more stable performance across the tested conditions (less improvement between different sessions). Furthermore, THR, exploiting topographical information about the single finger activity from HD-sEMG, provided in many cases a regression accuracy similar to that of the pattern recognition techniques, but the performance was not consistent across subjects and fingers.ConclusionsThe CSP-PE is a method of choice for selective individual finger control with the limited number of electrodes (<24), whereas for the higher resolution of the recording, either method (CPS-PA or LDA) can be used with a similar performance. Despite the abundance of detection points, the simple THR showed to be significantly worse compared to both pattern recognition/regression methods. Nevertheless, THR is a simple method to apply (no training), and it could still give satisfactory performance in some subjects and/or simpler scenarios (e.g., control of selected fingers). These conclusions are important for guiding future developments towards the clinical application of the methods for individual finger control in rehabilitation robotics.

Individual finger control of a modular prosthetic limb using high-density electrocorticography in a human subject

Objective. We used native sensorimotor representations of fingers in a brain–machine interface (BMI) to achieve immediate online control of individual prosthetic fingers. Approach. Using high gamma responses recorded with a high-density electrocorticography (ECoG) array, we rapidly mapped the functional anatomy of cued finger movements. We used these cortical maps to select ECoG electrodes for a hierarchical linear discriminant analysis classification scheme to predict: (1) if any finger was moving, and, if so, (2) which digit was moving. To account for sensory feedback, we also mapped the spatiotemporal activation elicited by vibrotactile stimulation. Finally, we used this prediction framework to provide immediate online control over individual fingers of the Johns Hopkins University Applied Physics Laboratory modular prosthetic limb. Main results. The balanced classification accuracy for detection of movements during the online control session was 92% (chance: 50%). At the onset of movement, finger classification was 76% (chance: 20%), and 88% (chance: 25%) if the pinky and ring finger movements were coupled. Balanced accuracy of fully flexing the cued finger was 64%, and 77% had we combined pinky and ring commands. Offline decoding yielded a peak finger decoding accuracy of 96.5% (chance: 20%) when using an optimized selection of electrodes. Offline analysis demonstrated significant finger-specific activations throughout sensorimotor cortex. Activations either prior to movement onset or during sensory feedback led to discriminable finger control. Significance. Our results demonstrate the ability of ECoG-based BMIs to leverage the native functional anatomy of sensorimotor cortical populations to immediately control individual finger movements in real time.

Single trial discrimination of individual finger movements on one hand: A combined MEG and EEG study

It is crucial to understand what brain signals can be decoded from single trials with different recording techniques for the development of Brain-Machine Interfaces. A specific challenge for non-invasive recording methods are activations confined to small spatial areas on the cortex such as the finger representation of one hand. Here we study the information content of single trial brain activity in non-invasive MEG and EEG recordings elicited by finger movements of one hand. We investigate the feasibility of decoding which of four fingers of one hand performed a slight button press. With MEG we demonstrate reliable discrimination of single button presses performed with the thumb, the index, the middle or the little finger (average over all subjects and fingers 57%, best subject 70%, empirical guessing level: 25.1%). EEG decoding performance was less robust (average over all subjects and fingers 43%, best subject 54%, empirical guessing level 25.1%). Spatiotemporal patterns of amplitude variations in the time series provided best information for discriminating finger movements. Non-phase-locked changes of mu and beta oscillations were less predictive. Movement related high gamma oscillations were observed in average induced oscillation amplitudes in the MEG but did not provide sufficient information about the finger's identity in single trials. Importantly, pre-movement neuronal activity provided information about the preparation of the movement of a specific finger. Our study demonstrates the potential of non-invasive MEG to provide informative features for individual finger control in a Brain-Machine Interface neuroprosthesis.

Single degree-of-freedom exoskeleton mechanism design for finger rehabilitation.

This paper presents the kinematic design of a single degree-of-freedom exoskeleton mechanism: a planar eight-bar mechanism for finger curling. The mechanism is part of a finger-thumb robotic device for hand therapy that will allow users to practice key pinch grip and finger-thumb opposition, allowing discrete control inputs for playing notes on a musical gaming interface. This approach uses the mechanism to generate the desired grasping trajectory rather than actuating the joints of the fingers and thumb independently. In addition, the mechanism is confined to the back of the hand, so as to allow sensory input into the palm of the hand, minimal size and apparent inertia, and the possibility of placing multiple mechanisms side-by-side to allow control of individual fingers.

Hierarchical organisation of neuro-anatomical constraints in interlimb coordination

Based on the observation that bimanual finger tapping movements tend toward mirror symmetry with respect to the body midline, despite the synchronous activation of non-homologous muscles, F. Mechsner, D. Kerzel, G. Knoblich, and W. Prinz (2001) [Perceptual basis of bimanual coordination. Nature, 414, 69–73] suggested that the basis of rhythmic coordination is purely spatial/perceptual in nature, and independent of the neuro-anatomical constraints of the motor system. To investigate this issue further, we employed a four finger tapping task similar to that used by F. Mechsner and G. Knoblich (2004) [Do muscle matter in bimanual coordination? Journal of Experimental Psychology: Human Perception and Performance, 30, 490–503] in which six male participants were required to alternately tap combinations of adjacent pairs of index (I), middle (M) and ring (R) fingers of each hand in time with an auditory metronome. The metronome pace increased continuously from 1Hz to 3Hz over the course of a 30-s trial. Each participant performed three blocks of trials in which finger combination for each hand (IM or MR) and mode of coordination (mirror or parallel) were presented in random order. Within each block, the right hand was placed in one of three orientations; prone, neutral and supine. The order of blocks was counterbalanced across the six participants. The left hand maintained a prone position throughout the experiment. On the basis of discrete relative phase analyses between synchronised taps, the time at which the initial mode of coordination was lost was determined for each trial. When the right hand was prone, transitions occurred only from parallel symmetry to mirror symmetry, regardless of finger combination. In contrast, when the right hand was supine, transitions occurred only from mirror symmetry to parallel but no transitions were observed in the opposite direction. In the right hand neutral condition, mirror and parallel symmetry are insufficient to describe the modes of coordination since the hands are oriented orthogonally. When defined anatomically, however, the results in each of the three right hand orientations are consistent. That is, synchronisation of finger tapping is determined by a hierarchy of control of individual fingers based on their intrinsic neuro-mechanical properties rather than on the basis of their spatial orientation.