Myoelectric Control Research Articles

A multifaceted suite of metrics for comparative myoelectric prosthesis controller research.

Upper limb robotic (myoelectric) prostheses are technologically advanced, but challenging to use. In response, substantial research is being done to develop person-specific prosthesis controllers that can predict a user's intended movements. Most studies that test and compare new controllers rely on simple assessment measures such as task scores (e.g., number of objects moved across a barrier) or duration-based measures (e.g., overall task completion time). These assessment measures, however, fail to capture valuable details about: the quality of device arm movements; whether these movements match users' intentions; the timing of specific wrist and hand control functions; and users' opinions regarding overall device reliability and controller training requirements. In this work, we present a comprehensive and novel suite of myoelectric prosthesis control evaluation metrics that better facilitates analysis of device movement details-spanning measures of task performance, control characteristics, and user experience. As a case example of their use and research viability, we applied these metrics in real-time control experimentation. Here, eight participants without upper limb impairment compared device control offered by a deep learning-based controller (recurrent convolutional neural network-based classification with transfer learning, or RCNN-TL) to that of a commonly used controller (linear discriminant analysis, or LDA). The participants wore a simulated prosthesis and performed complex functional tasks across multiple limb positions. Analysis resulting from our suite of metrics identified 16 instances of a user-facing problem known as the "limb position effect". We determined that RCNN-TL performed the same as or significantly better than LDA in four such problem instances. We also confirmed that transfer learning can minimize user training burden. Overall, this study contributes a multifaceted new suite of control evaluation metrics, along with a guide to their application, for use in research and testing of myoelectric controllers today, and potentially for use in broader rehabilitation technologies of the future.

A Comparison of Myoelectric Control Modes for an Assistive Robotic Virtual Platform.

In this paper, we propose a daily living situation where objects in a kitchen can be grasped and stored in specific containers using a virtual robot arm operated by different myoelectric control modes. The main goal of this study is to prove the feasibility of providing virtual environments controlled through surface electromyography that can be used for the future training of people using prosthetics or with upper limb motor impairments. We propose that simple control algorithms can be a more natural and robust way to interact with prostheses and assistive robotics in general than complex multipurpose machine learning approaches. Additionally, we discuss the advantages and disadvantages of adding intelligence to the setup to automatically assist grasping activities. The results show very good performance across all participants who share similar opinions regarding the execution of each of the proposed control modes.

Intelligent Human-Computer Interaction: Combined Wrist and Forearm Myoelectric Signals for Handwriting Recognition.

Recent studies have highlighted the possibility of using surface electromyographic (EMG) signals to develop human-computer interfaces that are also able to recognize complex motor tasks involving the hand as the handwriting of digits. However, the automatic recognition of words from EMG information has not yet been studied. The aim of this study is to investigate the feasibility of using combined forearm and wrist EMG probes for solving the handwriting recognition problem of 30 words with consolidated machine-learning techniques and aggregating state-of-the-art features extracted in the time and frequency domains. Six healthy subjects, three females and three males aged between 25 and 40 years, were recruited for the study. Two tests in pattern recognition were conducted to assess the possibility of classifying fine hand movements through EMG signals. The first test was designed to assess the feasibility of using consolidated myoelectric control technology with shallow machine-learning methods in the field of handwriting detection. The second test was implemented to assess if specific feature extraction schemes can guarantee high performances with limited complexity of the processing pipeline. Among support vector machine, linear discriminant analysis, and K-nearest neighbours (KNN), the last one showed the best classification performances in the 30-word classification problem, with a mean accuracy of 95% and 85% when using all the features and a specific feature set known as TDAR, respectively. The obtained results confirmed the validity of using combined wrist and forearm EMG data for intelligent handwriting recognition through pattern recognition approaches in real scenarios.

Context-informed incremental learning improves both the performance and resilience of myoelectric control

Despite its rich history of success in controlling powered prostheses and emerging commercial interests in ubiquitous computing, myoelectric control continues to suffer from a lack of robustness. In particular, EMG-based systems often degrade over prolonged use resulting in tedious recalibration sessions, user frustration, and device abandonment. Unsupervised adaptation is one proposed solution that updates a model’s parameters over time based on its own predictions during real-time use to maintain robustness without requiring additional user input or dedicated recalibration. However, these strategies can actually accelerate performance deterioration when they begin to classify (and thus adapt) incorrectly, defeating their own purpose. To overcome these limitations, we propose a novel adaptive learning strategy, Context-Informed Incremental Learning (CIIL), that leverages in situ context to better inform the prediction of pseudo-labels. In this work, we evaluate these CIIL strategies in an online target acquisition task for two use cases: (1) when there is a lack of training data and (2) when a drastic and enduring alteration in the input space has occurred. A total of 32 participants were evaluated across the two experiments. The results show that the CIIL strategies significantly outperform the current state-of-the-art unsupervised high-confidence adaptation and outperform models trained with the conventional screen-guided training approach, even after a 45-degree electrode shift (p < 0.05). Consequently, CIIL has substantial implications for the future of myoelectric control, potentially reducing the training burden while bolstering model robustness, and leading to improved real-time control.

Improving Complex Task Performance in Powered Upper Limb Exoskeletons With Adaptive Proportional Myoelectric Control for User Motor Strategy Tracking

Improving Complex Task Performance in Powered Upper Limb Exoskeletons With Adaptive Proportional Myoelectric Control for User Motor Strategy Tracking

Machine learning for hand pose classification from phasic and tonic EMG signals during bimanual activities in virtual reality.

Myoelectric prostheses have recently shown significant promise for restoring hand function in individuals with upper limb loss or deficiencies, driven by advances in machine learning and increasingly accessible bioelectrical signal acquisition devices. Here, we first introduce and validate a novel experimental paradigm using a virtual reality headset equipped with hand-tracking capabilities to facilitate the recordings of synchronized EMG signals and hand pose estimation. Using both the phasic and tonic EMG components of data acquired through the proposed paradigm, we compare hand gesture classification pipelines based on standard signal processing features, convolutional neural networks, and covariance matrices with Riemannian geometry computed from raw or xDAWN-filtered EMG signals. We demonstrate the performance of the latter for gesture classification using EMG signals. We further hypothesize that introducing physiological knowledge in machine learning models will enhance their performances, leading to better myoelectric prosthesis control. We demonstrate the potential of this approach by using the neurophysiological integration of the "move command" to better separate the phasic and tonic components of the EMG signals, significantly improving the performance of sustained posture recognition. These results pave the way for the development of new cutting-edge machine learning techniques, likely refined by neurophysiology, that will further improve the decoding of real-time natural gestures and, ultimately, the control of myoelectric prostheses.

Study on Gesture Recognition Method with Two-Stream Residual Network Fusing sEMG Signals and Acceleration Signals.

Currently, surface EMG signals have a wide range of applications in human-computer interaction systems. However, selecting features for gesture recognition models based on traditional machine learning can be challenging and may not yield satisfactory results. Considering the strong nonlinear generalization ability of neural networks, this paper proposes a two-stream residual network model with an attention mechanism for gesture recognition. One branch processes surface EMG signals, while the other processes hand acceleration signals. Segmented networks are utilized to fully extract the physiological and kinematic features of the hand. To enhance the model's capacity to learn crucial information, we introduce an attention mechanism after global average pooling. This mechanism strengthens relevant features and weakens irrelevant ones. Finally, the deep features obtained from the two branches of learning are fused to further improve the accuracy of multi-gesture recognition. The experiments conducted on the NinaPro DB2 public dataset resulted in a recognition accuracy of 88.25% for 49 gestures. This demonstrates that our network model can effectively capture gesture features, enhancing accuracy and robustness across various gestures. This approach to multi-source information fusion is expected to provide more accurate and real-time commands for exoskeleton robots and myoelectric prosthetic control systems, thereby enhancing the user experience and the naturalness of robot operation.

Enhancing Robustness of Surface Electromyography Pattern Recognition at Different Arm Positions for Transhumeral Amputees Using Deep Adversarial Inception Domain Adaptation

Pattern recognition in myoelectric control that relies on the myoelectric activity associated with arm motions is an effective control method applied to myoelectric prostheses. Individuals with transhumeral amputation face significant challenges in effectively controlling their prosthetics, as muscle activation varies with changes in arm positions, leading to a notable decrease in the accuracy of motion pattern recognition and consequently resulting in a high rejection rate of prosthetic devices. Therefore, to achieve high accuracy and arm position stability in upper-arm motion recognition, we propose a Deep Adversarial Inception Domain Adaptation (DAIDA) based on the Inception feature module to enhance the generalization ability of the model. Surface electromyography (sEMG) signals were collected from 10 healthy subjects and two transhumeral amputees while performing hand, wrist, and elbow motions at three arm positions. The recognition performance of different feature modules was compared, and ultimately, accurate recognition of upper-arm motions was achieved using the Inception C module with a recognition accuracy of 90.70% ± 9.27%. Subsequently, validation was performed using data from different arm positions as source and target domains, and the results showed that compared to the direct use of a convolutional neural network (CNN), the recognition accuracy on untrained arm positions increased by 75.71% (p &lt; 0.05), with a recognition accuracy of 91.25% ± 6.59%. Similarly, in testing scenarios involving multiple arm positions, there was a significant improvement in recognition accuracy, with recognition accuracy exceeding 90% for both healthy subjects and transhumeral amputees.

Myoelectric control and virtual reality to enhance motor rehabilitation after stroke.

Effective upper-limb rehabilitation for severely impaired stroke survivors is still missing. Recent studies endorse novel motor rehabilitation approaches such as robotic exoskeletons and virtual reality systems to restore the function of the paretic limb of stroke survivors. However, the optimal way to promote the functional reorganization of the central nervous system after a stroke has yet to be uncovered. Electromyographic (EMG) signals have been employed for prosthetic control, but their application to rehabilitation has been limited. Here we propose a novel approach to promote the reorganization of pathological muscle activation patterns and enhance upper-limb motor recovery in stroke survivors by using an EMG-controlled interface to provide personalized assistance while performing movements in virtual reality (VR). We suggest that altering the visual feedback to improve motor performance in VR, thereby reducing the effect of deviations of the actual, dysfunctional muscle patterns from the functional ones, will actively engage patients in motor learning and facilitate the restoration of functional muscle patterns. An EMG-controlled VR interface may facilitate effective rehabilitation by targeting specific changes in the structure of muscle synergies and in their activations that emerged after a stroke-offering the possibility to provide rehabilitation therapies addressing specific individual impairments.

Evaluation of Hand Action Classification Performance Using Machine Learning Based on Signals from Two sEMG Electrodes.

Classification-based myoelectric control has attracted significant interest in recent years, leading to prosthetic hands with advanced functionality, such as multi-grip hands. Thus far, high classification accuracies have been achieved by increasing the number of surface electromyography (sEMG) electrodes or adding other sensing mechanisms. While many prescribed myoelectric hands still adopt two-electrode sEMG systems, detailed studies on signal processing and classification performance are still lacking. In this study, nine able-bodied participants were recruited to perform six typical hand actions, from which sEMG signals from two electrodes were acquired using a Delsys Trigno Research+ acquisition system. Signal processing and machine learning algorithms, specifically, linear discriminant analysis (LDA), k-nearest neighbors (KNN), and support vector machines (SVM), were used to study classification accuracies. Overall classification accuracy of 93 ± 2%, action-specific accuracy of 97 ± 2%, and F1-score of 87 ± 7% were achieved, which are comparable with those reported from multi-electrode systems. The highest accuracies were achieved using SVM algorithm compared to LDA and KNN algorithms. A logarithmic relationship between classification accuracy and number of features was revealed, which plateaued at five features. These comprehensive findings may potentially contribute to signal processing and machine learning strategies for commonly prescribed myoelectric hand systems with two sEMG electrodes to further improve functionality.

Using Serious Games to Measure Upper-Limb Myoelectric Pattern Recognition Prosthesis Control Performance in an At-Home Environment

Using Serious Games to Measure Upper-Limb Myoelectric Pattern Recognition Prosthesis Control Performance in an At-Home Environment

Arm muscle synergies enhance hand posture prediction in combination with forearm muscle synergies

Objective. We analyze and interpret arm and forearm muscle activity in relation with the kinematics of hand pre-shaping during reaching and grasping from the perspective of human synergistic motor control. Approach. Ten subjects performed six tasks involving reaching, grasping and object manipulation. We recorded electromyographic (EMG) signals from arm and forearm muscles with a mix of bipolar electrodes and high-density grids of electrodes. Motion capture was concurrently recorded to estimate hand kinematics. Muscle synergies were extracted separately for arm and forearm muscles, and postural synergies were extracted from hand joint angles. We assessed whether activation coefficients of postural synergies positively correlate with and can be regressed from activation coefficients of muscle synergies. Each type of synergies was clustered across subjects. Main results. We found consistency of the identified synergies across subjects, and we functionally evaluated synergy clusters computed across subjects to identify synergies representative of all subjects. We found a positive correlation between pairs of activation coefficients of muscle and postural synergies with important functional implications. We demonstrated a significant positive contribution in the combination between arm and forearm muscle synergies in estimating hand postural synergies with respect to estimation based on muscle synergies of only one body segment, either arm or forearm (p < 0.01). We found that dimensionality reduction of multi-muscle EMG root mean square (RMS) signals did not significantly affect hand posture estimation, as demonstrated by comparable results with regression of hand angles from EMG RMS signals. Significance. We demonstrated that hand posture prediction improves by combining activity of arm and forearm muscles and we evaluate, for the first time, correlation and regression between activation coefficients of arm muscle and hand postural synergies. Our findings can be beneficial for myoelectric control of hand prosthesis and upper-limb exoskeletons, and for biomarker evaluation during neurorehabilitation.

Improving sEMG-Based Hand Gesture Recognition through Optimizing Parameters and Sliding Voting Classifiers

In this paper, we present a preliminary study that proposes to improve surface electromyography (sEMG)-based hand gesture recognition through optimizing parameters and sliding voting classifiers. Targeting the high-performing myoelectric control system, the traditional methods for hand gesture recognition still need to further improve the classification accuracy and utilization rate for sEMG signals. Therefore, the proposed method first optimizes parameters to reduce redundant information by selecting the proper values for the window length, the overlapping rate, the number of channels, and the features of sEMG signals. In addition, the random forest (RF) classifier is an advanced classifier for sEMG-based hand gesture recognition. To further improve classification performance, this paper proposes a sliding voting random forest (SVRF) classifier which can reduce potential pseudo decisions made by the RF classifier. Finally, experiments were conducted using two sEMG datasets, named DB2 and DB4, from the NinaPro database, as well as self-collected data. The results illustrate a certain improvement in classification accuracy based on the optimized values for window length, overlapping rate, number of channels, and features of sEMG signals. And the SVRF classifier can significantly improve performance with higher accuracy compared with the traditional linear discriminate analysis (LDA), k-nearest neighbors (KNN), support vector machine (SVM), and RF classifiers.

Implications of EMG channel count: enhancing pattern recognition online prosthetic testing.

Myoelectric pattern recognition systems have shown promising control of upper limb powered prostheses and are now commercially available. These pattern recognition systems typically record from up to 8 muscle sites, whereas other control systems use two-site control. While previous offline studies have shown 8 or fewer sites to be optimal, real-time control was not evaluated. Six individuals with no limb absence and four individuals with a transradial amputation controlled a virtual upper limb prosthesis using pattern recognition control with 8 and 16 channels of EMG. Additionally, two of the individuals with a transradial amputation performed the Assessment for Capacity of Myoelectric Control (ACMC) with a multi-articulating hand and wrist prosthesis with the same channel count conditions. Users had significant improvements in control when using 16 compared to 8 EMG channels including decreased classification error (p = 0.006), decreased completion time (p = 0.019), and increased path efficiency (p = 0.013) when controlling a virtual prosthesis. ACMC scores increased by more than three times the minimal detectable change from the 8 to the 16-channel condition. The results of this study indicate that increasing EMG channel count beyond the clinical standard of 8 channels can benefit myoelectric pattern recognition users.

Toward Robust and Accurate Myoelectric Controller Design Based on Multiobjective Optimization Using Evolutionary Computation

Toward Robust and Accurate Myoelectric Controller Design Based on Multiobjective Optimization Using Evolutionary Computation

Targeted muscle reinnervation in bionic upper limb reconstruction: current status and future directions.

Selective nerve transfers are used in the setting of upper limb amputation to improve myoelectric prosthesis control. This surgical concept is referred to as targeted muscle reinnervation (TMR) and describes the rerouting of the major nerves of the arm onto the motor branches of the residual limb musculature. Aside from providing additional myosignals for prosthetic control, TMR can treat and prevent neuroma pain and possibly also phantom limb pain. This article reviews the history and current applications of TMR in upper limb amputation, with a focus on practical considerations. It further explores and identifies technological innovations to improve the man-machine interface in amputation care, particularly regarding implantable interfaces, such as muscle electrodes and osseointegration. Finally, future clinical directions and possible scientific avenues in this field are presented and critically discussed.

Social media analysis of pain outcomes following targeted muscle reinnervation

AimTMR was developed to improve myoelectric prosthesis control for amputees; however, it has become an area of interest in pain modulation. Studies show evidence that this procedure alleviates chronic pain in amputees. The primary objective of this study is to utilize social media analysis to understand patients’ post-operative pain, satisfaction, and recovery time after TMR. MethodsData was collected from one Facebook group via posts and comments referencing TMR. Posts published between January 1st, 2020, and March 24th, 2023, were analyzed. Data collected included pain prior to surgery, pain in immediate post-op period, and how pain changed after surgery. Results43 individuals commented on their TMR experience. 31 had favorable surgical outcomes, 7 felt surgery worsened their pain or there was not significant change in their pain levels, and the remaining 5 commented during the initial post-operative period. 24 patients described their pain in the immediate post-operative period and 100% said that post-operative pain was worse than chronic pain. Of 28 authors who commented on overall reduction in chronic pain, 24 reported TMR reduced their pain, while 4 had no change or worsened pain. ConclusionsThe 24 patients who reported improvement in chronic pain aligns with current literature suggesting that TMR is a viable treatment option for pain. Current medical management of similar conditions leaves up to 80% of patients unsatisfied with pain control. This analysis supports the evidence that TMR is an effective treatment for patients who are experiencing post-amputation pain.

Optimizing the performance of convolutional neural network for enhanced gesture recognition using sEMG

Deep neural networks (DNNs) have demonstrated higher performance results when compared to traditional approaches for implementing robust myoelectric control (MEC) systems. However, the delay induced by optimising a MEC remains a concern for real-time applications. As a result, an optimised DNN architecture based on fine-tuned hyperparameters is required. This study investigates the optimal configuration of convolutional neural network (CNN)-based MEC by proposing an effective data segmentation technique and a generalised set of hyperparameters. Firstly, two segmentation strategies (disjoint and overlap) and various segment and overlap sizes were studied to optimise segmentation parameters. Secondly, to address the challenge of optimising the hyperparameters of a DNN-based MEC system, the problem has been abstracted as an optimisation problem, and Bayesian optimisation has been used to solve it. From 20 healthy people, ten surface electromyography (sEMG) grasping movements abstracted from daily life were chosen as the target gesture set. With an ideal segment size of 200 ms and an overlap size of 80%, the results show that the overlap segmentation technique outperforms the disjoint segmentation technique (p-value < 0.05). In comparison to manual (12.76 ± 4.66), grid (0.10 ± 0.03), and random (0.12 ± 0.05) search hyperparameters optimisation strategies, the proposed optimisation technique resulted in a mean classification error rate (CER) of 0.08 ± 0.03 across all subjects. In addition, a generalised CNN architecture with an optimal set of hyperparameters is proposed. When tested separately on all individuals, the single generalised CNN architecture produced an overall CER of 0.09 ± 0.03. This study's significance lies in its contribution to the field of EMG signal processing by demonstrating the superiority of the overlap segmentation technique, optimizing CNN hyperparameters through Bayesian optimization, and offering practical insights for improving prosthetic control and human–computer interfaces.

Technical Trick: Cryoneurolysis for Subacute Pain Mitigation in Patients With Limb Loss.

Pain after amputation is often managed by target muscle reinnervation (TMR) with the added benefit that TMR also provides improved myoelectric terminal device control. However, as TMR takes several months for the recipient muscles to reliably reinnervate, this technique does not address pain within the subacute postoperative period during which pain chronification, sensitization, and opioid dependence and misuse may occur. Cryoneurolysis, described herein, uses focused, extreme temperatures to essentially "freeze" the nerve, blocking nociception, and improving pain in treated nerves potentially reducing the chances of pain chronification, sensitization, and substance dependence or abuse.

An Interactive Training Model for Myoelectric Regression Control Based on Human–Machine Cooperative Performance

Electromyography-based wearable biosensors are used for prosthetic control. Machine learning prosthetic controllers are based on classification and regression models. The advantage of the regression approach is that it permits us to obtain a smoother and more natural controller. However, the existing training methods for regression-based solutions is the same as the training protocol used in the classification approach, where only a finite set of movements are trained. In this paper, we present a novel training protocol for myoelectric regression-based solutions that include a feedback term that allows us to explore more than a finite set of movements and is automatically adjusted according to real-time performance of the subject during the training session. Consequently, the algorithm distributes the training time efficiently, focusing on the movements where the performance is worse and optimizing the training for each user. We tested and compared the existing and new training strategies in 20 able-bodied participants and 4 amputees. The results show that the novel training procedure autonomously produces a better training session. As a result, the new controller outperforms the one trained with the existing method: for the able-bodied participants, the average number of targets hit is increased from 86% to 95% and the path efficiency from 40% to 84%, while for the subjects with limb deficiencies, the completion rate is increased from 58% to 69% and the path efficiency from 24% to 56%.