Prosthesis Control Research Articles

Hip-Knee Motion-Lagged Coordination Mapping Enables Speed Adaptive Walking for Powered Knee Prosthesis.

The commonly used finite-state-machine (FSM) impedance control for powered prostheses deploys diverse control parameters according to different gait phases, resulting in dozens of parameter adjustments and possible gait phase misrecognition. In contrast, this study presents a straightforward, continuous, and speed-adaptive control approach based on hip-knee motion-lagged coordination mapping (MLCM). The mapping, featured by the motion lag, can effectively generate the prosthetic knee's goal gait within a second-order polynomial. It is also verified from extensive gait analysis that the motion lag and polynomial coefficients evolve linearly with respect to walking speed and gait period, promising a simple real-time deployment for prosthesis control. Experimental validation with two non-disabled subjects and two transfemoral amputees wearing a prosthesis demonstrates the MLCM controller's ability to reduce the hip compensatory behavior, generate biomimetic knee kinematics, stance phase time, stride length, and hip-knee motion coordination across various speeds. Furthermore, compared to the benchmark FSM impedance controller, the MLCM controller reduces the number of control parameters from 17 to 7 and avoids misrecognition during gait phase transitions.

Огляд досліджень в напрямку міоелектричного методу керування біонічним протезом

Myoelectric control of bionic prostheses is an important field of research in the field of rehabilitation. Intuitive and intelligent myoelectric control can restore upper limb function. However, much research now focuses on the development of various myoelectrical and biotechnical control methods, limiting research to the complex daily tasks of prosthetic manipulation, such as grasping and releasing. The article examines the latest advances in the research areas of bionic prosthesis management. In particular, attention is paid to the methods of determining movement intentions, classification of discrete movements, estimation of continuous movements, single-channel control, feedback control and combined control. Motor neurons group input signals from the central nervous system that affect muscles and form motor units. The electromyography (EMG) signal, which is obtained by recording motor neuron action potentials, reflects muscle activity. This signal, oscillating within ±5000 μV with a frequency of 6 to 500 Hz, reflects the characteristics of muscle contraction. Depending on the location of the sensors, EMG signals are divided into intramuscular and surface electromyography. Intramuscular electromyography provides an accurate study of muscle activation, but requires the implantation of sensors, which can lead to physical problems. EMG, which captures a signal from the surface of the skin, is easier to use and is widely used in experiments with myoelectric prostheses.

Combining Surgical Innovations in Amputation Surgery-Robotic Harvest of the Rectus Abdominis Muscle, Transplantation and Targeted Muscle Reinnervation Improves Myocontrol Capability and Pain in a Transradial Amputee.

Adding robotic surgery to bionic reconstruction might open a new dimension. The objective was to evaluate if a robotically harvested rectus abdominis (RA) transplant is a feasible procedure to improve soft-tissue coverage at the residual limb (RL) and serve as a recipient for up to three nerves due to its unique architecture and to allow the generation of additional signals for advanced myoelectric prosthesis control. A transradial amputee with insufficient soft-tissue coverage and painful neuromas underwent the interventions and was observed for 18 months. RA muscle was harvested using robotic-assisted surgery and transplanted to the RL, followed by end-to-end neurroraphy to the recipient nerves of the three muscle segments to reanimate radial, median, and ulnar nerve function. The transplanted muscle healed with partial necrosis of the skin mesh graft. Twelve months later, reliable, and spatially well-defined Hoffmann-Tinel signs were detectable at three segments of the RA muscle flap. No donor-site morbidities were present, and EMG activity could be detected in all three muscle segments. The linear discriminant analysis (LDA) classifier could reliably distinguish three classes within 1% error tolerance using only the three electrodes on the muscle transplant and up to five classes outside the muscle transplant. The combination of these surgical procedure advances with emerging (myo-)control technologies can easily be extended to different amputation levels to reduce RL complications and augment control sites with a limited surface area, thus facilitating the usability of advanced myoelectric prostheses.

A Semiautonomous Control Strategy Based on Computer Vision for a Hand–Wrist Prosthesis

Alleviating the burden on amputees in terms of high-level control of their prosthetic devices is an open research challenge. EMG-based intention detection presents some limitations due to movement artifacts, fatigue, and stability. The integration of exteroceptive sensing can provide a valuable solution to overcome such limitations. In this paper, a novel semiautonomous control system (SCS) for wrist–hand prostheses using a computer vision system (CVS) is proposed and validated. The SCS integrates object detection, grasp selection, and wrist orientation estimation algorithms. By combining CVS with a simulated EMG-based intention detection module, the SCS guarantees reliable prosthesis control. Results show high accuracy in grasping and object classification (≥97%) at a fast frame analysis frequency (2.07 FPS). The SCS achieves an average angular estimation error ≤18° and stability ≤0.8° for the proposed application. Operative tests demonstrate the capabilities of the proposed approach to handle complex real-world scenarios and pave the way for future implementation on a real prosthetic device.

Exploring the EMG transient: the muscular activation sequences used as novel time-domain features for hand gestures classification.

Muscular activation sequences have been shown to be suitable time-domain features for classification of motion gestures. However, their clinical application in myoelectric prosthesis control was never investigated so far. The aim of the paper is to evaluate the robustness of these features extracted from the EMG signal in transient state, on the forearm, for classifying common hand tasks. The signal associated to four hand gestures and the rest condition were acquired from ten healthy people and two persons with trans-radial amputation. A feature extraction algorithm allowed for encoding the EMG signals into muscular activation sequences, which were used to train four commonly used classifiers, namely Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), Non-linear Logistic Regression (NLR) and Artificial Neural Network (ANN). The offline performances were assessed with the entire sample of recruited people. The online performances were assessed with the amputee subjects. Moreover, a comparison of the proposed method with approaches based on the signal envelope in the transient state and in the steady state was conducted. The highest performance were obtained with the NLR classifier. Using the sequences, the offline classification accuracy was higher than 93% for healthy and amputee subjects and always higher than the approach with the signal envelope in transient state. As regards the comparison with the steady state, the performances obtained with the proposed method are slightly lower (<4%), but the classification occurred at least 200 ms earlier. In the online application, the motion completion rate reached up to 85% of the total classification attempts, with a motion selection time that never exceeded 218 ms. Muscular activation sequences are suitable alternatives to the time-domain features commonly used in classification problems belonging to the sole EMG transient state and could be potentially exploited in control strategies of myoelectric prosthesis hands.

A pelvic kinematic approach for calculating hip angles for active hip disarticulation prosthesis control

BackgroundControl system design for a microprocessor-controlled hip–knee–ankle–foot (HKAF) prosthesis is a challenge since hip disarticulation amputees lack the entire leg and, therefore, only have pelvis movement as user-guided input. This research proposes a method for determining hip joint angles from pelvis movement in a control system for the next generation of powered prostheses.MethodThree-dimensional pelvic motion and stance time of 10 transfemoral (TF) prosthetic users were used to identify important features and to develop an algorithm to calculate hip angles from pelvis movement based on correlation and linear regression results. The algorithm was then applied to a separate (independent) TF group to validate algorithm performance.ResultsThe proposed algorithm calculated viable hip angles during walking by utilizing pelvic rotation, pelvic tilt, and stance time. Small angular differences were found between the algorithm results and motion capture data. The greatest difference was for hip maximum extension angle (2.5 ± 2.0°).ConclusionsSince differences between algorithm output and motion data were within participant standard deviations, the developed algorithm could be used to determine the desired hip angle from pelvis movements. This study will aid the future development of gait control systems for new active HKAF prostheses.

Design and control of active lower limb prosthesis with sensorial frame

In this article, we have designed an active prosthesis for the lower limb of a human. The unique design incorporates an exoskeletal extension that serves as a low-cost sensory framework, providing feedback on residual signals, namely the states of the hip and thigh. The controller takes advantage of system modeling and employs a simple proportional–derivative control. A stability analysis has been conducted. We have also provided simulations and analysis of the active prosthesis to evaluate the effectiveness of the design and control.

Realizing Upper Extremity Bionic Limbs: Leveraging Neuroprosthetic Control Strategies.

Innovations in prosthetic devices and neuroprosthetic control strategies have opened new frontiers for the treatment and rehabilitation of individuals undergoing amputation. Commercial prosthetic devices are now available with sophisticated electrical and mechanical components that can closely replicate the functions of the human musculoskeletal system. However, to truly recognize the potential of such prosthetic devices and develop the next generation of bionic limbs, a highly reliable prosthetic device control strategy is required. In the past few years, refined surgical techniques have enabled neuroprosthetic control strategies to record efferent motor and stimulate afferent sensory action potentials from a residual limb with extraordinary specificity, signal quality, and long-term stability. As a result, such control strategies are now capable of facilitating intuitive, real-time, and naturalistic prosthetic experiences for patients with amputations. This article summarizes the current state of upper extremity neuroprosthetic devices and discusses the leading control strategies that are critical to the ongoing advancement of prosthetic development and implementation.

Neural prosthesis control restores near-normative neuromechanics in standing postural control.

Current lower-limb prostheses do not provide active assistance in postural control tasks to maintain the user's balance, particularly in situations of perturbation. In this study, we aimed to address this missing function by enabling neural control of robotic lower-limb prostheses. Specifically, electromyographic (EMG) signals (amplified neural control signals) recorded from antagonistic residual ankle muscles were used to drive a robotic prosthetic ankle directly and continuously. Participants with transtibial amputation were recruited and trained in using the EMG-driven robotic ankle. We studied how using the EMG-controlled ankle affected the participants' anticipatory and compensatory postural control strategies and stability under expected perturbations compared with using their daily passive devices. We investigated the similarity of neuromuscular coordination (by analyzing motor modules) of the participants, using either device in a postural sway task, to that of able-bodied controls. Results showed that, compared with their passive prosthesis, the EMG-controlled prosthesis enabled participants to use near-normative postural control strategies, as evidenced by improved between-limb symmetry in intact-prosthetic center-of-pressure and joint angle excursions. Participants substantially improved postural stability, as evidenced by a reduction in steps or falls using the EMG-controlled prosthetic ankle. Furthermore, after relearning to use residual ankle muscles to drive the robotic ankle in postural control, nearly all participants' motor module structure shifted toward that observed in individuals without limb amputations. Here, we have demonstrated the potential benefit of direct EMG control of robotic lower limb prostheses to restore normative postural control strategies (both neural and biomechanical) toward enhancing standing postural stability in amputee users.

Imperceptive and reusable dermal surface EMG for lower extremity neuro-prosthetic control and clinical assessment

Surface electromyography (sEMG) sensors play a critical role in diagnosing muscle conditions and enabling prosthetic device control, especially for lower extremity robotic legs. However, challenges arise when utilizing such sensors on residual limbs within a silicon liner worn by amputees, where dynamic pressure, narrow space, and perspiration can negatively affect sensor performance. Existing commercial sEMG sensors and newly developed sensors are unsuitable due to size and thickness, or susceptible to damage in this environment. In this paper, our sEMG sensors are tailored for amputees wearing sockets, prioritizing breathability, durability, and reliable recording performance. By employing porous PDMS and Silbione substrates, our design achieves exceptional permeability and adhesive properties. The serpentine electrode pattern and design are optimized to improve stretchability, durability, and effective contact area, resulting in a higher signal-to-noise ratio (SNR) than conventional electrodes. Notably, our proposed sensors wirelessly enable to control of a robotic leg for amputees, demonstrating its practical feasibility and expecting to drive forward neuro-prosthetic control in the clinical research field near future.

Intuitive movement-based prosthesis control enables arm amputees to reach naturally in virtual reality.

Impressive progress is being made in bionic limbs design and control. Yet, controlling the numerous joints of a prosthetic arm necessary to place the hand at a correct position and orientation to grasp objects remains challenging. Here, we designed an intuitive, movement-based prosthesis control that leverages natural arm coordination to predict distal joints missing in people with transhumeral limb loss based on proximal residual limb motion and knowledge of the movement goal. This control was validated on 29 participants, including seven with above-elbow limb loss, who picked and placed bottles in a wide range of locations in virtual reality, with median success rates over 99% and movement times identical to those of natural movements. This control also enabled 15 participants, including three with limb differences, to reach and grasp real objects with a robotic arm operated according to the same principle. Remarkably, this was achieved without any prior training, indicating that this control is intuitive and instantaneously usable. It could be used for phantom limb pain management in virtual reality, or to augment the reaching capabilities of invasive neural interfaces usually more focused on hand and grasp control.

Intuitive movement-based prosthesis control enables arm amputees to reach naturally in virtual reality

Impressive progress is being made in bionic limbs design and control. Yet, controlling the numerous joints of a prosthetic arm necessary to place the hand at a correct position and orientation to grasp objects remains challenging. Here, we designed an intuitive, movement-based prosthesis control that leverages natural arm coordination to predict distal joints missing in people with transhumeral limb loss based on proximal residual limb motion and knowledge of the movement goal. This control was validated on 29 participants, including seven with above-elbow limb loss, who picked and placed bottles in a wide range of locations in virtual reality, with median success rates over 99% and movement times identical to those of natural movements. This control also enabled 15 participants, including three with limb differences, to reach and grasp real objects with a robotic arm operated according to the same principle. Remarkably, this was achieved without any prior training, indicating that this control is intuitive and instantaneously usable. It could be used for phantom limb pain management in virtual reality, or to augment the reaching capabilities of invasive neural interfaces usually more focused on hand and grasp control.

Improving Motion Intention Recognition for Trans-Radial Amputees Based on sEMG and Transfer Learning

Hand motion intentions can be detected by analyzing the surface electromyographic (sEMG) signals obtained from the remaining forearm muscles of trans-radial amputees. This technology sheds new light on myoelectric prosthesis control; however, fewer signals from amputees can be collected in clinical practice. The collected signals can further suffer from quality deterioration due to the muscular atrophy of amputees, which significantly decreases the accuracy of hand motion intention recognition. To overcome these problems, this work proposed a transfer learning strategy combined with a long-exposure-CNN (LECNN) model to improve the amputees’ hand motion intention recognition accuracy. Transfer learning can leverage the knowledge acquired from intact-limb subjects to amputees, and LECNN can effectively capture the information in the sEMG signals. Two datasets with 20 intact-limb and 11 amputated-limb subjects from the Ninapro database were used to develop and evaluate the proposed method. The experimental results demonstrated that the proposed transfer learning strategy significantly improved the recognition performance (78.1%±19.9%, p-value &lt; 0.005) compared with the non-transfer case (73.4%±20.8%). When the source and target data matched well, the after-transfer accuracy could be improved by up to 8.5%. Compared with state-of-the-art methods in two previous studies, the average accuracy was improved by 11.6% (from 67.5% to 78.1%, p-value &lt; 0.005) and 12.1% (from 67.0% to 78.1%, p-value &lt; 0.005). This result is also among the best from the contrast methods.

Volitional EMG Control Enables Stair Climbing with a Robotic Powered Knee Prosthesis.

Existing controllers for robotic powered prostheses regulate the prosthesis speed, timing, and energy generation using predefined position or torque trajectories. This approach enables climbing stairs step-over-step. However, it does not provide amputees with direct volitional control of the robotic prosthesis, a functionality necessary to restore full mobility to the user. Here we show that proportional electromyographic (EMG) control of the prosthesis knee torque enables volitional control of a powered knee prosthesis during stair climbing. The proposed EMG controller continuously regulates knee torque based on activation of the residual hamstrings, measured using a single EMG electrode located within the socket. The EMG signal is mapped to a desired knee flexion/extension torque based on the prosthesis knee position, the residual limb position, and the interaction with the ground. As a result, the proposed EMG controller enabled an above-knee amputee to climb stairs at different speeds, while carrying additional loads, and even backwards. By enabling direct, volitional control of powered robotic knee prostheses, the proposed EMG controller has the potential to improve amputee mobility in the real world.

Powered Knee and Ankle Prosthesis Control for Adaptive Ambulation at Variable Speeds, Inclines, and Uneven Terrains.

Ambulation in everyday life requires walking at variable speeds, variable inclines, and variable terrains. Powered prostheses aim to provide this adaptability through control of the actuated joints. Some powered prosthesis controllers can adapt to discrete changes in speed and incline but require manual tuning to determine the control parameters, leading to poor clinical viability. Other data-driven controllers can continuously adapt to changes in speed and incline but do so by imposing the same non-amputee gait patterns for all amputee subjects, which does not consider subjective preferences and differing clinical needs of users. Here, we present a controller for powered knee and ankle prostheses that can continuously adapt to different walking speeds, inclines, and uneven terrains without enforcing a specific prosthesis position, impedance, or torque. A virtual biarticular muscle connection determines the knee flexion torque, which changes with both speed and slope. Adaptation to inclines and uneven terrains is based solely on the global shank orientation. Continuously variable damping allows for speed adaptation. Minimum-jerk programming defines the prosthesis swing trajectory at variable cadences. Experiments with one individual with an above-knee amputation suggest that the proposed controller can effectively adapt to different walking speeds, inclines, and rough terrains.

Improving Amputee Endurance over Activities of Daily Living with a Robotic Knee-Ankle Prosthesis: A Case Study.

Robotic knee-ankle prostheses have often fallen short relative to passive microprocessor prostheses in time-based clinical outcome tests. User ambulation endurance is an alternative clinical outcome metric that may better highlight the benefits of robotic prostheses. However, previous studies were unable to show endurance benefits due to inaccurate high-level classification, discretized mid-level control, and insufficiently difficult ambulation tasks. In this case study, we present a phase-based mid-level prosthesis controller which yields biomimetic joint kinematics and kinetics that adjust to suit a continuum of tasks. We enrolled an individual with an above-knee amputation and challenged him to perform repeated, rapid laps of a circuit comprising activities of daily living with both his passive prosthesis and a robotic prosthesis. The participant demonstrated improved endurance with the robotic prosthesis and our mid-level controller compared to his passive prosthesis, completing over twice as many total laps before fatigue and muscle discomfort required him to stop. We also show that time-based outcome metrics fail to capture this endurance improvement, suggesting that alternative metrics related to endurance and fatigue may better highlight the clinical benefits of robotic prostheses.

Essential neural anatomy for creating a clinically translatable osseointegrated neural interface for prosthetic control in sheep

Aim: Ovine models for osseointegrated prosthetics research are well established, but do not consider neural control of advanced prostheses. The validity of interfacing technologies, such as the Osseointegrated Neural Interface (ONI), in their ability to provide communication between native nerves and advanced prosthetics is required, necessitating a stable, longitudinal large animal model for testing. The objective of this study is to provide a detailed anatomic description of the major nerves distal to the carpal and tarsal joints, informing the creation of a chronic ONI for prosthetic control in sheep. Methods: Six pelvic and six thoracic cadaveric limbs from mature female, non-lactating sheep were utilized. Radiographs were obtained to determine average bone length, medullary canal diameter, and cortical bone thickness. Microsurgical dissection was performed to discern topographical neuroanatomy and average circumferences of the major nerves of the pelvic and thoracic limbs. Histologic analysis was performed. A surgical approach for the creation of ONI was designed. Results: Average metacarpal and metatarsal length was 15.0 cm (± 0.0) and 19.7 cm (± 1.0), respectively. Average intramedullary canal diameter was 12.91 mm (± 3.69) for forelimbs and 12.60 mm (± 3.69) for hindlimbs. The thoracic limb nerves consisted of one dorsal and three ventral nerves, with an average circumference of 5.14 mm (± 2.00) and 5.05 mm (± 1.06), respectively. Pelvic limb nerves consisted of two dorsal and one ventral nerve with an average circumference of 6.27 mm (± 1.79) and 5.40 mm (± 0.53), respectively. Conclusions: These anatomic data inform the surgical approach and manufacture of a sensory ONI for chronic testing in awake, freely ambulating animals for future clinical translation.

EMG feedback improves grasping of compliant objects using a myoelectric prosthesis

BackgroundClosing the control loop in myoelectric prostheses by providing artificial somatosensory feedback is recognized as an important goal. However, designing a feedback interface that is effective in realistic conditions is still a challenge. Namely, in some situations, feedback can be redundant, as the information it provides can be readily obtained through hearing or vision (e.g., grasping force estimated from the deformation of a compliant object). EMG feedback is a non-invasive method wherein the tactile stimulation conveys to the user the level of their own myoelectric signal, hence a measurement intrinsic to the interface, which cannot be accessed incidentally.MethodsThe present study investigated the efficacy of EMG feedback in prosthesis force control when 10 able-bodied participants and a person with transradial amputation used a myoelectric prosthesis to grasp compliant objects of different stiffness values. The performance with feedback was compared to that achieved when the participants relied solely on incidental cues.ResultsThe main outcome measures were the task success rate and completion time. EMG feedback resulted in significantly higher success rates regardless of pin stiffness, indicating that the feedback enhanced the accuracy of force application despite the abundance of incidental cues. Contrary to expectations, there was no difference in the completion time between the two feedback conditions. Additionally, the data revealed that the participants could produce smoother control signals when they received EMG feedback as well as more consistent commands across trials, signifying better control of the system by the participants.ConclusionsThe results presented in this study further support the efficacy of EMG feedback when closing the prosthesis control loop by demonstrating its benefits in particularly challenging conditions which maximized the utility of intrinsic feedback sources.

Continuous joint velocity estimation using CNN-based deep learning for multi-DoF prosthetic wrist for activities of daily living.

Myoelectric control of prostheses is a long-established technique, using surface electromyography (sEMG) to detect user intention and perform subsequent mechanical actions. Most machine learning models utilized in control systems are trained using isolated movements that do not reflect the natural movements occurring during daily activities. Moreover, movements are often affected by arm postures, the duration of activities, and personal habits. It is crucial to have a control system for multi-degree-of-freedom (DoF) prosthetic arms that is trained using sEMG data collected from activities of daily living (ADL) tasks. This work focuses on two major functional wrist movements: pronation-supination and dart-throwing movement (DTM), and introduces a new wrist control system that directly maps sEMG signals to the joint velocities of the multi-DoF wrist. Additionally, a specific training strategy (Quick training) is proposed that enables the controller to be applied to new subjects and handle situations where sensors may displace during daily living, muscles can become fatigued, or sensors can become contaminated (e.g., due to sweat). The prosthetic wrist controller is designed based on data from 24 participants and its performance is evaluated using the Root Mean Square Error (RMSE) and Pearson Correlation. The results are found to depend on the characteristics of the tasks. For example, tasks with dart-throwing motion show smaller RSME values (Hammer: 6.68 deg/s and Cup: 7.92 deg/s) compared to tasks with pronation-supination (Bulb: 43.98 deg/s and Screw: 53.64 deg/s). The proposed control technique utilizing Quick training demonstrates a decrease in the average root mean square error (RMSE) value by 35% and an increase in the average Pearson correlation value by 40% across all four ADL tasks.

Using Deep Learning Models to Predict Prosthetic Ankle Torque.

Inverse dynamics from motion capture is the most common technique for acquiring biomechanical kinetic data. However, this method is time-intensive, limited to a gait laboratory setting, and requires a large array of reflective markers to be attached to the body. A practical alternative must be developed to provide biomechanical information to high-bandwidth prosthesis control systems to enable predictive controllers. In this study, we applied deep learning to build dynamical system models capable of accurately estimating and predicting prosthetic ankle torque from inverse dynamics using only six input signals. We performed a hyperparameter optimization protocol that automatically selected the model architectures and learning parameters that resulted in the most accurate predictions. We show that the trained deep neural networks predict ankle torques one sample into the future with an average RMSE of 0.04 ± 0.02 Nm/kg, corresponding to 2.9 ± 1.6% of the ankle torque's dynamic range. Comparatively, a manually derived analytical regression model predicted ankle torques with a RMSE of 0.35 ± 0.53 Nm/kg, corresponding to 26.6 ± 40.9% of the ankle torque's dynamic range. In addition, the deep neural networks predicted ankle torque values half a gait cycle into the future with an average decrease in performance of 1.7% of the ankle torque's dynamic range when compared to the one-sample-ahead prediction. This application of deep learning provides an avenue towards the development of predictive control systems for powered limbs aimed at optimizing prosthetic ankle torque.