Musculoskeletal Humanoid Research Articles

Adaptive neuromuscular control of a simplified muscle tendon-driven musculoskeletal system

PurposeThis study aims to improve the muscle model control performance of a tendon-driven musculoskeletal system (TDMS) to overcome disadvantages such as multisegmentation and strong coupling. An adaptive network controller (ANC) with a disturbance observer is established to reduce the modeling error of the musculoskeletal model and improve its antidisturbance ability.Design/methodology/approachIn contrast to other control technologies adopted for musculoskeletal humanoids, which use geometric relationships and antagonist inhibition control, this study develops a method comprising of three parts. (1) First, a simplified musculoskeletal model is constructed based on the Taylor expansion, mean value theorem and Lagrange–d’Alembert principle to complete the decoupling of the muscle model. (2) Next, for this simplified musculoskeletal model, an adaptive neuromuscular controller is designed to acquire the muscle-activation signal and realize stable tracking of the endpoint of the muscle-driven robot relative to the desired trajectory in the TDMS. For the ANC, an adaptive neural network controller with a disturbance observer is used to approximate dynamical uncertainties. (3) Using the Lyapunov method, uniform boundedness of the signals in the closed-loop system is proved. In addition, a tracking experiment is performed to validate the effectiveness of the adaptive neuromuscular controller.FindingsThe experimental results reveal that compared with other control technologies, the proposed design techniques can effectively improve control accuracy. Moreover, the proposed controller does not require extensive considerations of the geometric and antagonistic inhibition relationships, and it demonstrates anti-interference ability.Originality/valueMusculoskeletal robots with humanoid structures have attracted considerable attention from numerous researchers owing to their potential to avoid danger for humans and the environment. The controller based on bio-muscle models has shown great performance in coordinating the redundant internal forces of TDMS. Therefore, adaptive controllers with disturbance observers are designed to improve the immunity of the system and thus directly regulate the internal forces between the bio-muscle models.

Human-mimetic binaural ear design and sound source direction estimation for task realization of musculoskeletal humanoids

Human-like environment recognition by musculoskeletal humanoids is important for task realization in real complex environments and for use as dummies for test subjects. Humans integrate various sensory information to perceive their surroundings, and hearing is particularly useful for recognizing objects out of view or out of touch. In this research, we aim to realize human-like auditory environmental recognition and task realization for musculoskeletal humanoids by equipping them with a human-like auditory processing system. Humans realize sound-based environmental recognition by estimating directions of the sound sources and detecting environmental sounds based on changes in the time and frequency domain of incoming sounds and the integration of auditory information in the central nervous system. We propose a human mimetic auditory information processing system, which consists of three components: the human mimetic binaural ear unit, which mimics human ear structure and characteristics, the sound source direction estimation system, and the environmental sound detection system, which mimics processing in the central nervous system. We apply it to Musashi, a human mimetic musculoskeletal humanoid, and have it perform tasks that require sound information outside of view in real noisy environments to confirm the usefulness of the proposed methods.

Adaptive Body Schema Learning System Considering Additional Muscles for Musculoskeletal Humanoids

One of the important advantages of musculoskeletal humanoids is that the muscle arrangement can be easily changed and the number of muscles can be increased according to the situation. In this study, we describe an overall system of muscle addition for musculoskeletal humanoids and the adaptive body schema learning while taking into account the additional muscles. For hardware, we describe a modular body design that can be fitted with additional muscles, and for software, we describe a method that can learn the changes in body schema associated with additional muscles from a small amount of motion data. We apply our method to a simple 1-DOF tendon-driven robot simulation and the arm of the musculoskeletal humanoid Musashi, and show the effectiveness of muscle tension relaxation by adding muscles for a high-load task.

Robust continuous motion strategy against muscle rupture using online learning of redundant intersensory networks for musculoskeletal humanoids

Musculoskeletal humanoids have various biomimetic advantages, of which redundant muscle arrangement is one of the most important features. This feature enables variable stiffness control and allows the robot to keep moving its joints even if one of the redundant muscles breaks, but this has been rarely explored. In this study, we construct a neural network that represents the relationship among sensors in the flexible and difficult-to-modelize body of the musculoskeletal humanoid, and by learning this neural network, accurate motions can be achieved. In order to take advantage of the redundancy of muscles, we discuss the use of this network for muscle rupture detection, online update of the intersensory relationship considering the muscle rupture, and body control and state estimation using the muscle rupture information. This study explains a method of constructing a musculoskeletal humanoid that continues to move and perform tasks robustly even when one muscle breaks.

Self-Body Image Acquisition and Posture Generation With Redundancy Using Musculoskeletal Humanoid Shoulder Complex for Object Manipulation

We proposed a method for learning the actual body image of a musculoskeletal humanoid for posture generation and object manipulation using inverse kinematics with redundancy in the shoulder complex. The effectiveness of this method was confirmed by realizing automobile steering wheel operation. The shoulder complex has a scapula that glides over the rib cage and an open spherical joint, and is supported by numerous muscle groups, enabling a wide range of motion. As a development of the human mimetic shoulder complex, we have increased the muscle redundancy by implementing deep muscles and stabilize the joint drive. As a posture generation method to utilize the joint redundancy of the shoulder complex, we consider inverse kinematics based on the scapular drive strategy suggested by the scapulohumeral rhythm of the human body. In order to control a complex robot imitating a human body, it is essential to learn its own body image, but it is difficult to know its own state accurately due to its deformation which is difficult to measure. To solve this problem, we developed a method to acquire a self-body image that can be updated appropriately by recognizing the hand position relative to an object for the purpose of object manipulation. We apply the above methods to a full-body musculoskeletal humanoid, Kengoro, and confirm its effectiveness by conducting an experiment to operate a car steering wheel, which requires the appropriate use of both arms.

Automatic Grouping of Redundant Sensors and Actuators Using Functional and Spatial Connections: Application to Muscle Grouping for Musculoskeletal Humanoids

For a robot with redundant sensors and actuators distributed throughout its body, it is difficult to construct a controller or a neural network using all of them due to computational cost and complexity. Therefore, it is effective to extract functionally related sensors and actuators, group them, and construct a controller or a network for each of these groups. In this study, the functional and spatial connections among sensors and actuators are embedded into a graph structure and a method for automatic grouping is developed. Taking a musculoskeletal humanoid with a large number of redundant muscles as an example, this method automatically divides all the muscles into regions such as the forearm, upper arm, scapula, neck, etc., which has been done by humans based on a geometric model. The functional relationship among the muscles and the spatial relationship of the neural connections are calculated without a geometric model. This study is applied to muscle grouping of musculoskeletal humanoids Musashi and Kengoro, and its effectiveness is verified.

Realization of Multi Contact Behaviors Using Contact-State Transition Model and Reinforcement Learning by Musculoskeletal Humanoid

Realization of Multi Contact Behaviors Using Contact-State Transition Model and Reinforcement Learning by Musculoskeletal Humanoid

Design Optimization of Musculoskeletal Humanoids Maximizing the Redundancy to Compensate for Muscle Rupture

Design Optimization of Musculoskeletal Humanoids Maximizing the Redundancy to Compensate for Muscle Rupture

Actual Machine Learning of Self-Body Image for Object Manipulation and Posture Generation with Redundancy in Musculoskeletal Humanoid Shoulder Complex

Actual Machine Learning of Self-Body Image for Object Manipulation and Posture Generation with Redundancy in Musculoskeletal Humanoid Shoulder Complex

Toward Autonomous Driving by Musculoskeletal Humanoids: A Study of Developed Hardware and Learning-Based Software

This article summarizes an autonomous driving project by musculoskeletal humanoids. The musculoskeletal humanoid, which mimics the human body in detail, has redundant sensors and a flexible body structure. These characteristics are suitable for motions with complex environmental contact, and the robot is expected to sit down on the car seat, step on the acceleration and brake pedals, and operate the steering wheel with both arms. We reconsider the developed hardware and software of the musculoskeletal humanoid Musashi in the context of autonomous driving. The respective components of autonomous driving are conducted using the benefits of the hardware and software. Finally, we show that Musashi succeeded in the pedal and steering wheel operations with recognition.

Musculoskeletal AutoEncoder: A Unified Online Acquisition Method of Intersensory Networks for State Estimation, Control, and Simulation of Musculoskeletal Humanoids

While the musculoskeletal humanoid has various biomimetic benefits, the modeling of its complex structure is difficult, and many learning-based systems have been developed so far. There are various methods, such as control methods using acquired relationships between joints and muscles represented by a data table or neural network, and state estimation methods using Extended Kalman Filter or table search. In this letter, we construct a Musculoskeletal AutoEncoder representing the relationship among joint angles, muscle tensions, and muscle lengths, and propose a unified method of state estimation, control, and simulation of musculoskeletal humanoids using it. By updating the Musculoskeletal AutoEncoder online using the actual robot sensor information, we can continuously conduct more accurate state estimation, control, and simulation than before the online learning. We conducted several experiments using the musculoskeletal humanoid Musashi, and verified the effectiveness of this study.

Upper Limb Control of Musculoskeletal Humanoids by Muscle Tension Control Based on the Motor Directional Tuning Phenomenon

Upper Limb Control of Musculoskeletal Humanoids by Muscle Tension Control Based on the Motor Directional Tuning Phenomenon

Musculoskeletal design, control, and application of human mimetic humanoid Kenshiro

We have been developing a human mimetic musculoskeletal humanoid called Kenshiro, whose design concept is to thoroughly pursue an unprecedented anatomical fidelity to the human musculoskeletal structure. We believe that research on human mimetic musculoskeletal humanoids advances our understanding of humans and expands the applications of humanoids—such as a human body simulator that can quantitatively analyze internal human motion data. This paper describes Kenshiro’s musculoskeletal body characteristics, software system, and preliminary experiments explaining the concept of potential application.

Development of Joint with Planar Traction Structure on Musculoskeletal Humanoids

Development of Joint with Planar Traction Structure on Musculoskeletal Humanoids

Task-specific Self-body Controller Acquisition by Musculoskeletal Humanoids

Task-specific Self-body Controller Acquisition by Musculoskeletal Humanoids

Motion acquisition based on tapping sound recognition by time series hearing for Musculoskeletal Humanoid

Motion acquisition based on tapping sound recognition by time series hearing for Musculoskeletal Humanoid

Online Learning of Joint-Muscle Mapping Using Vision in Tendon-Driven Musculoskeletal Humanoids

The body structures of tendon-driven musculoskeletal humanoids are complex, and accurate modeling is difficult, because they are made by imitating the body structures of human beings. For this reason, we have not been able to move them accurately like ordinary humanoids driven by actuators in each axis, and large internal muscle tension and slack of tendon wires have emerged by the model error between its geometric model and the actual robot. Therefore, we construct a joint-muscle mapping (JMM) using a neural network (NN), which expresses a nonlinear relationship between joint angles and muscle lengths, and aim to move tendon-driven musculoskeletal humanoids accurately by updating the JMM online from data of the actual robot. In this study, the JMM is updated online by using the vision of the robot so that it moves to the correct position (Vision Updater). Also, we execute another update to modify muscle antagonisms correctly (Antagonism Updater). By using these two updaters, the error between the target and actual joint angles decrease to about 40% in 5 min, and we show through a manipulation experiment that the tendon-driven musculoskeletal humanoid Kengoro becomes able to move as intended. This novel system can adapt to the state change and growth of robots, because it updates the JMM online successively.

Development of Movable binocular eye unit for Musculoskeletal Humanoid and the achivement of looking around for driving

Development of Movable binocular eye unit for Musculoskeletal Humanoid and the achivement of looking around for driving

Development of pneumatically actuated musculoskeletal humanoid for dolphin kick research

Development of pneumatically actuated musculoskeletal humanoid for dolphin kick research

Antagonist Inhibition Control in Redundant Tendon-Driven Structures Based on Human Reciprocal Innervation for Wide Range Limb Motion of Musculoskeletal Humanoids

The body structure of an anatomically correct tendon-driven musculoskeletal humanoid is complex, and the difference between its geometric model and the actual robot is very large because expressing the complex routes of tendon wires in a geometric model is very difficult. If we move a tendon-driven musculoskeletal humanoid by the tendon wire lengths of the geometric model, unintended muscle tension and slack will emerge. In some cases, this can lead to the wreckage of the actual robot. To solve this problem, we focused on reciprocal innervation in the human nervous system, and then implemented antagonist inhibition control (AIC)-based on the reflex. This control makes it possible to avoid unnecessary internal muscle tension and slack of tendon wires caused by model error, and to perform wide range motion safely for a long time. To verify its effectiveness, we applied AIC to the upper limb of the tendon-driven musculoskeletal humanoid, Kengoro, and succeeded in dangling for 14 min and doing pull-ups.