Modular Neural Control Research Articles

Adaptive Modular Neural Control for Online Gait Synchronization and Adaptation of an Assistive Lower-Limb Exoskeleton.

Gait synchronization has attracted significant attention in research on assistive lower-limb exoskeletons because it can circumvent conflicting movements and improve the assistance performance. This study proposes an adaptive modular neural control (AMNC) for online gait synchronization and the adaptation of a lower-limb exoskeleton. The AMNC comprises several distributed and interpretable neural modules that interact with each other to effectively exploit neural dynamics and adopt feedback signals to quickly reduce the tracking error, thereby smoothly synchronizing the exoskeleton movement with the user's movement on the fly. Taking state-of-the-art control as the benchmark, the proposed AMNC provides further improvements in the locomotion phase, frequency, and shape adaptation. Accordingly, under the physical interaction between the user and the exoskeleton, the control can reduce the optimized tracking error and unseen interaction torque by up to 80% and 30%, respectively. Accordingly, this study contributes to the advancement of exoskeleton and wearable robotics research in gait assistance for the next generation of personalized healthcare.

Integrated Modular Neural Control for Versatile Locomotion and Object Transportation of a Dung Beetle-Like Robot.

Dung beetles can effectively transport dung pallets of various sizes in any direction across uneven terrain. While this impressive ability can inspire new locomotion and object transportation solutions in multilegged (insect-like) robots, to date, most existing robots use their legs primarily to perform locomotion. Only a few robots can use their legs to achieve both locomotion and object transportation, although they are limited to specific object types/sizes (10%-65% of leg length) on flat terrain. Accordingly, we proposed a novel integrated neural control approach that, like dung beetles, pushes state-of-the-art insect-like robots beyond their current limits toward versatile locomotion and object transportation with different object types/sizes and terrains (flat and uneven). The control method is synthesized based on modular neural mechanisms, integrating central pattern generator (CPG)-based control, adaptive local leg control, descending modulation control, and object manipulation control. We also introduced an object transportation strategy combining walking and periodic hind leg lifting for soft object transportation. We validated our method on a dung beetle-like robot. Our results show that the robot can perform versatile locomotion and use its legs to transport hard and soft objects of various sizes (60%-70% of leg length) and weights (approximately 3%-115% of robot weight) on flat and uneven terrains. The study also suggests possible neural control mechanisms underlying the dung beetle Scarabaeus galenus' versatile locomotion and small dung pallet transportation.

A Neural Coordination Strategy for Attachment and Detachment of a Climbing Robot Inspired by Gecko Locomotion.

Climbing behavior is a superior motion skill that animals have evolved to obtain a more beneficial position in complex natural environments. Compared to animals, current bionic climbing robots are less agile, stable, and energy-efficient. Further, they locomote at a low speed and have poor adaptation to the substrate. One of the key elements that can improve their locomotion efficiency is the active and flexible feet or toes observed in climbing animals. Inspired by the active attachment-detachment behavior of geckos, a hybrid pneumatic-electric-driven climbing robot with active attachment-detachment bionic flexible feet (toes) was developed. Although the introduction of bionic flexible toes can effectively improve the robot's adaptability to the environment, it also poses control challenges, specifically, the realization of attachment-detachment behavior by the mechanics of the feet, the realization of hybrid drive control with different response characteristics, and the interlimb collaboration and limb-foot coordination with a hysteresis effect. Through the analysis of geckos' limbs and foot kinematic behavior during climbing, rhythmic attachment-detachment strategies and coordination behavior between toes and limbs at different inclines were identified. To enable the robot to achieve similar foot attachment-detachment behavior for climbing ability enhancement, we propose a modular neural control framework comprising a central pattern generator module, a post-processing central pattern generation module, a hysteresis delay line module, and an actuator signal conditioning module. Among them, the hysteresis adaptation module helps the bionic flexible toes to achieve variable phase relationships with the motorized joint, thus enabling proper limb-to-foot coordination and interlimb collaboration. The experiments demonstrated that the robot with neural control achieved proper coordination, resulting in a foot with a 285% larger adhesion area than that of a conventional algorithm. In addition, in the plane/arc climbing scenario, the robot with coordination behavior increased by as much as 150%, compared to the incoordinated one owing to its higher adhesion reliability.

Versatile modular neural locomotion control with fast learning

Legged robots have significant potential to operate in unstructured environments. The design of locomotion control is, however, still challenging. Currently, controllers must be manually designed for specific robots and tasks, or automatically designed via machine learning methods that require long training times and yield large opaque controllers. Drawing inspiration from animal locomotion, we propose a simple yet versatile modular neural control structure with fast learning. The key advantages of our approach are that behaviour-specific control modules can be added incrementally to obtain increasingly complex emergent locomotion behaviours, and that neural connections can be quickly and automatically learned. In a series of experiments, we show how eight modules can be quickly learned and added to a base control module to obtain emergent adaptive behaviours allowing a hexapod robot to navigate in complex environments. We also show that modules can be added and removed during operation without affecting the functionality of the remaining controller. Finally, the controller is successfully demonstrated on a physical robot. Taken together, our study reveals a significant step towards fast automatic design of versatile neural locomotion control.

Modular Neural Control for Gait Adaptation and Obstacle Avoidance of a Tailless Gecko Robot

In this study, we present a novel neural control architecture for gait adaptation and obstacle avoidance of a tailless gecko robot. The control architecture is based on a hierarchical modular structure, consisting of several neural layers and modules. The first layer contains three sensory preprocessing modules which filter sensory noise and generate appropriate descending commands to activate corresponding behaviors through the second and third layers. The second and third layers contain a central pattern generator (CPG) module and CPG postprocessing modules, respectively. The CPG module generates basic rhythmic locomotion patterns, shaped by the CPG postprocessing modules to achieve different gaits (i.e., wave, intermediate, and trot) as well as different climbing directions (i.e., forward and sideways). We use a body inclination sensor to adapt the robot gait while climbing on different slope angles, with infrared sensors to detect an obstacle on its climbing path and activate obstacle avoidance behavior. We successfully tested our control approach on a real tailless gecko robot. As a result, the robot can efficiently climb forward on different slope angles (including 90∘) and automatically adapt its climbing gait accordingly, to maximize climbing speed and ensure stability. It can also avoid an obstacle by changing its climbing direction from forward to sideways.

Bio-Inspired Adaptive Locomotion Control System for Online Adaptation of a Walking Robot on Complex Terrains

Developing a controller that enables a walking robot to autonomously adapt its locomotion to navigate unknown complex terrains is difficult, and the methods developed to address this problem typically require robot kinematics with arduous parameter tuning or machine learning techniques that require several trials or repetitions. To overcome this limitation, in this paper, we present continuous, online, and self-adaptive locomotion control inspired by biological control systems, including neural control and hormone systems. The control approach integrates our existing modular neural locomotion control (MNLC) and a newly introduced artificial hormone mechanism (AHM). While the MNLC can generate various gaits through its modulatory input, the AHM, which replicates the endocrine system, adapts to rapid changes in online walking frequency and gait in response to different complex terrains. The control approach is evaluated on an insect-like hexapod robot with 18 degrees of freedom. We provide the results in three sections. First, we demonstrate the adaptability of the robot with the proposed artificial hormones. Second, we compare the performance of two robots with and without artificial hormones while walking on different complex terrains using three performance indexes (stability, harmony, and displacement). Third, we evaluate real-time online adaptations in the real world through real robot walking on different unknown terrains. The experimental results demonstrate that the robot with the proposed artificial hormones does not require several learning trials to adapt its locomotion. Instead, it can continuously adapt its locomotion online, thereby providing greater success and higher performance than other techniques when walking on all terrains.

Emergent modular neural control drives coordinated motor actions.

A remarkable feature of motor control is the ability to coordinate movements across distinct body parts into a consistent, skilled action. To reach and grasp an object, “gross” arm and “fine” dexterous movements must be coordinated as a single action, but how the nervous system achieves this coordination is currently unknown. One possibility is that, with training, gross and fine movements are co-optimized to produce a coordinated action; alternatively, gross and fine movements may be modularly refined to function together. To address this question, we recorded neural activity in primary motor cortex (M1) and dorsolateral striatum (DLS) during reach-to-grasp skill learning in rats. During learning, the refinement of fine and gross movements was behaviorally and neurally dissociable. Furthermore, inactivation of M1 and DLS had distinct effects on skilled fine and gross movements. Our results indicate that skilled movement coordination is achieved through emergent modular neural control.

Modular Neural Mechanisms for Gait Phase Tracking, Prediction, and Selection in Personalizable Knee-Ankle-Foot-Orthoses.

Orthoses for the lower limbs support patients to perform movements that they could not perform on their own. In traditional devices, generic gait models for a limited set of supported movements restrict the patients mobility and device acceptance. To overcome such limitations, we propose a modular neural control approach with user feedback for personalizable Knee-Ankle-Foot-Orthoses (KAFO). The modular controller consists of two main neural components: neural orthosis control for gait phase tracking and neural internal models for gait prediction and selection. A user interface providing online feedback allows the user to shape the control output that adjusts the knee damping parameter of a KAFO. The accuracy and robustness of the control approach were investigated in different conditions including walking on flat ground and descending stairs as well as stair climbing. We show that the controller accurately tracks and predicts the user's movements and generates corresponding gaits. Furthermore, based on the modular control architecture, the controller can be extended to support various distinguishable gaits depending on differences in sensory feedback.

Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot.

Walking animals, like insects, with little neural computing can effectively perform complex behaviors. For example, they can walk around their environment, escape from corners/deadlocks, and avoid or climb over obstacles. While performing all these behaviors, they can also adapt their movements to deal with an unknown situation. As a consequence, they successfully navigate through their complex environment. The versatile and adaptive abilities are the result of an integration of several ingredients embedded in their sensorimotor loop. Biological studies reveal that the ingredients include neural dynamics, plasticity, sensory feedback, and biomechanics. Generating such versatile and adaptive behaviors for a many degrees-of-freedom (DOFs) walking robot is a challenging task. Thus, in this study, we present a bio-inspired approach to solve this task. Specifically, the approach combines neural mechanisms with plasticity, exteroceptive sensory feedback, and biomechanics. The neural mechanisms consist of adaptive neural sensory processing and modular neural locomotion control. The sensory processing is based on a small recurrent neural network consisting of two fully connected neurons. Online correlation-based learning with synaptic scaling is applied to adequately change the connections of the network. By doing so, we can effectively exploit neural dynamics (i.e., hysteresis effects and single attractors) in the network to generate different turning angles with short-term memory for a walking robot. The turning information is transmitted as descending steering signals to the neural locomotion control which translates the signals into motor actions. As a result, the robot can walk around and adapt its turning angle for avoiding obstacles in different situations. The adaptation also enables the robot to effectively escape from sharp corners or deadlocks. Using backbone joint control embedded in the the locomotion control allows the robot to climb over small obstacles. Consequently, it can successfully explore and navigate in complex environments. We firstly tested our approach on a physical simulation environment and then applied it to our real biomechanical walking robot AMOSII with 19 DOFs to adaptively avoid obstacles and navigate in the real world.

Biologically inspired modular neural control for a leg-wheel hybrid robot

In this article we present modular neural control for a leg-wheel hybrid robot consisting of three legs with omnidirectional wheels. This neural control has four main modules having their functional origin in biological neural systems. A minimal recurrent control (MRC) module is for sensory signal processing and state memorization. Its outputs drive two front wheels while the rear wheel is controlled through a velocity regulating network (VRN) module. In parallel, a neural oscillator network module serves as a central pattern generator (CPG) controls leg movements for sidestepping. Stepping directions are achieved by a phase switching network (PSN) module. The combination of these modules generates various locomotion patterns and a reactive obstacle avoidance behavior. The behavior is driven by sensor inputs, to which additional neural preprocessing networks are applied. The complete neural circuitry is developed and tested using a physics simulation environment. This study verifies that the neural modules can serve a general purpose regardless of the robot's specific embodiment. We also believe that our neural modules can be important components for locomotion generation in other complex robotic systems or they can serve as useful modules for other module-based neural control applications.

Neural control of a modular multi-legged walking machine: Simulation and hardware

The modular walking machine Octavio is a bio-inspired robot designed to serve as a testbed for modular neural locomotion control. It consists of up to eight control- and energy-autonomous leg modules, each equipped with 3 active and 2 passive compliant joints and various proprioceptive sensors. Legs may be either used in single leg (treadmill) experiments or can be quickly attached to and detached from bodies with different morphologies. Body morphologies include 4-, 6- and 8-legged machines. Neurocybernetic control is developed and optimized using evolutionary techniques together with a physical simulation of the machine and its environment. This article gives an overview of the machines mechanics, electronics, firmware, configuration and control software. Simple examples demonstrate how the behavior of the simulated and the physical machines are controlled by e.g. neurobiologically motivated modular neural networks.

Reactive Neural Control for Phototaxis and Obstacle Avoidance Behavior of Walking Machines

This paper describes reactive neural control used to generate phototaxis and obstacle avoidance behavior of walking machines. It utilizes discrete-time neurodynamics and consists of two main neural modules: neural preprocessing and modular neural control. The neural preprocessing network acts as a sensory fusion unit. It filters sensory noise and shapes sensory data to drive the corresponding reactive behavior. On the other hand, modular neural control based on a central pattern generator is applied for locomotion of walking machines. It coordinates leg movements and can generate omnidirectional walking. As a result, through a sensorimotor loop this reactive neural controller enables the machines to explore a dynamic environment by avoiding obstacles, turn toward a light source, and then stop near to it. Keywords—Recurrent neural networks, Walking robots, Modular neural control, Phototaxis, Obstacle avoidance behavior.

Sensor-driven neural control for omnidirectional locomotion and versatile reactive behaviors of walking machines

This article describes modular neural control structures for different walking machines utilizing discrete-time neurodynamics. A simple neural oscillator network serves as a central pattern generator producing the basic rhythmic leg movements. Other modules, like the velocity regulating and the phase switching networks, enable the machines to perform omnidirectional walking as well as reactive behaviors, like obstacle avoidance and different types of tropisms. These behaviors are generated in a sensori-motor loop with respect to appropriate sensor inputs, to which a neural preprocessing is applied. The neuromodules presented are small so that their structure–function relationship can be analysed. The complete controller is general in the sense that it can be easily adapted to different types of even-legged walking machines without changing its internal structure and parameters.

An optimized modular neural network controller based on environment classification and selective sensor usage for mobile robot reactive navigation

A new approach to the design of a neural network (NN) based navigator is proposed in which the mobile robot travels to a pre-defined goal position safely and efficiently without any prior map of the environment. This navigator can be optimized for any user-defined objective function through the use of an evolutionary algorithm. The motivation of this research is to develop an efficient methodology for general goal-directed navigation in generic indoor environments as opposed to learning specialized primitive behaviors in a limited environment. To this end, a modular NN has been employed to achieve the necessary generalization capability across a variety of indoor environments. Herein, each NN module takes charge of navigating in a specialized local environment, which is the result of decomposing the whole path into a sequence of local paths through clustering of all the possible environments. We verify the efficacy of the proposed algorithm over a variety of both simulated and real unstructured indoor environments using our autonomous mobile robot platform.

Neural Processing of Auditory Signals and Modular Neural Control for Sound Tropism of Walking Machines

The specialized hairs and slit sensillae of spiders (Cupiennius salei) can sense the airflow and auditory signals in a low-frequency range. They provide the sensor information for reactive behavior, like e.g. capturing a prey. In analogy, in this paper a setup is described where two microphones and a neural preprocessing system together with a modular neural controller are used to generate a sound tropism of a four-legged walking machine. The neural preprocessing network is acting as a low-pass filter and it is followed by a network which discerns between signals coming from the left or the right. The parameters of these networks are optimized by an evolutionary algorithm. In addition, a simple modular neural controller then generates the desired different walking patterns such that the machine walks straight, then turns towards a switched-on sound source, and then stops near to it.