Multimodal Locomotion Research Articles

An enhanced ResNet deep learning method for multimodal signal-based locomotion intention recognition

Exoskeletons designed for rehabilitation and movement assistance are essential for addressing the physiological issues of aging in the elderly. Recognizing locomotion intention is a preliminary step towards developing balance recovery functions, as many current commercial exoskeletons have limited capabilities in this regard. The primary aim of this research is to study locomotion intention recognition algorithms to advance balance recovery technologies. This paper proposes a deep learning method, which selects ResNet as the foundational network and utilizes DSADS and Mex datasets to derive general insights from different types of locomotion recognition, focusing on daily activities and exercise respectively. To optimize ResNet, a Multi-Source Data Fusion Module and the Convolutional Block Attention Module were integrated to enhance performance when sensor data is insufficient. Experiments demonstrate that training accuracy improved, and the loss function converged more rapidly. Additionally, the Adaptive Pooling Module and Adaptive Gated Network were added to improve network stability and accuracy, resulting in a 5 % increase in accuracy. The model utilizes a self-collected dataset comprising accelerometer, gyroscope, and force data, incorporating extensive falling data to enhance its applicability. It achieves 98 % accuracy, 0.98 precision, 0.99 recall, 0.98 F1 Score, and 0.008 loss value for the recognition of six locomotion intentions in the self-collected dataset, meeting both the number and accuracy of activity category recognition. It outperforms existing methods on multiple evaluation metrics. Analysis of lower limb motion data validates the feasibility of the algorithm and highlights its potential for future applications in lower limb exoskeletons.

Bioinspired Microhinged Actuators for Active Mechanism‐Based Metamaterials

AbstractMechanism‐based metamaterials, comprising rigid elements interconnected by flexible hinges, possess the potential to develop intelligent micromachines with programmable motility and morphology. However, the absence of efficient microactuators has constrained the ability to achieve multimodal locomotion and active shape‐morphing behaviors at the micro and nanoscale. In this study, inspiration from the flight mechanisms of tiny insects is drawn to develop a biomimetic microhinged actuator by integrating compliant mechanisms with soft hydrogel muscle. A Pseudo‐Rigid‐Body mechanical model is introduced to analyze structural deformation, demonstrating that this hydrogel‐based microactuator can undergo significant folding while maintaining high structural stiffness. Furthermore, multiple microhinged actuators are combined to facilitate folding in multiple degrees of freedom and arbitrary directions. Fabricated by a multi‐step four‐dimensional (4D) direct laser writing technique, the microhinged actuators are integrated into 2D and 3D metamaterials enabling programable shape morphing. Additionally, micro‐kirigami with photonic structures is demonstrated to show the pattern transforming actuated by the microhinges. This bioinspired design approach opens new avenues for the development of active mechanism‐based metamaterials capable of intricate shape‐morphing behaviors.

Multimodal Locomotion and Dynamic Interaction of Hydrogel Microdisks at the Air-Water Interface under Magnetic and Light Stimuli.

The potential applications of hydrogel microrobots in biomedicine and environmental exploration have sparked significant interest in understanding their behavior under multiphysical fields. This study explores the multimodal locomotion and dynamic interaction of hydrogel microrobots at the air-water interface under magnetic and light stimuli. A pair of hydrogel microrobots at the air-water interface exhibits a transition from cooperative, combined rotation to interactive behavior, involving both rotation and revolution under the influence of a rotating magnetic field (RMF), and a shift from attraction to separation under near-infrared (NIR) light, demonstrating the dynamic modulation of their behaviors in response to different stimuli. Notably, the behavioral patterns of multiple hydrogel microrobots under multiphysical fields indicate that NIR light can enhance interactive motion behaviors under RMFs and extend the range of motion trajectories. Dynamic models for each condition are established and analyzed based on dynamic equilibrium, and their behavior can be modulated by parameters such as magnetic particle concentration, magnetic field frequency, and NIR light intensity. This work introduces a novel strategy for regulating and controlling the dynamic behaviors of hydrogel microrobots, offering new insights into their multiphysical field locomotion.

Solvent-adaptive hydrogels with lamellar confinement cellular structure for programmable multimodal locomotion

Biological organisms can perform flexible and controllable multimodal motion under external stimuli owing to the hierarchical assembly of anisotropic structures across multiple length scales. However, artificial soft actuators exhibit the limited response speed, deformation programmability and movement capability especially in harsh environments because of insufficient anisotropic hierarchy and precision in structural design. Here, we report a programmed assembly directed confinement polymerization method for the fabrication of environmentally tolerant and fast responsive hydrogels with lamellar assembly-confined cellular structure interpenetrated with highly aligned nanopillars by the directional freezing-assisted polymerization in the predesigned anisotropic laminar scaffold. The obtained hydrogel exhibits ultrafast responsiveness and anisotropic deformation exposed to temperature/light/solvent stimulation, maintaining highly consistent responsive deformation capability in all-polarity solvents over 100 days of soaking. Moreover, the hydrogels implement photoactive programmable multi-gait locomotion whose amplitude and directionality are precisely regulated by the intrinsic structure, including controlled crawling and rotation in water and non-polar solvents, and 3D self-propulsion floating and swimming in polar solvents. Thus, this hydrogel with hierarchically ordered structure and dexterous locomotion may be suitable for flexible intelligent actuators serving in harsh solvent environments.

Origami-Inspired Vacuum-Actuated Foldable Actuator Enabled Biomimetic Worm-like Soft Crawling Robot.

The development of a soft crawling robot (SCR) capable of quick folding and recovery has important application value in the field of biomimetic engineering. This article proposes an origami-inspired vacuum-actuated foldable soft crawling robot (OVFSCR), which is composed of entirely soft foldable mirrored origami actuators with a Kresling crease pattern, and possesses capabilities of realizing multimodal locomotion incorporating crawling, climbing, and turning movements. The OVFSCR is characterized by producing periodically foldable and restorable body deformation, and its asymmetric structural design of low front and high rear hexahedral feet creates a friction difference between the two feet and contact surface to enable unidirectional movement. Combining an actuation control sequence with an asymmetrical structural design, the body deformation and feet in contact with ground can be coordinated to realize quick continuous forward crawling locomotion. Furthermore, an efficient dynamic model is developed to characterize the OVFSCR's motion capability. The robot demonstrates multifunctional characteristics, including crawling on a flat surface at an average speed of 11.9 mm/s, climbing a slope of 3°, carrying a certain payload, navigating inside straight and curved round tubes, removing obstacles, and traversing different media. It is revealed that the OVFSCR can imitate contractile deformation and crawling mode exhibited by soft biological worms. Our study contributes to paving avenues for practical applications in adaptive navigation, exploration, and inspection of soft robots in some uncharted territory.

A Soft Crawling Robot with Multi-Modal Locomotion Inspired by the Movement Mechanism of Snake Scales

A Soft Crawling Robot with Multi-Modal Locomotion Inspired by the Movement Mechanism of Snake Scales

Complementing photothermal to photochemical actuation of assembled liquid crystal networks for wavelength-selective multimodal locomotion

The incorporation of molecular photoswitches into liquid crystal networks (LCNs) endows spatiotemporal control of their macroscale deformation and mechanical actuation in a noninvasive manner using light. Extending the photoactuation modes of LCNs to a higher level of life-like complexity and intelligence relies significantly on the rational collective utilization of multiple photoswitchable compounds. Here, we report the development of heterogeneously assembled LCN photoactuators that display well-defined stepwise actuation by assembly of new arylazopyrazole (azp)-based and conventional azobenzene (azb)-based LCN segments. Due to their activation wavelength selectivity, where azp is photochemically driven by UV light while azb is photothermally driven by green light, the assembled actuators show a high degree of photocontrollability of the overall actuation behaviors. A series of assembled actuators composed of azp and azb segments ranging from linear to branched structures are constructed to perform programmable wavelength-selective shape transformation. Bioinspired multimodal locomotion including rotating, crawling and rolling as well as optical switching between motion modes, is developed through selective irradiation to generate the robotic function for cargo transportation and release. Our work provides a useful molecular design strategy for the construction of light-driven actuators with precise photocontrollability and expanded actuation modes to better mimic the intelligent behaviors observed in nature.

Bistable soft jumper capable of fast response and high takeoff velocity.

In contrast with jumping robots made from rigid materials, soft jumpers composed of compliant and elastically deformable materials exhibit superior impact resistance and mechanically robust functionality. However, recent efforts to create stimuli-responsive jumpers from soft materials were limited in their response speed, takeoff velocity, and travel distance. Here, we report a magnetic-driven, ultrafast bistable soft jumper that exhibits good jumping capability (jumping more than 108 body heights with a takeoff velocity of more than 2 meters per second) and fast response time (less than 15 milliseconds) compared with previous soft jumping robots. The snap-through transitions between bistable states form a repeatable loop that harnesses the ultrafast release of stored elastic energy. On the basis of the dynamic analysis, the multimodal locomotion of the bistable soft jumper can be realized: the interwell mode of jumping and the intrawell mode of hopping. These modes are controlled by adjusting the duration and strength of the magnetic field, which endows the bistable soft jumper with robust locomotion capabilities. In addition, it is capable of jumping omnidirectionally with tunable heights and distances. To demonstrate its capability in complex environments, a realistic pipeline with amphibious terrain was established. The jumper successfully finished a simulative task of cleansing water through a pipeline. The design principle and actuating mechanism of the bistable soft jumper can be further extended for other flexible systems.

Multimodal locomotion ultra-thin soft robots for exploration of narrow spaces

From power plants on land to bridges over the sea, safety-critical built environments require periodic inspections for detecting issues to avoid functional discontinuities of these installations. However, navigation paths in these environments are usually challenging as they often contain difficult-to-access spaces (near-millimetre and submillimetre-high gaps) and multiple domains (solid, liquid and even aerial). In this paper, we address these challenges by developing a class of Thin Soft Robots (TS-Robot: thickness, 1.7 mm) that can access narrow spaces and perform cross-domain multimodal locomotion. We adopted a dual-actuation sandwich structure with a tuneable Poisson’s ratio tensioning mechanism for developing the TS-Robots driven by dielectric elastomers, providing them with two types of gaits (linear and undulating), remarkable output force ( ~ 41 times their weight) and speed (1.16 times Body Length/s and 13.06 times Body Thickness/s). Here, we demonstrated that TS-Robots can crawl, climb, swim and collaborate for transitioning between domains in environments with narrow entries.

Intelligent Rock-Climbing Robot Capable of Multimodal Locomotion and Hybrid Bioinspired Attachment.

Rock-climbing robots have significant potential in fieldwork and planetary exploration. However, they currently face limitations such as a lack of stability and adaptability on extreme terrains, slow locomotion, and single functionality. This study introduces a novel multimodal and adaptive rock-climbing robot (MARCBot), which addresses these limitations through spiny grippers that draw inspiration from morpho-functionalities observed in beetles, arboreal birds, and hoofed animals. This hybrid bioinspired design enables high attachment strength, passive adaptability to different terrains, and quick attachment on rock surfaces. The multimodal functionality of the gripper allows for attachment during climbing and support during walking. A novel control strategy using dynamics and quadratic programming (QP) optimizes attachment wrench distribution, reducing cost-of-transport by 20.03% and 6.05% compared to closed-loop inverse kinematic (CLIK) and virtual model control (VMC) methods, respectively. MARCBot achieved climbing speeds of 0.15mmin-1 on a vertical discrete rock surface under gravity and trotting speeds of up to 0.21ms-1 on various complex terrains. It is the first robot capable of climbing on rock surfaces and trotting in complex terrains without the need for switching end-effectors. This study highlights significant advancements in climbing and multimodal locomotion for robots in extreme environments.

Bistable Insect-Scale Jumpers with Tunable Energy Barriers for Multimodal Locomotion.

Drawing inspiration from the jumping mechanisms of insects (e.g., click beetles), bistable structures can convert slow deformations of soft actuating material into fast jumping motions (i.e., power amplification). However, bistable jumpers often encounter large energy barriers for energy release/re-storage, posing a challenge in achieving multimodal (i.e., height/distance) and continuous jumps at the insect scale (body length under 20mm). Here, a new offset-buckling bistable design is introduced that features antisymmetric equilibrium states and tunable energy barriers. Leveraging this design, a Boundary Actuation Tunable Energy-barrier (BATE) jumper (body length down to 15mm) is developed, and transform BATE jumper from height-jump mode (up to 12.7 body lengths) to distance-jump mode (up to 20 body lengths). BATE jumpers can perform agile continuous jumping (within 300ms for energy release/re-storage times) and real-time status detection is further demonstrated. This insect-level performance of the proposed BATE jumper showcases its potential toward future applications in exploration, search, and rescue.

Learning Soft Millirobot Multimodal Locomotion with Sim-to-Real Transfer.

With wireless multimodal locomotion capabilities, magnetic soft millirobots have emerged as potential minimally invasive medical robotic platforms. Due to their diverse shape programming capability, they can generate various locomotion modes, and their locomotion can be adapted to different environments by controlling the external magnetic field signal. Existing adaptation methods, however, are based on hand-tuned signals. Here, a learning-based adaptive magnetic soft millirobot multimodal locomotion framework empowered by sim-to-real transfer is presented. Developing a data-driven magnetic soft millirobot simulation environment, the periodic magnetic actuation signal is learned for a given soft millirobot in simulation. Then, the learned locomotion strategy is deployed to the real world using Bayesian optimization and Gaussian processes. Finally, automated domain recognition and locomotion adaptation for unknown environments using a Kullback-Leibler divergence-based probabilistic method are illustrated. This method can enable soft millirobot locomotion to quickly and continuously adapt to environmental changes and explore the actuation space for unanticipated solutions with minimum experimental cost.

Nodes for modes: Nodal honeycomb metamaterial enables a soft robot with multimodal locomotion

Soft-bodied animals, such as worms and snakes, use many muscles in different ways to traverse unstructured environments and inspire tools for accessing confined spaces. They demonstrate versatility of locomotion which is essential for adaptation to changing terrain conditions. However, replicating such versatility in untethered soft-bodied robots with multimodal locomotion capabilities have been challenging due to complex fabrication processes and limitations of soft body structures to accommodate hardware such as actuators, batteries and circuit boards. Here, we present MetaCrawler, a 3D printed metamaterial soft robot designed for multimodal and omnidirectional locomotion. Our design approach facilitated an easy fabrication process through a discrete assembly of a modular nodal honeycomb lattice with soft and hard components. A crucial benefit of the nodal honeycomb architecture is the ability of its hard components, nodes, to accommodate a distributed actuation system, comprising servomotors, control circuits, and batteries. Enabled by this distributed actuation, MetaCrawler achieves five locomotion modes: peristalsis, sidewinding, sideways translation, turn-in-place, and anguilliform. Demonstrations showcase MetaCrawler’s adaptability in confined channel navigation, vertical traversing, and maze exploration. This soft robotic system holds the potential to offer easy-to-fabricate and accessible solutions for multimodal locomotion in applications such as search and rescue, pipeline inspection, and space missions.

An agile monopedal hopping quadcopter with synergistic hybrid locomotion.

Nature abounds with examples of superior mobility through the fusion of aerial and ground movement. Drawing inspiration from such multimodal locomotion, we introduce a high-performance hybrid hopping and flying robot. The proposed robot seamlessly integrates a nano quadcopter with a passive telescopic leg, overcoming limitations of previous jumping mechanisms that rely on stance phase leg actuation. Based on the identified dynamics, a thrust-based control method and detachable active aerodynamic surfaces were devised for the robot to perform continuous jumps with and without position feedback. This unique design and actuation strategy enable tuning of jump height and reduced stance phase duration, leading to agile hopping locomotion. The robot recorded an average vertical hopping speed of 2.38 meters per second at a jump height of 1.63 meters. By harnessing multimodal locomotion, the robot is capable of intermittent midflight jumps that result in substantial instantaneous accelerations and rapid changes in flight direction, offering enhanced agility and versatility in complex environments. The passive leg design holds potential for direct integration with conventional rotorcraft, unlocking seamless hybrid hopping and flying locomotion.

Design and multimodal locomotion plan of a hexapod robot with improved knee joints

AbstractHexapod robots represent complex and highly redundant robotic systems capable of handling various tasks in extreme environments, such as planetary exploration and disaster response. To enhance the terrain adaptability and maneuverability of hexapod robots, we present a novel multimodal hexapod robot in this research. Our multimodal hexapod robot design incorporates knee joints with an improved multiparallel quadrilateral transmission mechanism, addressing singularity issues commonly encountered in legged robots. This enhancement not only improves the mechanical transmission characteristics of the knee joints but also increases the workspace of a single leg to achieve leg‐arm reuse functionality. In the presence of flat and structured terrain, the robot seamlessly switches to a wheeled locomotion mode, enabling swift traversal. Conversely, when faced with rough and unstructured terrain, it transitions into a legged mode, employing adaptive gait stability to navigate effectively. A novel operational mode in which the hexapod robot utilizes four legs for body support, while the remaining two legs are repurposed as arms is proposed. This innovative approach empowers the hexapod robot to perform dual‐arm manipulation without the need for additional degrees of freedom for the manipulator. To validate the effectiveness of our designed hexapod robot and multimodal motion planning algorithm, comprehensive experimental testing has been conducted, demonstrating the practicality and versatility of our system.

Multimodal Autonomous Locomotion of Liquid Crystal Elastomer Soft Robot.

Self-oscillation phenomena observed in nature serve as extraordinary inspiration for designing synthetic autonomous moving systems. Converting self-oscillation into designable self-sustained locomotion can lead to a new generation of soft robots that require minimal/no external control. However, such locomotion is typically constrained to a single mode dictated by the constant surrounding environment. In this study, a liquid crystal elastomer (LCE) robot capable of achieving self-sustained multimodal locomotion, with the specific motion mode being controlled via substrate adhesion or remote light stimulation is presented. Specifically, the LCE is mechanically trained to undergo repeated snapping actions to ensure its self-sustained rolling motion in a constant gradient thermal field atop a hotplate. By further fine-tuning the substrate adhesion, the LCE robot exhibits reversible transitions between rolling and jumping modes. In addition, the rolling motion can be manipulated in real time through light stimulation to perform other diverse motions including turning, decelerating, stopping, backing up, and steering around complex obstacles. The principle of introducing an on-demand gate control offers a new venue for designing future autonomous soft robots.

Conceptualization and Topology Optimization of Ampheel: An Integration of Rolling Wheel and Turtle-Inspired Mechanism for Amphibious Mobile Robot

The primary distinguishing feature of mobile robots is the ability to traverse various environments, setting them apart in the realm of robotics. The mobility of a robot hinges primarily on its locomotion mechanism, which dictates how it moves. The existing unimodal mobile robots are limited to work within the environment for which they are designed for and hence lack a scope to adapt the change in the terrain especially when they put to work in a mixed environment like land and water. Many applications like land and underwater search/rescue, shore infrastructure inspection, coastal area defence and security, offshore energy harvesting, space exploration, etc. demand a mobile robot that can traverse in both terrestrial and aquatic environments with the help of dual or multimodal locomotion mechanism, something like an amphibious animal. Most of the available amphibious robotic solutions have different appendages for both the environment, need human intervention to changeover the mechanism for transition, require different driving system for land and water locomotion and have fragile structures that limit the manoeuvrability. The proposed conceptual design called “Ampheel” is a novel amphibious locomotion mechanism inspired by the biomechanics of freshwater turtles. Ampheel incorporates a rigid wheel, enabling the robot to move on land, integrating soft actuators within it which emulate the turtle's leg-like extensions and enable the aquatic locomotion. Unlike the existing amphibious robots, the Ampheel utilizes the rotational motion of itself as a common driving system for both the environments. This reduces the need of multiple driving systems and also simplifies the control system. Ampheel is designed for safe travelling on land considering the maximum payload of robot as 20 kg including self-weight. Topology optimization of Ampheel is also carried out using ANSYS software for reduction of weight. Additionally, a unique interfacing shaft is designed that transmits the required torque to Ampheel for rotation and also channelise the compressed air to soft pneumatic actuators for inflation during rotation of Ampheel in aquatic setting. The fabricated Ampheel assembly is experimentally checked for failure under the applicable loading condition and found safe.

Insect-Scale Biped Robots Based on Asymmetrical Friction Effect Induced by Magnetic Torque.

Multimodal and controllable locomotion in complex terrain is of great importance for practical applications of insect-scale robots. Robust locomotion plays a particularly critical role. In this study, a locomotion mechanism for magnetic robots based on asymmetrical friction effect induced by magnetic torque is revealed and defined. The defined mechanism overcomes the design constraints imposed by both robot and substrate structures, enabling the realization of multimodal locomotion on complex terrains. Drawing inspiration from human walking and running locomotion, a biped robot based on the mechanism is proposed, which not only exhibits rapid locomotion across substrates with varying friction coefficients but also achieves precise locomotion along patterned trajectories through programmed controlling. Furthermore, apart from its exceptional locomotive capabilities, the biped robot demonstrates remarkable robustness in terms of load-carrying and weight-bearing performance. The presented locomotion and mechanism herein introduce a novel concept for designing magnetic robots while offering extensive possibilities for practical applications in insect-scale robotics.

Soft Millirobot Capable of Switching Motion Modes on the Fly for Targeted Drug Delivery in the Oviduct.

Small-scale magnetic robots with fixed magnetizations have limited locomotion modes, restricting their applications in complex environments in vivo. Here we present a morphology-reconfigurable millirobot that can switch the locomotion modes locally by reprogramming its magnetizations during navigation, in response to distinct magnetic field patterns. By continuously switching its locomotion modes between the high-velocity rigid motion and high-adaptability soft actuation, the millirobot efficiently navigates in small lumens with intricate internal structures and complex surface topographies. As demonstrations, the millirobot performs multimodal locomotion including woodlouse-like rolling and flipping, sperm-like rotating, and snake-like gliding to negotiate different terrains, including the unrestricted channel and high platform, narrow channel, and solid-liquid interface, respectively. Finally, we demonstrate the drug delivery capability of the millirobot through the oviduct-mimicking phantom and ex vivo oviduct. The magnetization reprogramming strategy during navigation represents a promising approach for developing self-adaptive robots for performing complex tasks in vivo.

Optomagnetic Coordination Helical Robot with Shape Transformation and Multimodal Motion Capabilities.

Soft robots with magnetic responsiveness exhibit diverse motion modes and programmable shape transformations. While the fixed magnetization configuration facilitates coupling control of robot posture and motion, it limits individual posture control to some extent. This poses a challenge in independently controlling the robot's transformation and motion, restricting its versatile applications. This research introduces a multifunctional helical robot responsive to both light and magnetism, segregating posture control from movements. Light fields assist in robot shaping, achieving a 78% maximum diameter shift. Magnetic fields guide helical robots in multimodal motions, encompassing rotation, flipping, rolling, and spinning-induced propulsion. By controlling multimodal locomotion and shape transformation on demand, helical robots gain enhanced flexibility. This innovation allows them to tightly grip and wirelessly transport designated payloads, showcasing potential applications in drug delivery, soft grippers, and chemical reaction platforms. The unique combination of structural design and control methods holds promise for intelligent robots in the future.