Robust Motion Research Articles

Robust Motion Planning With Accuracy Optimization Based on Learned Sensitivity Metrics

Robust Motion Planning With Accuracy Optimization Based on Learned Sensitivity Metrics

Adaptive robust motion control for hydraulic load sensitive systems considering displacement dynamic compensation

Adaptive robust motion control for hydraulic load sensitive systems considering displacement dynamic compensation

SketchAnim: Real‐time sketch animation transfer from videos

AbstractAnimation of hand‐drawn sketches is an adorable art. It allows the animator to generate animations with expressive freedom and requires significant expertise. In this work, we introduce a novel sketch animation framework designed to address inherent challenges, such as motion extraction, motion transfer, and occlusion. The framework takes an exemplar video input featuring a moving object and utilizes a robust motion transfer technique to animate the input sketch. We show comparative evaluations that demonstrate the superior performance of our method over existing sketch animation techniques. Notably, our approach exhibits a higher level of user accessibility in contrast to conventional sketch‐based animation systems, positioning it as a promising contributor to the field of sketch animation. https://graphics-research-group.github.io/SketchAnim/

Glucose-fueled cationic nanomotors for promoting the healing of infected diabetic wounds

Hyperglycemia-promoted bacterial infection will seriously exacerbate diabetic wounds, and its current clinical treatments are suffering from the adverse effects associated with off-target, bacterial resistance, and glycemic fluctuation. Herein, we present a kind of glucose-fueled cationic nanomotors capable of remarkably enhancing antibacterial efficacy, and thus expediting diabetic wound healing. The nanomotors have positively charged surfaces, and consist of mesoporous bowl-shaped polydopamine nanoparticles grafted with quaternized polymer brushes and coupled with glucose oxidase (GOx) and catalase (CAT). Stemming from the GOx-CAT cascade reaction in diabetic wound microenvironment, they can perform robust chemotactic motion towards both high glucose regions, where bacteria proliferation predominantly occurs, and elevated H2O2 levels, which bacterial metabolism produced. This enables the nanomotors to facilitate targeted migration towards bacteria-rich regions and simultaneous downregulation of glycemic levels, as well as to significantly enhance the electrostatic interaction between antibacterial components and bacteria. Consequently, the nanomotors exhibit amplified contact-killing effects of their attached cationic molecules, leading to an almost 10-fold enhancement in antibacterial efficacy compared to previous counterparts. The in vivo experiments approved that the nanomotors demonstrated the accelerated healing of infected diabetic wounds by S. aureus and biosafety. The results herein provide an insight into the clinical treatment of infected diabetic wounds.

A Robust Translational Motion Compensation Method for Moving Target ISAR Imaging Based on Phase Difference-Lv’s Distribution and Auto-Cross-Correlation Algorithm

Translational motion compensation constitutes a pivotal and essential procedure in inverse synthetic aperture radar (ISAR) imaging. Many researchers have previously proposed their methods to address this requirement. However, conventional methods may struggle to produce satisfactory results when dealing with non-stationary moving targets or operating under conditions of low signal-to-noise ratios (SNR). Aiming at this challenge, this article proposes a parametric non-search method that contains two main stages. The radar echoes can be modeled as polynomial phase signals (PPS). In the initial stage, the energy of the received two-dimensional signal is coherently integrated into a peak point by leveraging phase difference (PD) and Lv’s distribution (LVD), from which the high-order polynomial coefficients can be obtained accurately. The estimation of the first-order coefficients is conducted during the second stage. The auto-cross-correlation function for range profiles is introduced to enhance the accuracy and robustness of estimation. Subsequently, a novel mathematical model for velocity estimation is proposed, and its least squares solution is derived. Through this model, a sub-resolution solution can be obtained without requiring interpolation. By employing all the estimated polynomial coefficients, the non-stationary motion of the target can be fully compensated, yielding the acquisition of a finely focused image. Finally, the experimental findings validate the superiority and robustness of the proposed method in comparison to state-of-the-art approaches.

Robust motion planning for mobile robots under attacks against obstacle localization

Abstract Thanks to its real-time computation efficiency, deep reinforcement learning (DRL) has been widely applied in motion planning for mobile robots. In DRL-based methods, a DRL model computes an action for a robot based on the states of its surrounding obstacles, including other robots that may communicate with it. These methods always assume that the environment is attack-free and the obtained obstacles’ states are reliable. However, in the real world, a robot may suffer from obstacle localization attacks (OLAs), such as sensor attacks, communication attacks, and remote-control attacks, which cause the robot to retrieve inaccurate positions of the surrounding obstacles. In this paper, we propose a robust motion planning method ObsGAN-DRL, integrating a generative adversarial network (GAN) into DRL models to mitigate OLAs in the environment. First, ObsGAN-DRL learns a generator based on the GAN model to compute the approximation of obstacles’ accurate positions in benign and attack scenarios. Therefore, no detectors are required for ObsGAN-DRL. Second, by using the approximation positions of the surrounding obstacles, ObsGAN-DRL can leverage the state-of-the-art DRL methods to compute collision-free motion commands (e.g., velocity) efficiently. Comprehensive experiments show that ObsGAN-DRL can mitigate OLAs effectively and guarantee safety. We also demonstrate the generalization of ObsGAN-DRL.

An Explainable and Robust Motion Planning and Control Approach for Autonomous Vehicle On-Ramping Merging Task Using Deep Reinforcement Learning

An Explainable and Robust Motion Planning and Control Approach for Autonomous Vehicle On-Ramping Merging Task Using Deep Reinforcement Learning

Conductive hydrogels‐based self‐sensing soft robot state perception and trajectory tracking

AbstractSoft robots face significant challenges in proprioceptive sensing and precise control due to their highly deformable and compliant nature. This paper addresses these challenges by developing a conductive hydrogel sensor and integrating it into a soft robot for bending angle measurement and motion control. A quantitative mapping between the hydrogel resistance and the robot's bending gesture is formulated. Furthermore, a nonlinear differentiator is proposed to estimate the angular velocity for closed‐loop control, eliminating the reliance on conventional sensors. Meanwhile, a controller is designed to track both structural and nonstructural trajectories. The proposed approach integrates advanced soft sensing materials and intelligent control algorithms, significantly improving the proprioception and motion accuracy of soft robots. This work bridges the gap between novel material design and practical control applications, opening up new possibilities for soft robots to perform delicate tasks in various fields. The experimental results demonstrate the effectiveness of the proposed sensing and control approach in achieving precise and robust motion control of the soft robot.

Run-time motion and first-order shim control by expanded servo navigation.

To provide a navigator-based run-time motion and first-order field correction for three-dimensional human brain imaging with high precision, minimal calibration and acquisition, and fast processing. A complex-valued linear perturbation model with feedback control is extended to estimate and correct for gradient shim fields using orbital navigators (2.3 ms). Two approaches for sensitizing the model to gradient fields are presented, one based on finite differences with three additional navigators, and another projection-based approximation requiring no additional navigators. A mechanism for noise decorrelation of the matrix and the data is proposed and evaluated to reduce unwanted parameter biases. The rigid motion and first-order field control achieves robust motion and gradient shim corrections improving image quality in a series of phantom and in vivo experiments with varying field conditions. In phantom scans, magnet drifts, forced gradient field perturbations and field distortions from shifts of a second bottle phantom are successfully corrected. Field estimates of the magnet drifts are in good agreement with concurrent field probe measurements. For in vivo scans, the proposed method mitigates field variations from torso motions while being robust to head motion. In vivo gradient field precisions were along with single-digit micrometer and millidegree rigid precisions. The navigator-based method achieves accurate, high-precision run-time motion and field corrections with low sequence impact and calibration requirements.

Humans use local spectrotemporal correlations to detect rising and falling pitch.

To discern speech or appreciate music, the human auditory system detects how pitch increases or decreases over time. However, the algorithms used to detect changes in pitch, or pitch motion, are incompletely understood. Here, using psychophysics, computational modeling, functional neuroimaging, and analysis of recorded speech, we ask if humans detect pitch motion using computations analogous to those used by the visual system. We adapted stimuli from studies of vision to create novel auditory correlated noise stimuli that elicited robust pitch motion percepts. Crucially, these stimuli possess no persistent features across frequency or time, but do possess positive or negative local spectrotemporal correlations in intensity. In psychophysical experiments, we found clear evidence that humans judge pitch direction based on both positive and negative spectrotemporal correlations. The observed sensitivity to negative correlations is a direct analogue of illusory "reverse-phi" motion in vision, and thus constitutes a new auditory illusion. Our behavioral results and computational modeling led us to hypothesize that human auditory processing employs pitch direction opponency. fMRI measurements in auditory cortex supported this hypothesis. To link our psychophysical findings to real-world pitch perception, we analyzed recordings of English and Mandarin speech and discovered that pitch direction was robustly signaled by the same positive and negative spectrotemporal correlations used in our psychophysical tests, suggesting that sensitivity to both positive and negative correlations confers ecological benefits. Overall, this work reveals that motion detection algorithms sensitive to local correlations are deployed by the central nervous system across disparate modalities (vision and audition) and dimensions (space and frequency).

Robust Safe Motion Control for Compliantly Actuated Robots via Disturbance Observers

Robust Safe Motion Control for Compliantly Actuated Robots via Disturbance Observers

A dynamic target tracking framework of UGV for UAV recovery under random disturbances

PurposeDynamically tracking the target by unmanned ground vehicles (UGVs) plays a critical role in mobile drone recovery. This study aims to solve this challenge under diverse random disturbances, proposing a dynamic target tracking framework for UGVs based on target state estimation, trajectory prediction, and UGV control.Design/methodology/approachTo mitigate the adverse effects of noise contamination in target detection, the authors use the extended Kalman filter (EKF) to improve the accuracy of locating unmanned aerial vehicles (UAVs). Furthermore, a robust motion prediction algorithm based on polynomial fitting is developed to reduce the impact of trajectory jitter caused by crosswinds, enhancing the stability of drone trajectory prediction. Regarding UGV control, a dynamic vehicle model featuring independent front and rear wheel steering is derived. Additionally, a linear time-varying model predictive control algorithm is proposed to minimize tracking errors for the UGV.FindingsTo validate the feasibility of the framework, the algorithms were deployed on the designed UGV. Experimental results demonstrate the effectiveness of the proposed dynamic tracking algorithm of UGV under random disturbances.Originality/valueThis paper proposes a tracking framework of UGV based on target state estimation, trajectory prediction and UGV predictive control, enabling the system to achieve dynamic tracking to the UAV under multiple disturbance conditions.

Deep motion estimation through adversarial learning for gait recognition

Gait recognition is a form of identity verification that can be performed over long distances without requiring the subject’s cooperation, making it particularly valuable for applications such as access control, surveillance, and criminal investigation. The essence of gait lies in the motion dynamics of a walking individual. Accurate gait-motion estimation is crucial for high-performance gait recognition. In this paper, we introduce two main designs for gait motion estimation. Firstly, we propose a fully convolutional neural network named W-Net for silhouette segmentation from video sequences. Secondly, we present an adversarial learning-based algorithm for robust gait motion estimation. Together, these designs contribute to a high-performance system for gait recognition and user authentication. In the experiment, two datasets, i.e., OU-IRIS and our own dataset, are used for performance evaluation. Experimental results show that, the W-Net achieves an accuracy of 89.46% in silhouette segmentation, and the proposed user-authentication method achieves over 99.6% and 93.8% accuracy on the two datasets, respectively.

Solar-Powered Molecular Crystal Motor Based on an Anthracene-Thiazolidinedione Photoisomerization Reaction.

Assembling molecular machines into crystals provides a way to harness their power on large length scales, but the development of a crystal analogue to a molecular motor remains a challenge. The molecule (Z)-5-(anthracen-9-ylmethylene)-3-butylthiazolidine-2,4-dione (C4-ATD) has E and Z isomers with strongly overlapping absorption spectra. This spectroscopic property allows both Z → E and E → Z photoisomerization reactions to be driven by a single light source, and simulations indicate this property can provide a route to robust oscillatory motion. Reprecipitation in an aqueous surfactant enables the growth of single crystal microwires that exhibit continuous mechanical oscillations under a wide range of illumination conditions, including ambient solar irradiation. Molecular crystal motors provide a new approach for transforming continuous light into oscillatory mechanical motion.

A new industrially magnetic capsule MedRobot integrated with smart motion controller

Capsule medical robots with unique application advantages have broad prospects for gastrointestinal detection, targeted drug delivery, medical assistance, and other fields. However, due to the complexity of the gastrointestinal environment and the limitations of the space magnetic field, robust motion control of capsule robots is still a challenge. Using a permanent magnet (NdFeB) as a space magnetic source, a capsule robot manipulation instrument with an integrated motion intelligent control approach is proposed in this work. First of all, a steering fixture controlling a permanent magnet is designed, and a manipulation instrument capable of five degrees of motion freedom is built with low cost and high accuracy. Furthermore, an integrated motion control approach, consisting of a primary motion subsystem and an auxiliary motion subsystem, is presented, where the motion route of the capsule robot is planned. A parallel optimization strategy is adopted to improve the traditional Gray Wolf Optimization Algorithm, the improved version of which is utilized to tune the parameters of controllers. Finally, some experiments of the designed capsule robot are carried out in different planes and slopes, as well as simulated stomach and real pig stomach, respectively. The results show that the motion characteristics are continuous and stable, and the average position error is 4.2 mm, which meets the application requirements.

Safe Robust Adaptive Motion Control for Underactuated Marine Robots.

This article presents an innovative approach to the design of a safe adaptive backstepping control system. Tailored specifically for underactuated marine robots, the system utilizes simple sensors for enhanced practicality and efficiency. Given their operation in diverse oceanic environments fraught with various sources of uncertainties, ensuring the system's safe and robust behavior holds paramount importance in the control literature. To address this concern, this paper introduces a control strategy designed to ensure robustness at both the kinematic and dynamic levels. By emphasizing the compensation for the system uncertainties, the design integrates a straightforward fuzzy system structure. To further ensure the system's safety, a funnel surface is defined, followed by the design of a suitable nonlinear sliding surface as a function of the funnel and tracking error. Using Lyapunov theory, the study formally establishes the Semi-globally Practically Finite-time Stability of the closed-loop system, validated through simulations conducted on underactuated marine robots.

Nonlinear robust motion trajectory tracking control based on backstepping method for a novel pneumatic actuator

Nonlinear robust motion trajectory tracking control based on backstepping method for a novel pneumatic actuator

Co2iAR: Co-located audio-visual enabled mobile collaborative industrial AR wiring harness assembly

Existing augmented reality (AR) assembly mainly provides visual instructions for operators from a first-person perspective, and it is hard to share individual working intents for co-located workers on the shop floor, especially for large-scale product assembly task that requires multiple operators working together. To bridge this gap for practical deployments, this paper proposes Co2iAR, a co-located audio-visual enabled mobile collaborative AR assembly. Firstly, according to the stereo visual-inertial fusion strategy, robust and accurate self-contained motion tracking is achieved for the resource-constrained mobile AR platform, followed by a co-located alignment from multiple mobile AR clients on the shop floor. Then, a lightweight text-aware network for online wiring harness character recognition is proposed, as well as the audio-based confirming strategy, enabling natural audio-visual interaction among co-located workers within a shared immersive workplace, which can also monitor the current wiring assembly status and activate the step-by-step tutorials automatically. The novelty of this work is focused on the deployment of audio-visual aware interaction using the same device that is being used to deploy the co-located collaborative AR work instructions, establishing shared operating intents among multiple co-located workers. Finally, comprehensive experiments are carried out on the collaborative performance among multiple AR clients, and results illustrate that the proposed Co2iAR can alleviate the cognitive load and achieve superior performance for the co-located AR assembly tasks, providing a more human-centric collaborative assembly performance.

Research on Modeling Method of Autonomous Underwater Vehicle Based on a Physics-Informed Neural Network

Accurately modeling the system dynamics of autonomous underwater vehicles (AUVs) is imperative to facilitating the implementation of intelligent control. In this research, we introduce a physics-informed neural network (PINN) method to model the dynamics of AUVs by integrating dynamical equations with deep neural networks. This integration leverages the nonlinear expressive power of deep neural networks, alongside the robust foundation of physical prior knowledge, resulting in an AUV model proficient in long-term motion forecasting. The experimental results indicate that this method is capable of effectively extracting AUV system dynamics from datasets, exhibiting strong generalization capabilities and achieving robust long-term motion prediction. Furthermore, a model predictive control method is proposed, using the learned PINN as the predictive model to accurately track the closed-loop trajectory. This research offers novel perspectives on the dynamics modeling of AUVs and has the potential to be applied in other relevant research endeavors.

Control of a three-wheeled omnidirectional mobile robot via a mixed FTB/H∞\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\mathcal H_\\infty $$\\end{document} approach

In this paper, the problem of guidance and motion control of mobile robots is addressed and solved within the novel framework of the mixed finite-time/H∞\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\mathcal H_\\infty $$\\end{document} control theory of nonlinear quadratic systems (NLQSs). Starting from a NLQS describing the dynamics of omnidirectional mobile platforms, the main tasks performed for controlling in closed loop the motion of omnidirectional robots can be conveniently formulated as a mixed finite-time/H∞\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\mathcal H_\\infty $$\\end{document} control problem. A robust motion controller, which can effectively rejects disturbances deviating the robot platform from a planned path, can be designed after choosing a linear state-feedback structure for the controller. The synthesis problem is solved through some sufficient conditions contemplating both norm-bounded disturbances and sets constraining initial and terminal conditions, together with a finite-time bound on the output transient. Therefore, for all the allowable uncertainties, in presence of nonzero initial conditions and exogenous disturbance inputs which are possible within an unstructured environment, the motion control tasks can be accomplished through optimal H∞\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\mathcal H_\\infty $$\\end{document} performance by simultaneously guaranteeing that the NLQS, which governs in closed loop the robot platform, is finite-time bounded. Finally, the applicability and control performance of the design approach have been evaluated through numerical simulations.