Motion Planning Approach Research Articles

A Motion Planner Based on Mask-D3QN of Quadruped Robot Motion for Steam Generator.

Crawling robots are the focus of intelligent inspection research, and the main feature of this type of robot is the flexibility of in-plane attitude adjustment. The crawling robot HIT_Spibot is a new type of steam generator heat transfer tube inspection robot with a unique mobility capability different from traditional quadrupedal robots. This paper introduces a hierarchical motion planning approach for HIT_Spibot, aiming to achieve efficient and agile maneuverability. The proposed method integrates three distinct planners to handle complex motion tasks: a nonlinear optimization-based base motion planner, a TOPSIS-based base orientation planner, and a Mask-D3QN (MD3QN) algorithm-based gait motion planner. Initially, the robot's base and foot workspace were delineated through envelope analysis, followed by trajectory computation using Larangian methods. Subsequently, the TOPSIS algorithm was employed to establish an evaluation framework conducive to foundational turning planning. Finally, the MD3QN algorithm trained foot-points to facilitate robot movement along predefined paths. Experimental results demonstrated the method's adaptability across diverse tube structures, showcasing robust performance even in environments with random obstacles. Compared to the D3QN algorithm, MD3QN achieved a 100% success rate, enhanced average overall scores by 6.27%, reduced average stride lengths by 39.04%, and attained a stability rate of 58.02%. These results not only validate the effectiveness and practicality of the method but also showcase the significant potential of HIT_Spibot in the field of industrial inspection.

An Explainable and Robust Motion Planning and Control Approach for Autonomous Vehicle On-Ramping Merging Task Using Deep Reinforcement Learning

An Explainable and Robust Motion Planning and Control Approach for Autonomous Vehicle On-Ramping Merging Task Using Deep Reinforcement Learning

Causal deconfounding deep reinforcement learning for mobile robot motion planning

Deep reinforcement learning (DRL) has emerged as an efficient approach for motion planning in mobile robot systems. It leverages the offline training process to enhance real-time computation efficiency. In DRL-based methods, the DRL models are trained to compute an action based on the current state of the robot and the surrounding obstacles. However, the trained models may capture spurious correlations through potential confounders, resulting in non-robust state representations, which limits the models’ robustness and generalizability. In this paper, we propose a Causal Deconfounding DRL method for Motion Planning, CD-DRL-MP, to address spurious correlations and learn robust and generalizable policies. Specifically, we formalize the temporal causal relationships between states and actions using a structural causal model. We then extract the minimal sufficient state representation set by blocking the backdoor paths in the causal model. Finally, using the representation set, CD-DRL-MP learns the causal effect between states and actions while mitigating the detrimental influence of potential confounders and computes motion commands for mobile robots. Comprehensive experiments show that the proposed method significantly outperforms non-causal DRL methods and existing causal methods, while guaranteeing good robustness and generalizability.

A differentiable dynamic modeling approach to integrated motion planning and actuator physical design for mobile manipulators

AbstractThis paper investigates the differentiable dynamic modeling of mobile manipulators to facilitate efficient motion planning and physical design of actuators, where the actuator design is parameterized by physically meaningful motor geometry parameters. The proposed differentiable modeling comprises two major components. First, the dynamic model of the mobile manipulator is derived, which differs from the state‐of‐the‐art in two aspects: (1) the model parameters, including magnetic flux, link mass, inertia, and center‐of‐mass, are represented as analytical functions of actuator design parameters; (2) the dynamic coupling between the base and the manipulator is captured. Second, the state and control constraints, such as maximum angular velocity and torque capacity, are established as analytical functions of actuator design parameters. This paper further showcases two typical use cases of the proposed differentiable modeling work: integrated locomotion and manipulation planning; simultaneous actuator design and motion planning. Numerical experiments demonstrate the effectiveness of differentiable modeling. That is, for motion planning, it can effectively reduce computation time as well as result in shorter task completion time and lower energy consumption, compared with an established sequential motion planning approach. Furthermore, actuator design and motion planning can be jointly optimized toward higher performance.

An Investigation of Real-Time Robotic Polishing Motion Planning Using a Dynamical System

When addressing the technical challenges of achieving precise force tracking during the local polishing process of polishing robots, controlling the contact state between the robot and the workpiece surface is essential. To this end, a contact motion-planning strategy based on dynamic systems is designed to generate trajectory routes during local polishing. The trajectory simulation of the local modulation dynamic system is achieved through the employment of the support vector regression (SVR) algorithm with a Gaussian kernel, facilitating the learning process. The feasibility and stability of planning local paths are validated using the local modulation dynamic system. To maintain a constant contact force between the end-effector polishing robot and the workpiece, an integral adaptive impedance control strategy is utilized, enabling the robot’s compliant control. Subsequently, an experimental system for the polishing robot is constructed in order to verify the effectiveness of the motion-planning system. The experimental results demonstrate that the proposed motion-planning approach is applicable in practical polishing processes, ensuring smooth contact and maintaining the desired contact force when scanning nonlinear surfaces, and thus showcasing stability and practicality.

An enhanced motion planning approach by integrating driving heterogeneity and long-term trajectory prediction for automated driving systems: A highway merging case study

Navigating automated driving systems (ADSs) through complex driving environments is difficult. Predicting the driving behavior of surrounding human-driven vehicles (HDVs) is a critical component of an ADS. This paper proposes an enhanced motion-planning approach for an ADS in a highway-merging scenario. This method utilizes the results of two aspects: the driving behavior and long-term trajectory of surrounding HDVs, which are coupled using a hierarchical model that is used for the motion planning of an ADS to improve driving safety. An unsupervised clustering algorithm is utilized to classify HDV drivers into two categories: aggressive and normal, as part of predicting their driving behaviors. Subsequently, a logistic regression model is employed for driving style prediction. For trajectory prediction, a transformer-based model that concentrated parallelization computations on longer sequence predictions via a self-attention mechanism is developed. Based on the predicted driving styles and trajectories of the surrounding HDVs, an intelligent decision-making strategy is utilized for ADS motion planning. Finally, real-world traffic data collected from drones on a highway ramp in Xi’an is used as a case study to train and evaluate the proposed model. The results demonstrate that the proposed approach can predict HDVs merging trajectories with a mean squared error (MSE) smaller than 0.125 at 30 s away from the merging point, outperforming existing approaches in terms of predictable duration and accuracy. Furthermore, it exhibited safety improvements by adjusting the ADS motion state in advance with good predictive power for the surrounding HDVs’ motion. For both normal and aggressive driving styles, the ADS trajectories reached optimal safety at a prediction horizon of at least 10 s and over 6.67 s, respectively, when evaluating both time-to-collision (TTC) and deceleration rate to avoid a crash (DRAC) metrics. This indicates that our proposed procedures have improved safety for AVs with long-term predictive capabilities (i.e., over 6 s) for surrounding HDVs. Interestingly, the safety performance does not continue to improve with the increase in prediction horizon once the optimal safety performance (highest TTC and lowest DRAC) has been achieved for both normal and aggressive styles. This suggests that an excessively long prediction horizon (e.g., 30 s) is not always beneficial for safety performance of ADS in our case study. When ADS encounter aggressive HDVs, having a predicted surrounding HDV trajectory can extremely reduce crash risk and maintain a safe situation. This demonstrates that planning ADS trajectories with HDV predictions has significant effects on safety, especially for aggressive driving styles as compared to normal driving styles.

Motion Planning for Autonomous Driving with Real Traffic Data Validation

Accurate trajectory prediction of surrounding road users is the fundamental input for motion planning, which enables safe autonomous driving on public roads. In this paper, a safe motion planning approach is proposed based on the deep learning-based trajectory prediction method. To begin with, a trajectory prediction model is established based on the graph neural network (GNN) that is trained utilizing the INTERACTION dataset. Then, the validated trajectory prediction model is used to predict the future trajectories of surrounding road users, including pedestrians and vehicles. In addition, a GNN prediction model-enabled motion planner is developed based on the model predictive control technique. Furthermore, two driving scenarios are extracted from the INTERACTION dataset to validate and evaluate the effectiveness of the proposed motion planning approach, i.e., merging and roundabout scenarios. The results demonstrate that the proposed method can lower the risk and improve driving safety compared with the baseline method.

Model-based reinforcement learning for robot-based laser material processing

Articulated robotic arms in laser material processing require precise motion planning. Traditional motion planning methods face challenges in trajectory accuracy. This study demonstrates model-based reinforcement learning as an effective approach for motion planning of these robotic arms. The process involves training a neural network trajectory model based on Pilz Industrial Motion Planner, followed by training an agent to optimize motion by adjusting joint velocities.The study compares Proximal Policy Optimization and Soft Actor-Critic algorithms to the baseline Pilz motion plan. Results show that model-based reinforcement learning improves accuracy in x-direction, reducing mean absolute error to 1.75 × 10−3 m from 6.37 × 10−3 m. However, it slightly increases z-direction mean absolute error, from 6 × 10−6 m to 2.5 × 10−4 m. This leads to an increase in on-surface beam radius, from 2.9 × 10−5 m to 3.3 × 10−5 m, and decrease in peak intensity of 22.77 % compared to baseline.These results highlight reinforcement learning’s potential to enhance trajectory accuracy in motion planning, advancing robot-based laser material processing.

Interactive Left-Turning of Autonomous Vehicles at Uncontrolled Intersections

This paper presents a novel interactive motion planning approach for left-turning of autonomous vehicles at uncontrolled intersections. A typical left-turning scenario that consists of agent vehicles and an autonomous ego vehicle is established. The autonomous ego vehicle aims to cross the uncontrolled intersection quickly and safely when meeting with the agent vehicles. A modified obstacle reciprocal collision avoidance (MORCA) prediction model is proposed to predict the trajectory of the agent vehicles with the considerations of longitudinal and lateral interaction-aware behaviors. The parameters of the MORCA prediction model are optimized using particle swarm optimization (PSO) with the inD datasets. Based on MORCA, a partially observable Markov decision process (POMDP) framework is established. The action and state spaces of the POMDP are extended reasonably to satisfy the requirement of real-time application. The simulation results show that the prediction precision is improved by 15% using the MORCA compared with the obstacle reciprocal collision avoidance (ORCA) prediction model. Meanwhile, the results manifest that the proposed MORCA-based POMDP planning method improves 43.8% in commuting efficiency compared with a traditional rule-based method, nearly as good as the vehicle-to-vehicle (V2V) communication is equipped. <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Note to Practitioners</i> —The motivation of this article is to establish a safe and efficient planning framework for the left-turning of autonomous vehicles at uncontrolled intersections. Rule-based approaches were widely used in the previous studies but they are not optimal. In this paper, the lateral movements of vehicles at the intersection are considered for the first time. A MORCA prediction model is established and optimized to formulate a POMDP planning framework. The CARLA simulation demonstrates the effectiveness of the proposed MORCA-based POMDP planner. In future work, we will migrate the algorithm to a real-world test platform for experimentation.

Optimal Task and Motion Planning and Execution for Multiagent Systems in Dynamic Environments.

Combining symbolic and geometric reasoning in multiagent systems is a challenging task that involves planning, scheduling, and synchronization problems. Existing works overlooked the variability of task duration and geometric feasibility intrinsic to these systems because of the interaction between agents and the environment. We propose a combined task and motion planning approach to optimize the sequencing, assignment, and execution of tasks under temporal and spatial variability. The framework relies on decoupling tasks and actions, where an action is one possible geometric realization of a symbolic task. At the task level, timeline-based planning deals with temporal constraints, duration variability, and synergic assignment of tasks. At the action level, online motion planning plans for the actual movements dealing with environmental changes. We demonstrate the approach's effectiveness in a collaborative manufacturing scenario, in which a robotic arm and a human worker shall assemble a mosaic in the shortest time possible. Compared with existing works, our approach applies to a broader range of applications and reduces the execution time of the process.

A Strategy for Integrated Multi-Demands High-Performance Motion Planning Based on Nonlinear MPC

Nonlinear Model Predictive Control (NMPC) is an effective approach for motion planning in autonomous vehicles that need to satisfy multiple driving demands. Within the realm of planner design, current strategies inadequately address the issues related to redundancy and conflicts among these diverse demands. This shortcoming leads to low efficiency and suboptimal performance, particularly when faced with a high volume of demands. In response to this challenge, this paper introduces the Hierarchical and Multi-Domain (HMD) strategy as a solution for designing a multi-objective NMPC planner. This strategy enables the dynamic adjustment of the integration method for demand indicators based on their priority. To evaluate the risk of breaching driving demands, several risk functions are established. The constraints and objective function of the planner are meticulously designed in accordance with the HMD strategy and evaluation functions. Simulation results attest to the advantages of the HMD-based planner, which, compared to planners based on traditional multi-objective (TMO) strategies, exhibits a 68.5% improvement in solution efficiency and the simultaneous enhancement of driving safety. Additionally, the HMD approach reduces the maximum jerk by 58.8%.

A Novel Sampling-Based Optimal Motion Planning Algorithm for Energy-Efficient Robotic Pick and Place

Energy usage in robotic applications is rapidly increasing as industrial robot installations grow. This research introduces a novel approach, using the rapidly exploring random tree (RRT)-based scheme for optimizing the robot’s motion planning and minimizing energy consumption. Sampling-based algorithms for path planning, such as RRT and its many other variants, are widely used in robotic motion planning due to their efficiency in solving complex high-dimensional problems efficiently. However, standard versions of these algorithms cannot guarantee that the generated trajectories are always optimum and mostly ignore the energy consumption in robotic applications. This paper proposes an energy-efficient industrial robotics motion planning approach using the novel flight cost-based RRT (FC-RRT*) algorithm in pick-and-place operation to generate nodes in a predetermined direction and then calculate energy consumption using the circle point method. After optimizing the motion trajectory, power consumption is computed for the rotary axes of a six degree of freedom (6DOF) serial type of industrial robot using the work–energy hypothesis for the rotational motion of a rigid body. The results are compared to the traditional RRT and RRT* (RRT-star) algorithm as well as the kinematic solutions. The experimental results of axis indexing tests indicate that by employing the sampling-based FC-RRT* algorithm, the robot joints consume less energy (1.6% to 16.5% less) compared to both the kinematic solution and the conventional RRT* algorithm.

Auction-Based Task Allocation and Motion Planning for Multi-Robot Systems with Human Supervision

This paper presents a task allocation strategy for a multi-robot system with a human supervisor. The multi-robot system consists of a team of heterogeneous robots with different capabilities that operate in a dynamic scenario that can change in the robots’ capabilities or in the operational requirements. The human supervisor can intervene in the operation scenario by approving the final plan before its execution or forcing a robot to execute a specific task. The proposed task allocation strategy leverages an auction-based method in combination with a sampling-based multi-goal motion planning. The latter is used to evaluate the costs of execution of tasks based on realistic features of paths. The proposed architecture enables the allocation of tasks accounting for priorities and precedence constraints, as well as the quick re-allocation of tasks after a dynamic perturbation occurs –a crucial feature when the human supervisor preempts the outcome of the algorithm and makes manual adjustments. An extensive simulation campaign in a rescue scenario validates our approach in dynamic scenarios comprising a sensor failure of a robot, a total failure of a robot, and a human-driven re-allocation. We highlight the benefits of the proposed multi-goal strategy by comparing it with single-goal motion planning strategies at the state of the art. Finally, we provide evidence for the system efficiency by demonstrating the powerful synergistic combination of the auction-based allocation and the multi-goal motion planning approach.

An Optimized and Stable CF2 Mobile Robot Motion Planning Approach and Adaptation for Moving Targets

In this paper, the mobile robot motion planning approach (PSO-CF2-mt: PSO-CF2 for moving targets) is improved to track a moving target following a smooth path. PSO-CF2-mt was tested previously in various static and dynamic environments and proved its capacity to track moving targets whatever the form of the target’s trajectory. The problem with PSO-CF2-mt that we want to face in this paper is the stability of the robot’s motion. It is tackled by limiting the angular velocity of the robot. The angular speed limit is PSO selected and the variance of the angular speed is added to the fitness function as a third objective. This new version of PSO-CF2-mt is called OS-CF2-mt (Optimized Stable CF2-mt). Simulation results prove the capacity of OS-CF2-mt in ensuring stable travels for mobile robots following short, secure and smooth paths when tracking moving targets whether the environment is static or dynamic and whatever the form of the target’s trajectory.

Solving Rearrangement Puzzles Using Path Defragmentation in Factored State Spaces

Rearrangement puzzles are variations of rearrangement problems in which the elements of a problem are potentially logically linked together. To efficiently solve such puzzles, we develop a motion planning approach based on a new state space that is logically <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">factored</i> , integrating the capabilities of the robot through factors of simultaneously manipulatable joints of an object. Based on this factored state space, we propose less-actions RRT (LA-RRT), a planner which optimizes for a low number of actions to solve a puzzle. At the core of our approach lies a new path defragmentation method, which rearranges and optimizes consecutive edges to minimize action cost. We solve six rearrangement scenarios with a Fetch robot, involving planar table puzzles and an escape room scenario. LA-RRT significantly outperforms the next best asymptotically-optimal planner by 4.01 to 6.58 times improvement in final action cost.

Recent Developments of Actuation Mechanisms for Continuum Robots: A Review.

Traditional rigid robots face significant challenges in congested and tight environments, including bulky size, maneuverability, and safety limitations. Thus, soft continuum robots, inspired by the incredible capabilities of biological appendages such as octopus arms, starfish, and worms, have shown promising performance in complex environments due to their compliance, adaptability, and safety. Different actuation techniques are implemented in soft continuum robots to achieve a smoothly bending backbone, including cable-driven actuators, pneumatic actuators, and hydraulic actuation systems. However, designing and developing efficient actuation mechanisms, motion planning approaches, and control algorithms are challenging due to the high degree of redundancy and non-linearity of soft continuum robots. This article profoundly reviews the merits and drawbacks of soft robots' actuation systems concerning their applications to provide the readers with a brief review reference to explore the recent development of soft robots' actuation mechanisms technology. Moreover, the authors have surveyed the recent review studies in controller design of continuum robots as a guidance for future applications.

Event-triggered reconfigurable reinforcement learning motion-planning approach for mobile robot in unknown dynamic environments

Deep reinforcement learning (DRL) is an essential technique for autonomous motion planning of mobile robots in dynamic and uncertain environments. In attempting to acquire a satisfactory DRL-based motion planning strategy, the mobile robots encountered several difficulties, including poor convergence, insufficient sample information, and low learning efficiency. These problems not only consume plenty of training time, but also bring a negative impact on motion planning performance. One promising research direction is to provide a more effective network framework for DRL-based policies. Along this line of thinking, our paper presents a novel DRL-based motion planning approach called Reconfigurable Structure of Deep Deterministic Policy Gradient (RS-DDPG) for mobile robots. To account for the poor convergence, the proposed approach first introduces an event-triggered reconfigurable actor–critic network framework for motion policy that adaptively changes its network structure to suppress the overestimation of action value. Then, the time convergence of the motion policy can be enhanced based on the value actions with minor valuation deviation. Afterwards, an adaptive reward mechanism is designed for reconfigurable networks to compensate for the lack of sample information. To deal with the problem of low learning efficiency, we developed a sample pretreatment method for the experience samples, which employs three novel techniques to improve the sample utilization, including a double experience memory buffer, a variable proportional sampling principle, and a similarity judgment mechanism. In extensive experiments, the proposed method outperforms the compared approaches.

A Unified Trajectory Optimization Approach for Long-Term and Reactive Motion Planning of Legged Locomotion

A Unified Trajectory Optimization Approach for Long-Term and Reactive Motion Planning of Legged Locomotion

Imitation-Based Motion Planning and Control of a Multi-Section Continuum Robot Interacting With the Environment

Recently, flexible robots are growing in importance owing to their merits over rigid robots in maneuverability and safety, which equips them to work in unstructured environments, such as occur in medical applications. However, motion planning and control of flexible manipulators is challenging due to their compliance behavior and system uncertainties. Thus, this letter presents an Imitation-based Motion Planning (IbMP) approach, along with dynamic impedance control for learning, planning, and trajectory tracking of a two-section soft continuum robot in a dynamic environment. Point-to-point motion demonstrations, including the robot's tip position and orientation are intuitively provided by a motion capture system (OptiTrack V120-trio) and a similar kinematic flexible interface. Additionally, a singularity-free dynamic model based on Lagrangian formulation and Taylor expansion series of a two-section continuum robot is derived while planning for robot motions. The simulation results show that the IbMP approach, along with the dynamic impedance control, generalizes the robot's motion by varying the initial and goal of the robot's tip pose while avoiding static and dynamic obstacles, and moving back to the desired track after disturbances. Finally, the stability and performance of the IbMP algorithm against input disturbances are assessed using a Monte Carlo approach that can guide the selection of gain values.

A data-driven approach for motion planning of industrial robots controlled by high-level motion commands.

Most motion planners generate trajectories as low-level control inputs, such as joint torque or interpolation of joint angles, which cannot be deployed directly in most industrial robot control systems. Some industrial robot systems provide interfaces to execute planned trajectories by an additional control loop with low-level control inputs. However, there is a geometric and temporal deviation between the executed and the planned motions due to the inaccurate estimation of the inaccessible robot dynamic behavior and controller parameters in the planning phase. This deviation can lead to collisions or dangerous situations, especially in heavy-duty industrial robot applications where high-speed and long-distance motions are widely used. When deploying the planned robot motion, the actual robot motion needs to be iteratively checked and adjusted to avoid collisions caused by the deviation between the planned and the executed motions. This process takes a lot of time and engineering effort. Therefore, the state-of-the-art methods no longer meet the needs of today's agile manufacturing for robotic systems that should rapidly plan and deploy new robot motions for different tasks. We present a data-driven motion planning approach using a neural network structure to simultaneously learn high-level motion commands and robot dynamics from acquired realistic collision-free trajectories. The trained neural network can generate trajectory in the form of high-level commands, such as Point-to-Point and Linear motion commands, which can be executed directly by the robot control system. The result carried out in various experimental scenarios has shown that the geometric and temporal deviation between the executed and the planned motions by the proposed approach has been significantly reduced, even if without access to the "black box" parameters of the robot. Furthermore, the proposed approach can generate new collision-free trajectories up to 10 times faster than benchmark motion planners.