Motion Planning Research Articles

Design and Motion Planning of a Cable Robot Utilizing Cable Slackness

Abstract Extending the workspace of cable robots can enhance their motion ability and help us make fuller use of their potential. This work designs a novel cable robot and utilizes cable slackness to extend its workspace. First, we use driving cables actuated by main motors and constrained cables driven by auxiliary motors equipped with lockers to control and restrain the motion of the end-effector, respectively. Then we classify the constraints on the end-effector into different modes according to the slackness of different constrained cables whose lengths can be changed by auxiliary motors, and continuous tension distribution (realized by tensioning devices) is applied to switch among them. To expand the mechanism’s workspace, the properties of the constraint mode series are analyzed and the static reachable workspace associated with it is defined, which guarantees the existence of feasible point-to-point trajectories. In particular, tree-based basic and general constraint mode series connection algorithms are designed to connect two targets in the static reachable workspace efficiently considering the necessary condition for the existence of the connection. After that, dual workspaces and subspace-based motion planning algorithms are designed to connect multiple targets in the static reachable workspace of the mechanism, and the quality of the trajectories is improved by using different manipulations of the constraint mode series. Since only driving cables are actuated by real-time capable servo motors and passively constrained cables are adopted to compensate for the weight of the end-effector, the size and the number of actuators and the energy consumption of the robot are reduced. Finally, the performance of the mechanism designed and the motion planning methods proposed are verified numerically under practical modeling errors regarding the cable elongation phenomenon.

Robots in Partially Known and Unknown Environments: A Simulated Annealing Approach for Re-Planning

The path planning problem using mobile robots, also known as robot motion planning, is a key problem in robotics. The goal is to find a collision-free path from a starting point to a target point in an environment with obstacles. These obstacles can be known, partially unknown, or completely unknown to the robot. The robot’s decisions are different according to its degree of knowledge of the environment. If the environment is fully known, using an offline approach is sufficient. Otherwise, online techniques are required to find a path. They must be fast, effective, and adaptive to tackle the complexity of changing environments. In this work, we propose a framework based on a simulated annealing approach to solve the path planning problem with different degrees of knowledge of the environment for the robot. We evaluate our approach with a set of large-scale instances with different features. The results show that our framework can quickly find quality solutions and is also able to manage environmental changes.

How to arrange the robotic environment? Leveraging experience in both motion planning and environment optimization

This study presents an experience-based hierarchical-structure optimization algorithm to address the robotic system environment design problem, which combines motion planning and environment arrangement problems together. The motion planning problem, which could be defined as a multiple-degree-of-freedom (m-DOF) problem, together with the environment arrangement problem, which could be defined as a free DOF problem, is a high-dimensional optimization problem. Therefore, the hierarchical structure was established, with the higher layer solving the environment arrangement problem and lower layer solving the problem of motion planning. Previously planned trajectories and past results for this design problem were first constructed as datasets; however, they cannot be seen as optimal. Therefore, this study proposed an experience-reuse manner, which selected the most “useful” experience from the datasets and reused it to query new problems, optimize the results in the datasets, and provide better environment arrangement with shorter path lengths within the same time. Therefore, a hierarchical structural caseGA-ERTC algorithm was proposed. In the higher layer, a novel approach employing the case-injected genetic algorithm (GA) was implemented to tackle optimization challenges in robot environment design, leveraging experiential insights. Performance indices in the arrangement of the robot system’s environment were determined by the robotic arm’s motion and path length calculated using an experience-driven random tree (ERT) algorithm. Moreover, the effectiveness of the proposed method is illustrated with the 12.59% decrease in path lengths by solving different settings of hard problems and 5.05% decrease in easy problems compared with other state-of-the-art methods in three small robots.

Brain functional connectivity under teleoperation latency: a fNIRS study

IntroductionLong-distance robot teleoperation faces high latencies that pose cognitive challenges to human operators. Latency between command, execution, and feedback in teleoperation can impair performance and affect operators’ mental state. The neural underpinnings of these effects are not well understood.MethodsThis study aims to understand the cognitive impact of latency in teleoperation and the related mitigation methods, using functional Near-Infrared Spectroscopy (fNIRS) to analyze functional connectivity. A human subject experiment (n = 41) of a simulated remote robot manipulation task was performed. Three conditions were tested: no latency, with visual and haptic latency, with visual latency and no haptic latency. fNIRS and performance data were recorded and analyzed.ResultsThe presence of latency in teleoperation significantly increased functional connectivity within and between prefrontal and motor cortexes. Maintaining visual latency while providing real-time haptic feedback reduced the average functional connectivity in all cortical networks and showed a significantly different connectivity ratio within prefrontal and motor cortical networks. The performance results showed the worst performance in the all-delayed condition and best performance in no latency condition, which echoes the neural activity patterns.ConclusionThe study provides neurological evidence that latency in teleoperation increases cognitive load, anxiety, and challenges in motion planning and control. Real-time haptic feedback, however, positively influences neural pathways related to cognition, decision-making, and sensorimotor processes. This research can inform the design of ergonomic teleoperation systems that mitigate the effects of latency.

Design of a Novel Macro-Micro Integrated Brain Surgery Robot Based on Modular Parallel Mechanisms

The advancement and development of medical surgical robots have provided new technological support for brain surgery and neurosurgical procedures, improving the reliability of highly complex and precise surgeries. In turn, this urges the design and development of novel surgical robots to possess higher precision, stability, and enhanced motion capabilities. In response to this practical demand, this paper introduces a macro-micro integrated medical brain surgery robot system based on the concept of modular PMs (parallel mechanisms), which have a total of 13 active DOFs (degrees of freedom). This system divides the motion process of brain surgery into a large-scale macro-motion space and a small-scale high-precision motion space for design and planning control. The introduction of the design concept that combines multiple modular parallel sub-mechanisms has brought a significant level of decoupling characteristics to the mechanism itself. A comprehensive introduction and analysis of the surgical robot are provided, covering aspects such as design, kinematics, motion planning, and performance indicators. To address the pose allocation and coordination of motion between the macro platform and the micro platform, a pose allocation algorithm based on the decoupling and non-decoupling characteristics in various dimensions of the macro-micro platform is proposed. The designed measurement experiments have demonstrated that the repeatability in positioning accuracy of the macro and micro platform reaches the level of micron and submicron respectively. Practical experiments of motion control and simulated brain electrode implantation validate the excellent performance and stability of the entire surgical robot system. This research contributes innovative insights to the development of medical surgical robot systems, particularly in the domain of mechanism design.

Motion Planning and Path Following for Autonomous Navigation and Reversing of a Full-Scale Mining Truck and Trailer System

Motion Planning and Path Following for Autonomous Navigation and Reversing of a Full-Scale Mining Truck and Trailer System

Optimization Algorithms for Dynamic Environmental Sensing and Motion Planning of Quadruped Robots in Complex Environments on Unmanned Offshore Platforms

Optimization Algorithms for Dynamic Environmental Sensing and Motion Planning of Quadruped Robots in Complex Environments on Unmanned Offshore Platforms

GPU-Enabled Parallel Trajectory Optimization Framework for Safe Motion Planning of Autonomous Vehicles

GPU-Enabled Parallel Trajectory Optimization Framework for Safe Motion Planning of Autonomous Vehicles

Ro2En: Robust Neural Environment Encoder for Domain Generalization of Fast Motion Planning

This paper discusses a new issue named domain generalization of fast motion planning in 3D environments, which benefits agility-required robot applications such as autonomous driving and uncrewed aerial vehicle obstacle avoidance flight. The existing work shows that conventional spatial search-based planning algorithms cannot meet the real-time requirement due to high time costs. The end-to-end neural network-based methods achieve an excellent balance between performance and planning speed in the seen environments, but are hard to transfer to new scenarios. To overcome this limitation, we propose a novel Robust Environment Encoder (Ro2En) approach to domain generalization of fast motion planning. Specifically, by demonstrating the reconstructed environment, we find that the previous environment encoder cannot encode the volume information properly, i.e., a volume collapse ensues, which leads to noisy environment modeling. Inspired by this observation, a dual-task auto-encoder is developed. It can not only reconstruct the point cloud of the obstacles, but also align their geometric centers. Experiment results showed that in the new scenarios, Ro2En outperformed previous state-of-the-art conventional and neural alternatives with a much smaller performance variation.

Global reorientation of a free-fall multibody system using periodical joint motions – theory and motion planning

Global reorientation of a free-fall multibody system using periodical joint motions – theory and motion planning

Editorial for Special Issue of Motion Planning and Advanced Control for Robotics

Advancements in robotics are increasingly essential in addressing complex challenges associated with motion planning and control, particularly in environments that require physical interaction with various elements [...]

Deep reinforcement learning augmented decision model for intelligent driving cars

In view of the fact that the state machine decision model cannot effectively handle the rich contextual information and the influence of uncertain factors in ice and snow environments, a deep reinforcement learning agent based on the deep Q network algorithm (DQN) was constructed. The motion planner was used to augment the agent, and the rule-based decision planning module and the deep reinforcement learning model were integrated to establish the DQN-planner model, thereby improving the convergence speed and driving ability of the reinforcement learning agent. Finally, based on the CARLA simulation platform, a comparative experiment was conducted on the driving ability of the DQN model and the DQN-planner model on low-adhesion ice and snow roads, and the training process and verification results were analyzed respectively.

Dynamic event-triggered integrated task and motion planning for process-aware source seeking

The process-aware source seeking (PASS) problem in flow fields aims to find an informative trajectory to reach an unknown source location while taking the energy consumption in the flow fields into consideration. Taking advantage of the dynamic flow field partition technique, this paper formulates this problem as a task and motion planning (TAMP) problem and proposes a bi-level hierarchical planning framework to decouple the planning of inter-region transition and inner-region trajectory by introducing inter-region junctions. An integrated strategy is developed to enable efficient upper-level planning by investigating the optimal solution of the lower-level planner. In order to leverage the information acquisition and computational burden, a dynamic event-triggered mechanism is introduced to enable asynchronized estimation, region partitioning and re-plans. The proposed algorithm provides guaranteed convergence of the trajectory, and achieves automatic trade-offs of both exploration-exploitation and accuracy-efficiency. Simulations in a highly complicated and realistic ocean surface flow field validate the merits of the proposed algorithm, which demonstrates a significant reduction in computational burden without compromising planning optimality.

Trajectory optimization and obstacle avoidance of autonomous robot using Robust and Efficient Rapidly Exploring Random Tree.

One of the key challenges in robotics is the motion planning problem. This paper presents a local trajectory planning and obstacle avoidance strategy based on a novel sampling-based path-finding algorithm designed for autonomous vehicles navigating complex environments. Although sampling-based algorithms have been extensively employed for motion planning, they have notable limitations, such as sluggish convergence rate, significant search time volatility, a vast, dense sample space, and unsmooth search routes. To overcome the limitations, including slow convergence, high computational complexity, and unnecessary search while sampling the whole space, we have proposed the RE-RRT* (Robust and Efficient RRT*) algorithm. This algorithm adapts a new sampling-based path-finding algorithm based on sampling along the displacement from the initial point to the goal point. The sample space is constrained during each stage of the random tree's growth, reducing the number of redundant searches. The RE-RRT* algorithm can converge to a shorter path with fewer iterations. Furthermore, the Choose Parent and Rewire processes are used by RE-RRT* to improve the path in succeeding cycles continuously. Extensive experiments under diverse obstacle settings are performed to validate the effectiveness of the proposed approach. The results demonstrate that the proposed approach outperforms existing methods in terms of computational time, sampling space efficiency, speed, and stability.

See the Unseen: Grid-Wise Drivable Area Detection Dataset and Network Using LiDAR

Drivable Area (DA) detection is crucial for autonomous driving. Camera-based methods rely heavily on illumination conditions and often fail to capture accurate 3D information, while LiDAR-based methods offer accurate 3D data and are less susceptible to illumination conditions. However, existing LiDAR-based methods focus on point-wise detection, so are prone to occlusion and limited by point cloud sparsity, which leads to decreased performance in motion planning and localization. We propose Argoverse-grid, a grid-wise DA detection dataset derived from Argoverse 1, comprising over 20K frames with fine-grained BEV DA labels across various scenarios. We also introduce Grid-DATrNet, a first grid-wise DA detection model utilizing global attention through transformers. Our experiments demonstrate the superiority of Grid-DATrNet over various methods, including both LiDAR and camera-based approaches, in detecting grid-wise DA on the proposed Argoverse-grid dataset. Grid-DATrNet achieves state-of-the-art results with an accuracy of 93.28% and an F1-score of 0.8328. We show that Grid-DATrNet can detect grids even in occluded and unmeasured areas by leveraging contextual and semantic information through global attention, unlike CNN-based DA detection methods. The preprocessing code for Argoverse-grid, experiment code, Grid-DATrNet implementation, and result visualization code are available at AVE Laboratory official git hub.

Energy-Aware Hierarchical Control of Joint Velocities

Nowadays, robots are applied in dynamic environments. For a robust operation, the motion planning module must consider other tasks besides reaching a specified pose: (self) collision avoidance, joint limit avoidance, keeping an advantageous configuration, etc. Each task demands different joint control commands, which may counteract each other. We present a hierarchical control that, depending on the robot and environment state, determines online a suitable priority among those tasks. Thereby, the control command of a lower-prioritized task never hinders the control command of a higher-prioritized task. We ensure smooth control signals also during priority rearrangement. Our hierarchical control computes reference joint velocities. However, the underlying concepts of hierarchical control differ when using joint accelerations or joint torques as control signals instead. So, as a further contribution, we provide a comprehensive discussion on how joint velocity control, joint acceleration control, and joint torque control differ in hierarchical task control. We validate our formulation in an experiment on hardware.

A parallel mechanism-based virtual biomechanical shoulder robot model: Mechanism design optimization and motion planning

This paper presents the design and optimization process of a Virtual Biomechanical Shoulder Robot Model (VBSRM) based on a 6-4 parallel mechanism. To address the challenges posed by parallel manipulators and the specific biomechanical constraints of the shoulder joint, a comprehensive design analysis is conducted. First, a kinematic model of the VBSRM is developed, followed by an investigation of its geometric model. To obtain an optimal VBSRM design, performance objectives such as condition number, norm of actuator force, and stiffness are identified and optimized. Initially, only condition number of the robot mechanism is optimized using Genetic Algorithm and performance objectives from the optimal design are analyzed. Later, the three objectives are grouped to form a single function and a single objective-based optimization is also conducted. However, further investigation revealed the conflicting nature of the objectives and hence these were simultaneously optimized using the Non-dominated Sorting Genetic Algorithm (NSGA II). The results obtained from various optimization routines are compared and it is found that the results from the NSGA II provide a better tradeoff between the performance objectives. The motion trajectories from the optimal design of the VBSRM are later analyzed vis-à-vis human shoulder motions for its intended use as a robotic model of the human shoulder joint in various applications.

A comprehensive survey of space robotic manipulators for on-orbit servicing.

On-Orbit Servicing (OOS) robots are transforming space exploration by enabling vital maintenance and repair of spacecraft directly in space. However, achieving precise and safe manipulation in microgravity necessitates overcoming significant challenges. This survey delves into four crucial areas essential for successful OOS manipulation: object state estimation, motion planning, and feedback control. Techniques from traditional vision to advanced X-ray and neural network methods are explored for object state estimation. Strategies for fuel-optimized trajectories, docking maneuvers, and collision avoidance are examined in motion planning. The survey also explores control methods for various scenarios, including cooperative manipulation and handling uncertainties, in feedback control. Additionally, this survey examines how Machine learning techniques can further propel OOS robots towards more complex and delicate tasks in space.

PartwiseMPC: Interactive Control of Contact‐Guided Motions

AbstractPhysics‐based character motions remain difficult to create and control. We make two contributions towards simpler specification and faster generation of physics‐based control. First, we introduce a novel partwise model predictive control (MPC) method that exploits independent planning for body parts when this proves beneficial, while defaulting to whole‐body motion planning when that proves to be more effective. Second, we introduce a new approach to motion specification, based on specifying an ordered set of contact keyframes. These each specify a small number of pairwise contacts between the body and the environment, and serve as loose specifications of motion strategies. Unlike regular keyframes or traditional trajectory optimization constraints, they are heavily under‐constrained and have flexible timing. We demonstrate a range of challenging contact‐rich motions that can be generated online at interactive rates using this framework. We further show the generalization capabilities of the method.

Trajectory optimization and stability control for a novel unmanned intelligent wheel-legged vehicles on unstructured terrains

The trend of intelligent vehicles is currently expanding, and a new class of unmanned intelligent vehicles known as wheel-legged vehicles (WLVs) is emerging. WLVs excel in transportation on unstructured terrain by offering a unique combination of the efficiency of wheels on flat ground and the versatility of legs to tackle obstacles. To enhance the locomotion performance of WLVs on unstructured terrains, this paper presents a novel framework for improving their locomotion through nonlinear programming-based (NLP) trajectory optimization and stability control. The framework optimizes the vehicle’s body and wheel positioning while incorporating terrain information and employs a linear rigid body dynamic model for efficient motion planning. The stability control framework combines feedforward control using ground reaction forces with feedback control through joint PD control and utilizes model predictive control (MPC) to adjust the wheel slip ratio to prevent slip on steep slopes. Experimental validation on the real vehicle with torque-controlled wheels demonstrated the capability of driving over a 1 m height with a 30°slope at an average speed of 0.7 m/s and a maximum speed of 1.03 m/s. Our approach also enables the WLV to overcome obstacles, such as inclines, while dynamically negotiating these challenging terrains.