Proprioceptive Sensors Research Articles

Instrumented bio-inspired cable-driven compliant continuum robot: static modeling and experimental evaluation

Abstract Energy efficiency is inherent for autonomous robotic device. Snakes are well known for their ability to low energy consumption when swimming. However, the swimming know-how is poorly understood. Designing a snake robot inspired by snakes as a tool to find out the swimming energy efficiency crucial point will lead to the development of hyper efficient undulating locomotors. In this article, we introduce a four tendons driven continuum robot made of bio-inspired compliant vertebrae to assess the energy consumption of a planar and a spatial snake motion. The tendon-driven continuum robot constitutes the head–neck part of a locomotor snake robot. A static modeling coupled with an optimization method was implemented to generate bio-inspired motions recorded on snake swimming head. A friction model describing the friction between cables and the disks is investigated and compared to a frictionless model. The proposed prototype is equipped with exteroceptive sensors to record motion and proprioceptive sensors to measure cable forces applied at the tip of the robot. Hence, the work of the forces, thus the energy required to execute a trajectory are computed and analyzed. The energy is introduced as a key criterion to assess the swimming motion of a locomotor snake robot.

3D Bioprinting Techniques and Bioinks for Periodontal Tissues Regeneration-A Literature Review.

The periodontal tissue is made up of supporting tissues and among its functions, it promotes viscoelastic properties, proprioceptive sensors, and dental anchorage. Its progressive destruction by disease leads to the loss of bone and periodontal ligaments. For this reason, biomaterials are constantly being developed to restore tissue function. Various techniques are being used to promote regenerative dentistry, including 3D bioprinting with bioink formulations. This paper aims to review the different types of bioink formulations and 3D bioprinting techniques used in periodontal tissue regeneration. Different techniques have been formulated, and the addition of different materials into bioinks has been conducted, with the intention of improving the process and creating a bioink that supports cell viability, proliferation, differentiation, and stability for periodontal tissue regeneration.

SYNLOCO‐VE: Synthesizing central pattern generator with reinforcement learning and velocity estimator for quadruped locomotion

AbstractIt is a challenging task to learn a robust and natural locomotion controller for quadruped robots at different terrains and velocities. In particular, the locomotion learning task will be even more difficult for the case with no exteroceptive sensors. In this article, the learning‐based locomotion control is, therefore, investigated for quadruped robots only using proprioceptive sensors. A new framework called SYNLOCO‐VE is proposed by synthesizing a feedforward gait planner, a trunk velocity estimator, and reinforcement learning (RL). The feedforward gait planner is developed based on the well‐known central pattern generator, but it can change the foot length for improved velocity tracking performance. The trunk velocity estimator is designed based on deep learning, which estimates the trunk velocity using historical data from proprioceptive sensors. The introduction of the trunk velocity estimator can mitigate the influence of the partial observation issue due to the lack of exteroceptive sensors. RL is employed to learn a feedback controller to regulate the robot gaits using feedback from proprioceptive sensors and the trunk velocity estimation. In the proposed framework, the feedforward gait planner can also guide the training process of RL, thus resulting in more stable and faster policy learning. Ablation studies are provided to demonstrate the efficiency of different modules in the proposed design. Extensive experiments are performed using a quadruped robot Go1, which only has proprioceptive sensors. The proposed framework is able to learn robust and stable locomotion at different terrains and tasks. Experimental comparisons are also conducted to illustrate the advantages of the proposed design over the state‐of‐the‐art methods.

ABDALAMEER. DEVELOPMENT OF AUTONOMOUS MOBILE ROBOTS CONTROL SYSTEMS

The development of an efficient control system for mobile autonomous robots is explored. It delineates key stages in this process, starting with the necessity of precise trajectory planning followed by the creation of a mathematical model for controlling the robotic device. Subsequently, the implementation of navigation algorithms in the management system is emphasized. The importance of conducting comprehensive error analysis to address discrepancies during robot movement is underscored. Post the primary phase of control system creation, evaluating the cost-effectiveness and ensuring workplace safety are deemed crucial management steps. Localization emerges as a pivotal factor enabling the robot's effective autonomous movement relative to its target position. This, in turn, aids in orienting the robot within its external environment. Spatial information acquisition is underscored through the significance of traffic planning, cartography and specialized robotics sensors. Furthermore, the article delves into proprioceptive sensors, detailing their components, such as optical and electrical conductor sensors operating via the Hall effect discovered in 1879. It provides a formula to accurately ascertain conductivity state, involving parameters like hole and electron concentration, electron and hole mobility and elementary charge. In essence, the control system parallels the human brain, requiring a recognition system, action planning and execution functions. Navigation is identified as a critical element facilitating the robot's movement in three-dimensional space. The article integrates technical intricacies about proprioceptive sensors, highlighting their pivotal role within robot control systems.

Proprioception and Control of a Soft Pneumatic Actuator Made of a Self-Healable Hydrogel.

The current evolutionary trends in soft robotics try to exploit the capacities of smart materials to achieve compact robotics designs with embodied intelligence. In this way, the number of elements that compose the soft robot can be reduced, as the smart material can cover different aspects (e.g., structure and sensorization) all in one. This work follows this tendency and presents a custom-designed hydrogel that exhibits two smart features, self-healing and ionic conductivity, used to build a pneumatic actuator. The self-healing capability provides the actuator's structure with the ability to self-repair from damages (e.g., punctures or cuts), an important quality to prolong the life cycle of the actuator. The ionic conductivity enables the actuator's proprioception: the structure itself serves as a curvature sensor. The behavior of this proprioceptive curvature sensor is analyzed in this work, studying its linearity, stability, and performance after a self-healing process. This sensor is also proposed as feedback in a closed-loop scheme to automatically control the actuator's curvature. A proportional-integral-derivative controller is designed based on an empirical model of the actuator's dynamics, and then validated in experimental tests, proving the proprioceptive sensor as proper feedback. These control tests are performed over undamaged and self-healed actuators, thus demonstrating all the capabilities of our soft material.

Sequential track fusion in multi-sensor networks of unscented Kalman filters: A case of slip estimation in planetary mobile robots

Accurate wheel slip estimation facilitates Wheeled Mobile Robots (WMRs) with improved localization and traversability monitoring which are crucial to their autonomy in challenging planetary environments. Although distributed track-level fusion offers better computational efficiency, often sensor-level fusion is adopted in slip estimators of planetary rovers. Extending upon our earlier work, we develop a novel explicit track-to-track fusion algorithm for multi-sensor networks of unscented Kalman filters that has immediate application to slip ratio estimation in WMRs. The algorithm demonstrates better consistency compared to the existing fusion techniques since it implements a sub-optimal fusion rule to sequentially combine local tracks. It also saves computational power due to the recursive propagation of cross-covariance matrices based on the statistical linearization technique, instead of performing online optimizations. We prove that this recursion only requires the information of the first and last tracks in a sequence if all local tracks are unbiased. We rigorously study various key properties of the developed fusion algorithm and show its superior level of confidence when compared to the two prominent fusion methods of sequential and batch covariance intersection. The slip ratio estimation in a six-wheel WMR is considered as a case study, where the steerable wheel sets act as a network of sensors. The proposed slip estimator works based on the rigid body kinematics and readings of purely proprioceptive sensors, i.e., an inertial measurement unit and encoders. The slip estimator’s performance is evaluated in a high-fidelity software-in-the-loop simulation environment connecting MATLAB and CM Lab’s Vortex Studio software. In a comparison study that considers four rival strategies, we show the superiority of the proposed fusion method offering a balance between consistency, accuracy, and speed in real-time slip estimations.

Estimation of the height profile of the path for autonomous driving in terrain

A priori knowledge about the height profile of the path is vital for rollover avoidance in the context of autonomous driving through uneven forest ground. The forest ground is usually covered with either soft vegetation in summertime, or by snow in winter. Thus, the exact solid form of the forest ground cannot be detected by camera or LiDAR. This article, we propose height-odometry and aided height-odometry methods for ground height estimation. The height-odometry method depends solely on interoceptive and proprioceptive sensor data, while the aided height-odometry combines height-odometry output with the existing 3D map information. Thus, the central idea is to build a reference 3D path for autonomous forest machines where the spatial positioning – based on the RTK-GNSS or Forest SLAM method – is fused with the output of (aided) height-odometry method(s). We evaluate the proposed height-odometry methods in two separate environments that are accurately (3D) mapped by a UAV using the advanced machine-vision-based SfM method and the LiDAR-based SLAM algorithms. Through comprehensive data analysis, we demonstrate that the proposed 3D path estimation methods are practical and simple to implement, yet sufficient to estimate the height profile of the path with desired accuracy.

Inherently integrated microfiber-based flexible proprioceptive sensor for feedback-controlled soft actuators

For the accurate and continuous control of soft actuators in dynamic environments, the movements of the soft actuators must be monitored in real-time. To this end, various soft actuators capable of self-monitoring have been developed by separately integrating sensing devices into actuators. However, integrating such heterogeneous sensing components into soft actuators results in structural complexity, high manufacturing costs, and poor interfacial stability. Here, we report on intelligent pneumatic fiber-reinforced soft actuators with an inherent flexible proprioceptive sensor that uses only the essential components of typical fiber-reinforced soft actuators. The inherent flexible proprioceptive sensor is achieved by leveraging two parallel conductive microfibers around an elastomeric chamber of the soft actuator, which simultaneously acts as both a capacitive bending sensor and radial expansion limiting fibers of typical fiber-reinforced soft actuators. The proprioceptive soft actuator exhibits excellent mechanical actuation up to 240° bending motion and proprioceptive sensing performance with high sensitivity of 1.2 pF rad−1. Mathematical analysis and simulations of the soft actuator can effectively predict the bending actuation and capacitive responses against input pressures. We demonstrate that proprioceptive soft actuators can be used to construct a soft gripping system and prosthetic hand which express various hand gestures and perform dexterous manipulation with real-time proprioceptive sensing capability.

Whole-Body Intuitive Physical Human-Robot Interaction With Flexible Robots Using Non-Collocated Proprioceptive Sensing

Whole-Body Intuitive Physical Human-Robot Interaction With Flexible Robots Using Non-Collocated Proprioceptive Sensing

A mechanism for tuning proprioception proposed by research in Drosophila and mammals

Proprioception provides important sensory feedback regarding the position of an animal’s body and limbs in space. This interacts with a central pattern generator responsible for rhythmic movement, to adapt locomotion to the demands that an animal’s environment places on it. The mechanisms by which this feedback is enabled are poorly understood, which belies its importance: dysfunctional proprioception is associated with movement disorder and improving it can help reduce the severity of symptoms. Similarly, proprioception is important for guiding accurate robotic movement and for understanding how sensory systems capture and process information to guide action selection. It is therefore important to interpret research that investigates mechanisms of proprioception, to ask: what type of information do proprioceptive sensors capture, and how do they capture it? Work in mammalian models has made important progress towards answering this question. So too, has research conducted Drosophila. Fruit fly proprioceptors are more accessible than mammalian equivalents and can be manipulated using a unique genetic toolkit, so experiments conducted in the invertebrate can make a significant contribution to overall understanding. It can be difficult, however, to relate work conducted in different models, to draw general conclusions about proprioception. This review, therefore, explores what research in the fruit fly has revealed about proprioceptor function, to highlight its potential translation to mammals. Specifically, the present text presents evidence that differential expression of mechanoelectrical transducers contributes to tuning of fly proprioceptors and suggests that the same mechanism may play a role in tuning mammalian proprioceptors.

Relationship between Car-Sickness Susceptibility and Postural Activity: Could the Re-Weighting Strategy between Signals from Different Body Sensors Be an Underlying Factor?

Postural control characteristics have been proposed as a predictor of Motion Sickness (MS). However, postural adaptation to sensory environment changes may also be critical for MS susceptibility. In order to address this issue, a postural paradigm was used where accurate orientation information from body sensors could be lost and restored, allowing us to infer sensory re-weighting dynamics from postural oscillation spectra in relation to car-sickness susceptibility. Seventy-one participants were standing on a platform (eyes closed) alternating from static phases (proprioceptive and vestibular sensors providing reliable orientation cues) to sway referenced to the ankle-angle phases (proprioceptive sensors providing unreliable orientation cues). The power spectrum density (PSD) on a 10 s sliding window was computed from the antero-posterior displacement of the center of pressure. Energy ratios (ERs) between the high (0.7-1.3 Hz) and low (0.1-0.7 Hz) frequency bands of these PSDs were computed on key time windows. Results showed no difference between MS and non-MS participants following loss of relevant ankle proprioception. However, the reintroduction of reliable ankle signals led, for the non-MS participants, to an increase of the ER originating from a previously up-weighted vestibular information during the sway-referenced situation. This suggests inter-individual differences in re-weighting dynamics in relation to car-sickness susceptibility.

Advancing robust state estimation of wheeled robots in degenerate environments: harnessing ground manifold and motion states

State estimation is crucial for enabling autonomous mobility in mobile robots. However, traditional localization methods often falter in degraded environments, including issues like visual occlusion, lidar performance degradation, and global navigation satellite system signal interference. This paper presents a novel estimation approach for wheeled robots, exclusively utilizing proprioceptive sensors such as encoders and inertial measurement units (IMU). Initially, the motion manifolds extracted from the historical trajectories are used to assist the encoder in realizing the orientation estimation. Furthermore, a hybrid neural network is designed to categorize the robot’s operational state, and the corresponding pseudo-constraints are added to improve the estimation accuracy. We utilize an error state Kalman filter for the encoder and IMU data fusion. Lastly, comprehensive testing is conducted using both datasets and real-world robotic platforms. The findings underscore that the integration of manifold and motion constraints within our proposed state estimator substantially elevates accuracy compared to conventional approaches. Compare with the methods commonly used in engineering, the accuracy of this method is improved by more than 20%. Crucially, this methodology enables dependable estimation even in degraded environments.

TossNet: Learning to Accurately Measure and Predict Robot Throwing of Arbitrary Objects In Real Time With Proprioceptive Sensing

TossNet: Learning to Accurately Measure and Predict Robot Throwing of Arbitrary Objects In Real Time With Proprioceptive Sensing

Noncollocated Proprioceptive Sensing for Lightweight Flexible Robotic Manipulators

This article presents the design of a noncollocated feedback system for flexible serial manipulators. The device is a passive serial chain of encoders and lightweight links, mounted in parallel with the manipulator. This measuring arm effectively decouples the manipulator's proprioception from its actuators by providing information on the actual end effector pose, accounting for both joint and link flexibility. The kinematic redundancy of the measuring chain allows for safe operation in the context of human–robot interaction. A simple yet effective error model is introduced to assess the suitability of the proposed sensor system in the context of robotic control. The practicality of the device is first demonstrated by building a physical joint-encoder assembly and a simplified planar measuring arm prototype. With this additional feedback, a task-space position controller is devised and tested in simulation. Finally, the simulation results are validated with an experimental 3-DoF lightweight manipulator prototype equipped with a five-joint measuring arm.

In situ skid estimation for mobile robots in outdoor environments

AbstractSkidding is a surface hazard for mobile robots' navigation and traction control systems when operating in outdoor environments and uneven terrains due to the wheel–terrain interaction. It could lead to large trajectory tracking errors, losing the robot's controllability, and mission failure occurring. Despite research in this field, the development of a real‐world feasible in situ skid estimation system with the capability of operating in harsh and unforeseen environments using low‐cost/power and ease of integrating sensors is still an open problem in terramechanics. This paper presents a novel velocity‐based definition for skidding that enables a real‐world feasible estimation for the mobile robot's undesired skidding at the vehicle‐level in outdoor environments. The proposed technique estimates the undesired skidding using a combination of two proprioceptive sensors (e.g., inertial measurement unit and wheel encoder) and deep learning. The practicality of a velocity‐based definition and the performance of the proposed undesired skid estimation technique are evaluated experimentally in various outdoor terrains. The results show that the proposed technique performs with less than 11.79 mm/s mean absolute error and estimates the direction of undesired skidding with approximately 98% accuracy.

Adaptive technique for physical human–robot interaction handling using proprioceptive sensors

The work focuses on the development of an adaptive technique for the physical interaction handling between a human and a robot, as well as its experimental validation. The proposed technique is based on the deep residual neural network and dedicated finite state machine, where the states are the robot behavior modes and transitions are the switchings between the states that depend on the interaction parameters and characteristics. It ensures the human operator safety and improves the human–robot collaboration performance by implementing various scenarios. In the scope of this technique, the parameters of human–robot interaction are used to select an appropriate robot reaction strategy using data from internal robot sensors only, i.e. proprioceptive sensors. These parameters define the interaction force vector and its application point on the robot surface, which allow to classify the interaction within the set of predefined categories. This classification distinguishes interactions applied at the tool or intermediate link (Tool/Link), having soft or hard nature (Soft/Hard), as well as having different intention (Intl/Accd) or duration (Short/Long). Based on identified category and the current robot state, the algorithm chooses an appropriate robot reaction. To confirm the efficiency the developed technique, an experimental study was conducted, which involved the collaboration between the real industrial manipulator KUKA LBR iiwa and the human operator.

Actuator-level motion and contact episode learning and classification using adaptive resonance theory

Several methods exist to detect and distinguish collisions of robotic systems with their environment, since this information is a critical dependency of many tasks. These methods are prevalently based on thresholds in combination with filters, models, or offline trained machine learning models. To improve the adaptation and thereby enable a more autonomous operation of robots in new environments, this work evaluates the applicability of an incremental learning approach. The method addresses online learning and recognition of motion and contact episodes of robotic systems from proprioceptive sensor data using machine learning. The objective is to learn new category templates representing previously encountered situations of the actuators and improve them based on newly gathered similar data. This is achieved using an artificial neural network based on adaptive resonance theory (ART). The input samples from the robot’s actuator measurements are preprocessed into frequency spectra. This enables the ART neural network to learn incrementally recurring episodic patterns from these preprocessed data. An evaluation based on preliminary experimental data from a grasping motion of a humanoid robot’s arm encountering contacts is presented and suggests that this is a promising approach.

Towards neuromorphic FPGA-based infrastructures for a robotic arm

Muscles are stretched with bursts of spikes that come from motor neurons connected to the cerebellum through the spinal cord. Then, alpha motor neurons directly innervate the muscles to complete the motor command coming from upper biological structures. Nevertheless, classical robotic systems usually require complex computational capabilities and relative high-power consumption to process their control algorithm, which requires information from the robot’s proprioceptive sensors. The way in which the information is encoded and transmitted is an important difference between biological systems and robotic machines. Neuromorphic engineering mimics these behaviors found in biology into engineering solutions to produce more efficient systems and for a better understanding of neural systems. This paper presents the application of a Spike-based Proportional-Integral-Derivative controller to a 6-DoF Scorbot ER-VII robotic arm, feeding the motors with Pulse-Frequency-Modulation instead of Pulse-Width-Modulation, mimicking the way in which motor neurons act over muscles. The presented frameworks allow the robot to be commanded and monitored locally or remotely from both a Python software running on a computer or from a spike-based neuromorphic hardware. Multi-FPGA and single-PSoC solutions are compared. These frameworks are intended for experimental use of the neuromorphic community as a testbed platform and for dataset recording for machine learning purposes.

Gait Event Detection with Proprioceptive Force Sensing in a Powered Knee-Ankle Prosthesis: Validation over Walking Speeds and Slopes.

Many powered prosthetic devices use load cells to detect ground interaction forces and gait events. These sensors introduce additional weight and cost in the device. Recent proprioceptive actuators enable an algebraic relationship between actuator torques and ground contact forces. This paper presents a proprioceptive force sensing paradigm which estimates ground reaction forces as a solution to detect gait events without a load cell. A floating body dynamic model is obtained with constraints at the center of pressure representing foot-ground interaction. Constraint forces are derived to estimate ground reaction forces and subsequently timing of gait events. A treadmill experiment is conducted with a powered knee-ankle prosthesis used by an able-bodied subject walking at various speeds and slopes. Results show accurate gait event timing, with pooled data showing heel strike detection lagging by only 6.7 ± 7.2 ms and toe off detection leading by 30.4 ± 11.0 ms compared to values obtained from the load cell. These results establish proof of concept for predicting gait events without a load cell in powered prostheses with proprioceptive actuators.

Joint estimation of position and attitude for intelligent vehicles by fusing delayed visual measurements

Accurate position and attitude information is an important basis for normal driving of intelligent vehicles. In this paper, we investigate the estimation of position and attitude states for intelligent vehicles with low cost scheme. The low cost GNSS, camera, and proprioceptive sensors equipped by mass-produced vehicle are fused to estimate the states. The visual measurements adopted in this paper are based on the lateral distance and deflection angle to road features such as lane lines or curbs, which are generated more frequently than some other semantic features such as traffic lights, and leads to broader application scenario. Moreover, it is easier to implement compared with geometrical feature matching methods, since it only needs a simple prior map while latter needs large maps containing many high precision features. The visual measurements is often with large time delay due to negligible processing time. In order to fuse delayed measurements, a state-augmentation technique is adopted for the estimator design. The performance of the proposed method is evaluated by professional simulation software CarMaker, and shows that the incorporation of road features based visual measurement can effectively improve the position and attitude estimation accuracy by reducing the lateral position and yaw angle estimation error.