Physical Human-robot Interaction Research Articles

A rehabilitation robot control framework with adaptation of training tasks and robotic assistance.

Robot-assisted rehabilitation has exhibited great potential to enhance the motor function of physically and neurologically impaired patients. State-of-the-art control strategies usually allow the rehabilitation robot to track the training task trajectory along with the impaired limb, and the robotic motion can be regulated through physical human-robot interaction for comfortable support and appropriate assistance level. However, it is hardly possible, especially for patients with severe motor disabilities, to continuously exert force to guide the robot to complete the prescribed training task. Conversely, reduced task difficulty cannot facilitate stimulating patients' potential movement capabilities. Moreover, challenging more difficult tasks with minimal robotic assistance is usually ignored when subjects show improved performance. In this paper, a control framework is proposed to simultaneously adjust both the training task and robotic assistance according to the subjects' performance, which can be estimated from the users' electromyography signals. Concretely, a trajectory deformation algorithm is developed to generate smooth and compliant task motion while responding to pHRI. An assist-as-needed (ANN) controller along with a feedback gain modification algorithm is designed to promote patients' active participation according to individual performance variance on completing the training task. The proposed control framework is validated using a lower extremity rehabilitation robot through experiments. The experimental results demonstrate that the control scheme can optimize the robotic assistance to complete the subject-adaptation training task with high efficiency.

Design and Modeling of a Smart Torque-Adjustable Rotary Electroadhesive Clutch for Application in Human–Robot Interaction

The increasing need for sharing workspace and interactive physical tasks between robots and humans has raised concerns regarding the safety of such operations. In this regard, controllable clutches have shown great potential for addressing important safety concerns at the hardware level by separating the high-impedance actuator from the end-effector by providing the power transfer from electromagnetic source to the human. However, the existing clutches suffer from high power consumption and large weight, which make them undesirable from the design point of view. In this article, for the first time, the design and development of a novel, lightweight, and low-power torque-adjustable rotary clutch using electroadhesive materials are presented. The performance of three different pairs of clutch plates is investigated in the context of the smoothness and quality of output torque. The performance degradation issue due to the polarization of the insulator is addressed through the utilization of an alternating current waveform activation signal. Moreover, the effect of the activation frequency on the output torque and power consumption of the clutch is investigated. Finally, a time-dependent model for the output torque of the clutch is presented, and the performance of the clutch was evaluated through experiments, including physical human–robot interaction. The proposed clutch offers a torque-to-power consumption ratio that is six times better than commercial magnetic particle clutches. The proposed clutch presents great potential for developing safe, lightweight, and low-power physical human–robot interaction systems, such as exoskeletons and robotic walkers.

Physical Human–Robot Interaction Control of Variable Stiffness Exoskeleton With sEMG-Based Torque Estimation

Robotic exoskeleton assistance is an effective method for the treatment of patients with movement disorders. Firstly, this paper presents a variable stiffness knee exoskeleton robot (VS-KExo), which can independently control stiffness and position and has a large stiffness range under low preload. Then, combined with the designed variable stiffness exoskeleton, a physical human-robot interaction (pHRI) control scheme based on joint torque estimation is proposed. Different from previous studies, this method uses the mechanical properties of the exoskeleton to achieve pHRI without complex control algorithms and force/torque sensors. Furthermore, the joint torque is estimated based on the surface electromyography signal (sEMG) and the Hill-based muscle model, and the exoskeleton can realize assist-as-needed (AAN) function: 1) when the subject trains with less effort, the exoskeleton maintains a high output physical impedance to provide high tracking accuracy; and 2) when the subject trains with greater effort, the exoskeleton maintains a low output impedance to provide high physical compliance. Finally, we conducted experiments on three healthy subjects and two subjects with lower limb motor dysfunction to verify the effectiveness of the torque estimation method and the pHRI control scheme.

Follow the Force: Haptic Communication Enhances Coordination in Physical Human-Robot Interaction When Humans are Followers

Follow the Force: Haptic Communication Enhances Coordination in Physical Human-Robot Interaction When Humans are Followers

Visual-Impedance-Based Human–Robot Cotransportation With a Tethered Aerial Vehicle

Physical human-robot interaction (pHRI) in the field of aerial vehicles has received more research attention in recent years. In this work, a visual impedance control strategy for human-aerial robot cooperative transportation with a tethered vehicle is presented. Without a positioning system, the aerial vehicle is controlled to follow the human partner by using cable force and visual features of the object as feedback. Furthermore, being aware of human motion is important to improve efficiency and smoothness of the cooperation. Without measuring velocities of the aerial vehicle and the human, we propose to directly estimate relative velocity of them by a vision-based velocity observer. This estimated velocity is then integrated into a visual impedance scheme. The stability of the system is rigorously proved by Lyapunov analysis and passivity analysis. Indoor experiments where a human participant transports a long bar with a tethered aerial vehicle are conducted. Results of experiments under different human velocities and intentions demonstrate the effectiveness and reliability of the proposed method.

Interday Reliability of Upper-limb Geometric MyoPassivity Map for Physical Human-Robot Interaction.

The value of intrinsic energetic behavior of human biomechanics has recently been recognized and exploited in physical human-robot interaction (pHRI). The authors have recently proposed the concept of "Biomechanical Excess of Passivity," based on nonlinear control theory, to construct a user-specific energetic map. The map would assess the behavior of the upper-limb in absorbing the kinesthetic energy when interacting with robots. Integrating such knowledge into the design of pHRI stabilizers can reduce the conservatism of the control by unleashing hidden energy reservoirs indicating a less conservative margin of stability. The outcome would enhance the system's performance, such as rendering kinesthetic transparency of (tele)haptics systems. However, current methods require an offline data-driven identification procedure prior to each operation to estimate the energetic map of human biomechanics. This can be time-consuming and challenge users susceptible to fatigue. In this study, for the first time, we investigate the interday reliability of upper-limb passivity maps in a sample of five healthy subjects. Our statistical analyses indicate that the identified passivity map is highly reliable in estimating the expected energetic behavior based on Intraclass correlation coefficient analysis (conducted on different days and with various interactions). The results illustrate that a one-shot estimate is a reliable measure to be used repeatedly in biomechanics-aware pHRI stabilization, enhancing practicality in real-life scenarios.

A Robust Region Control Approach for Simultaneous Trajectory Tracking and Compliant Physical Human–Robot Interaction

A Robust Region Control Approach for Simultaneous Trajectory Tracking and Compliant Physical Human–Robot Interaction

Stiffness-Switchable Hydrostatic Transmission Toward Safe Physical Human–Robot Interaction

Stiffness-Switchable Hydrostatic Transmission Toward Safe Physical Human–Robot Interaction

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction

Humans can leverage physical interaction to teach robot arms. This physical interaction takes multiple forms depending on the task, the user, and what the robot has learned so far. State-of-the-art approaches focus on learning from a single modality, or combine some interaction types. Some methods do so by assuming that the robot has prior information about the features of the task and the reward structure. By contrast, in this paper we introduce an algorithmic formalism that unites learning from demonstrations, corrections, and preferences. Our approach makes no assumptions about the tasks the human wants to teach the robot; instead, we learn a reward model from scratch by comparing the human’s input to nearby alternatives, i.e., trajectories close to the human’s feedback. We first derive a loss function that trains an ensemble of reward models to match the human’s demonstrations, corrections, and preferences. The type and order of feedback is up to the human teacher: we enable the robot to collect this feedback passively or actively. We then apply constrained optimization to convert our learned reward into a desired robot trajectory. Through simulations and a user study we demonstrate that our proposed approach more accurately learns manipulation tasks from physical human interaction than existing baselines, particularly when the robot is faced with new or unexpected objectives. Videos of our user study are available at: https://youtu.be/FSUJsTYvEKU

Adaptive technique for physical human–robot interaction handling using proprioceptive sensors

The work focuses on the development of an adaptive technique for the physical interaction handling between a human and a robot, as well as its experimental validation. The proposed technique is based on the deep residual neural network and dedicated finite state machine, where the states are the robot behavior modes and transitions are the switchings between the states that depend on the interaction parameters and characteristics. It ensures the human operator safety and improves the human–robot collaboration performance by implementing various scenarios. In the scope of this technique, the parameters of human–robot interaction are used to select an appropriate robot reaction strategy using data from internal robot sensors only, i.e. proprioceptive sensors. These parameters define the interaction force vector and its application point on the robot surface, which allow to classify the interaction within the set of predefined categories. This classification distinguishes interactions applied at the tool or intermediate link (Tool/Link), having soft or hard nature (Soft/Hard), as well as having different intention (Intl/Accd) or duration (Short/Long). Based on identified category and the current robot state, the algorithm chooses an appropriate robot reaction. To confirm the efficiency the developed technique, an experimental study was conducted, which involved the collaboration between the real industrial manipulator KUKA LBR iiwa and the human operator.

Human Modeling in Physical Human-Robot Interaction: A Brief Survey

Human Modeling in Physical Human-Robot Interaction: A Brief Survey

Applied Exoskeleton Technology: A Comprehensive Review of Physical and Cognitive Human–Robot Interaction

Exoskeletons and orthoses are wearable mobile systems providing mechanical benefits to users. Despite significant improvements in the last decades, the technology is not fully mature to be adopted for strenuous and non-programmed tasks. To accommodate this insufficiency, different aspects of this technology need to be analysed and improved. Numerous studies have tried to address some aspects of exoskeletons, e.g. mechanism design, intent prediction, and control scheme. However, most works have focused on a specific element of design or application without providing a comprehensive review framework. This study aims to analyse and survey the contributing aspects to this technology’s improvement and broad adoption. To address this, after introducing assistive devices and exoskeletons, the main design criteria will be investigated from both physical Human-Robot Interaction (HRI) perspectives. In order to establish an intelligent HRI strategy and enable intuitive control for users, cognitive HRI will be investigated after a brief introduction to various approaches to their control strategies. The study will be further developed by outlining several examples of known assistive devices in different categories. And some guidelines for exoskeleton selection and possible mitigation of current limitations will be discussed.

Human Factors Considerations for Quantifiable Human States in Physical Human-Robot Interaction: A Literature Review.

As the global population rapidly ages with longer life expectancy and declining birth rates, the need for healthcare services and caregivers for older adults is increasing. Current research envisions addressing this shortage by introducing domestic service robots to assist with daily activities. The successful integration of robots as domestic service providers in our lives requires them to possess efficient manipulation capabilities, provide effective physical assistance, and have adaptive control frameworks that enable them to develop social understanding during human-robot interaction. In this context, human factors, especially quantifiable ones, represent a necessary component. The objective of this paper is to conduct an unbiased review encompassing the studies on human factors studied in research involving physical interactions and strong manipulation capabilities. We identified the prevalent human factors in physical human-robot interaction (pHRI), noted the factors typically addressed together, and determined the frequently utilized assessment approaches. Additionally, we gathered and categorized proposed quantification approaches based on the measurable data for each human factor. We also formed a map of the common contexts and applications addressed in pHRI for a comprehensive understanding and easier navigation of the field. We found out that most of the studies in direct pHRI (when there is direct physical contact) focus on social behaviors with belief being the most commonly addressed human factor type. Task collaboration is moderately investigated, while physical assistance is rarely studied. In contrast, indirect pHRI studies (when the physical contact is mediated via a third item) often involve industrial settings, with physical ergonomics being the most frequently investigated human factor. More research is needed on the human factors in direct and indirect physical assistance applications, including studies that combine physical social behaviors with physical assistance tasks. We also found that while the predominant approach in most studies involves the use of questionnaires as the main method of quantification, there is a recent trend that seeks to address the quantification approaches based on measurable data.

A Passivity-Based Framework for Safe Physical Human–Robot Interaction

In this paper, the problem of making a safe compliant contact between a human and an assistive robot is considered. Users with disabilities have a need to utilize their assistive robots for physical human–robot interaction (PHRI) during certain activities of daily living (ADLs). Specifically, we propose a hybrid force/velocity/attitude control for a PHRI system based on measurements from a six-axis force/torque sensor mounted on the robot wrist. While automatically aligning the end-effector surface with the unknown environmental (human) surface, a desired commanded force is applied in the normal direction while following desired velocity commands in the tangential directions. A Lyapunov-based stability analysis is provided to prove both the convergence as well as passivity of the interaction to ensure both performance and safety. Simulation as well as experimental results verify the performance and robustness of the proposed hybrid controller in the presence of dynamic uncertainties as well as safe physical human–robot interactions for a kinematically redundant robotic manipulator.

Human–Robot Attachment System for Exoskeletons: Design and Performance Analysis

Exoskeleton robots found application in neurorehabilitation, telemanipulation, and power augmentation. The human–robot attachment system of an exoskeleton should transmit all the interaction forces while keeping the anatomical and robotic joint axes aligned. Existing attachment concepts were bounding the performance of modern exoskeletons due to insufficient stiffness for high-performance force control, time-consuming adaption processes, and/or bulkiness. Therefore, we developed an augmented attachment system for a recent fully actuated nine-degree-of-freedom upper limb exoskeleton. The proposed system was compared to a conventional solution in a case study with four participants. The proposed attachment system lowered the relative motion between the human and the robot under static loads for all defined landmarks by 45% on average. The occurrence of undesired contacts in the trials was mitigated by 74%, thus improving conditions for closed-loop force control. Furthermore, the proposed system adapted better to the user's anatomy facilitating more accurate alignment and less obstruction. On average, self-attachment took <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\mathbf {43(8.3)}$</tex-math></inline-formula> <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\mathrm{s}$</tex-math></inline-formula> to don(doff). Thereby, the alignment of anatomic landmarks had typically less than 15 mm offset to a thorough expert alignment, making self-attachment eligible. The augmented attachment system and the insights gained by the case study are expected to enable improvement of the physical human–robot interaction of exoskeletons.

Aerial Physical Human Robot Interaction for Payload Transportation

Aerial Physical Human Robot Interaction for Payload Transportation

Validation of the Human Arm Stiffness Estimation Method Developed for Overground Physical Interaction Experiments.

To build a physically interactive robot for overground applications, it is crucial to first understand the biomechanics of humans underlying overground physical human-robot interaction (pHRI) tasks. Estimating human arm stiffness during overground interactive tasks is a promising first step toward this goal. For this, an arm stiffness estimation technique was developed in our previous works that consider the unique challenges involving overground pHRI, such as the need to estimate the arm stiffness from a short duration of data with fewer repetitions. In this work, our stiffness estimation method is further validated with a passive spring setup with known stiffness values, as well as with a human experiment setup that resembles the widely used seated reaching tasks. Results show that our method can estimate the passive spring stiffness within 0.5% of error. We also show that the human arm stiffness measured through our method is comparable to those reported in well-known literature. In addition, our method was able to discern experimental conditions such as early vs. late trials or differences in arm movement conditions. Implications of these results are discussed further.Clinical Relevance- This method can aid the design and development of overground interactive robots for human movement assistance and rehabilitation.

Collaborative robot dynamics with physical human–robot interaction and parameter identification with PINN

Collaborative robots are increasingly being used in dynamic and semi-structured environments because of their ability to perform physical Human–Robot Interaction (pHRI) to ensure safety. Therefore, it is crucial to model the dynamics of collaborative robots during pHRI to gain valuable insights into the system’s behavior when in contact with humans. In this work, a generic dynamic model is proposed for the quasi-static contact phase of pHRI, which considers the interaction dynamics and the complete structural dynamics of the collaborative robot. Moreover, a hybrid physics-informed neural network (PINN) is proposed, which utilizes a recurrent neural network (RNN) and the Runge–Kutta method to identify the joint dynamic parameters without complicated regressor construction. Experiments are conducted using a UR3e collaborative robot, and the PINN is trained using the acquired data. The results demonstrate the effectiveness of the PINN in identifying joint dynamics without prior knowledge, and the dynamic simulation of pHRI is consistent with the experimental results. The proposed model and PINN-based identification approach have the potential to improve safety and productivity in industrial environments by facilitating the control of pHRI.

RESEARCH ON HUMAN–ROBOT PHYSICAL INTERACTION CONTROL BASED ON ADAPTIVE IMPEDANCE CONTROL

An adaptive impedance control method based on dexterity for compliant interaction is proposed for the problem of compliance and motion performance of the human’s healthy side interacting with the manipulator in bilateral mirror rehabilitation motion-assisted training, and constructs a local virtual force field to hinder the movement of the manipulator to the low motion performance region, thus improving the motion performance of the manipulator. Firstly, the dynamic model of the manipulator and the human–robot interaction model based on impedance control are established. Then, a dexterity index based on the condition number is established, and an adaptive impedance control method based on the dexterity is proposed to construct a local virtual force field to hinder the movement of the manipulator to the low motion performance region. Finally, the effectiveness of the proposed method is demonstrated by experiments. The results have shown that the adaptive impedance control method based on dexterity can construct a local virtual force field, which can constrain the motion of the manipulator and keep the robot with good motion performance. It also laid the foundation for the training strategy of bilateral mirror rehabilitation.

Deep Imitation Learning of Nonlinear Model Predictive Control Laws for a Safe Physical Human–Robot Interaction

This paper proposes motion planning algorithms for industrial manipulators in the presence of human operators based on deep neural networks (DNNs), aimed at imitating the behavior of a nonlinear model predictive control (NMPC) scheme. The proposed DNN solutions retain the safety features of NMPC in terms of speed and separation monitoring, defined according to the guidelines in the ISO/TS 15066 standard. At the same time, they improve the robot performance in terms of task completion time, and of a-posteriori evaluation of the NMPC cost function on experimental data. The reasons for this improvement are the reduced computational delay of running a DNN compared to solving the nonlinear programs associated to NMPC, and the ability to implicitly learn how to predict the human operator's motion from the training set.