Adaptive Shared Control Research Articles

Shared Driving Assistance Design Considering Human Error Protection for Intelligent Electric Wheelchairs

To effectively provide the handicapped with mobility aids, studies on the shared autonomy of robotic systems have been widely cultivated. This study proposes an adaptive shared control strategy to realize reliable and safe driving assistance on an intelligent electric wheelchair with protection against human errors. The theoretical framework of the system is analyzed by the linearized reference wheelchair model and stable characteristics of obstacle avoidance behavior can be subsequently derived according to the Lyapunov analysis and Liénard-Chipart criterion. Based on the convex analysis, the relationships between human input and robot control are investigated to determine shared control weights. As such, safety and reliability can be guaranteed. To verify the performances of the proposed approach, human errors including skill-based errors, decision errors, and violations are considered in the experiments. The experimental results based on a comprehensive study show that the proposed method is capable of enhancing driving safety and reducing operation burden in terms of the designed criteria with fluency, smoothness, and time efficiency while protecting the user from human manual errors.

Passive arbitration in adaptive shared control of robots with variable force and stiffness scaling

In mixed-initiative shared control, the final control command to the robot is a weighted sum of the commands from two or more agents (human operators or automatic control systems). In force controlled robots, scaling of forces without power-consistent scaling of velocities leads to loss of passivity of the overall system. In this work, we first pose the problem statement related to position drift, while using a state-of-the-art, passivity ensuring method for scaling of forces. We then formulate adaptive mixed-initiative shared control as an adaptive stiffness control approach. We ensure passivity of the adaptive stiffness controller with a novel, model-independent method. The salient features, benefits and limitations of the approach are emphasized through analyses, simulations and hardware experiments. The proposed approach is finally validated with a practical shared control task.

A human activity-aware shared control solution for medical human–robot interaction

PurposeThe purpose of this paper is to develop a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation. Hands-on control and teleoperation are two main procedures switched frequently in teleoperated minimally invasive surgery (MIS). The detailed human activity in the procedures can be defined and recognized using the sensor information. In this paper, a novel continuous adaptive shared control method is proposed for manipulators with Cartesian impedance control in the surgical scenario.Design/methodology/approachA human activity-aware shared control solution by adjusting the weight function is introduced to achieve smooth transition among different human activities, including hands-on control and teleoperation. Instead of introducing various controllers and switching among them during the surgical procedures, the proposed solution integrated all the human activity-based controllers into a single controller and the transition among the procedures is smooth and stable. The effectiveness of the proposed control approach was verified in a lab setup environment. The results prove that the robot behavior is stable and smooth. The algorithm is feasible and can achieve a human activity-aware adaptive shared control solution for human–robot interaction in surgical operation.FindingsBased on the experiment, the results confirm that the proposed human activity-aware adaptive shared control solution can switch the device behavior automatically using the real-time sensor information. The transition between different activities is smooth and stable.Practical implicationsFor teleoperated surgical applications, the proposed method integrated different controllers for various human activities into a single controller by recognizing the activities using the real-time sensor information and the transition between different procedures is smooth and stable. It eases the surgical work for the surgeon and enhances the safety during the transition of control modes. The presented scheme provides a general solution to address the switching of working procedures in teleoperated MIS.Originality/valueTo the best of the authors’ knowledge, this paper is the first to propose human activity-aware adaptive shared control solution for human–robot interaction in surgical operations.

Mutually Adaptive Shared Control between Human Operator and Autonomy in Ground Vehicles

Mutually Adaptive Shared Control between Human Operator and Autonomy in Ground Vehicles

Effect of Fixed and sEMG-Based Adaptive Shared Steering Control on Distracted Driver Behavior.

Driver distraction is a well-known cause for traffic collisions worldwide. Studies have indicated that shared steering control, which actively provides haptic guidance torque on the steering wheel, effectively improves the performance of distracted drivers. Recently, adaptive shared steering control based on the forearm muscle activity of the driver has been developed, although its effect on distracted driver behavior remains unclear. To this end, a high-fidelity driving simulator experiment was conducted involving 18 participants performing double lane change tasks. The experimental conditions comprised two driver states: attentive and distracted. Under each condition, evaluations were performed on three types of haptic guidance: none (manual), fixed authority, and adaptive authority based on feedback from the forearm surface electromyography of the driver. Evaluation results indicated that, for both attentive and distracted drivers, haptic guidance with adaptive authority yielded lower driver workload and reduced lane departure risk than manual driving and fixed authority. Moreover, there was a tendency for distracted drivers to reduce grip strength on the steering wheel to follow the haptic guidance with fixed authority, resulting in a relatively shorter double lane change duration.

Human–Machine Adaptive Shared Control for Safe Driving Under Automation Degradation

In this article, a human–machine adaptive shared control method is proposed for automated vehicles (AVs) under automation performance degradation. First, a novel risk assessment module is proposed to monitor driving behavior and evaluate automation performance degradation for AVs. Then, an adaptive control authority allocation module is developed. In the event of any performance degradation, the control authority allocated to the automation system is decreased based on the assessed risk. Consequently, the control authority allocated to a human driver is adaptively increased and thus requires more driver engagement in the control loop to compensate for the automation degradation and ensure the vehicle’s safety. Experimental validation is conducted under different driving scenarios. The test results show that the approach can effectively compensate for vehicle automation performance degradation through human–machine adaptive shared control, ensuring the safety of automated driving.

Adaptive Driver-Automation Shared Steering Control via Forearm Surface Electromyography Measurement

Shared steering control has been developed to reduce driver workload while keeping the driver in the control loop. A driver could integrate visual sensory information from the road ahead and haptic sensory information from the steering wheel to achieve better driving performance. Previous studies suggest that, compared with adaptive automation authority, fixed automation authority is not always appropriate with respect to human factors. This paper focuses on designing an adaptive shared steering control system via sEMG (surface electromyography) measurement from the forearm of the driver, and evaluates the effect of the system on driver behavior during a double lane change task. The shared steering control was achieved through a haptic guidance system which provided active assistance torque on the steering wheel. Ten subjects participated in a high-fidelity driving simulator experiment. Two types of adaptive algorithms were investigated: haptic guidance decreases when driver grip strength increases (HG-Decrease), and haptic guidance increases when driver grip strength increases (HG-Increase). These two algorithms were compared to manual driving and two levels of fixed authority haptic guidance, for a total of five experimental conditions. Evaluation of the driving systems was based on two sets of dependent variables: objective measures of driver behavior and subjective measures of driver workload. The results indicate that the adaptive authority of HG-Decrease yielded lower driver workload and reduced the lane departure risk compared to manual driving and fixed authority haptic guidance.

Adaptive shared control strategy for lane changing assistance system via multi-mode switching

To address the lateral control issue between the automatic controller and the driver for lane changing assistance system, we present a novel multi-mode adaptive shared control strategy in optimal control framework. Different from traditional approaches that achieve shared control through adjusting control authority allocation, we aim at designing a human-friendly adaptive shared control scheme which can provide the driver with assistance in accordance with driving demands via multi-mode switching. Three control modes are proposed: 1. minimum-lateral error mode; 2. minimum-lateral acceleration mode; 3. minimum-interference mode. Meanwhile, we develop a hybrid model based on hidden markov model (HMM) and support vector machine (SVM) to recognize the optimum control mode. Mathematically, the shared control scheme is described as an optimal control problem, which is then addressed by using the improved Radau pseudospectral method (RPM). Numerical analysis and the driver-in-the-loop (DIL) tests show that the proposed shared control strategy has the advantage of ensuring driving safety while reducing driver’s workload.

Proprioceptive Estimation of Forces Using Underactuated Fingers for Robot-Initiated pHRI.

In physical Human–Robot Interaction (pHRI), forces exerted by humans need to be estimated to accommodate robot commands to human constraints, preferences, and needs. This paper presents a method for the estimation of the interaction forces between a human and a robot using a gripper with proprioceptive sensing. Specifically, we measure forces exerted by a human limb grabbed by an underactuated gripper in a frontal plane using only the gripper’s own sensors. This is achieved via a regression method, trained with experimental data from the values of the phalanx angles and actuator signals. The proposed method is intended for adaptive shared control in limb manipulation. Although adding force sensors provides better performance, the results obtained are accurate enough for this application. This approach requires no additional hardware: it relies uniquely on the gripper motor feedback—current, position and torque—and joint angles. Also, it is computationally cheap, so processing times are low enough to allow continuous human-adapted pHRI for shared control.

Long-Term Stable Control of Motor-Imagery BCI by a Locked-In User Through Adaptive Assistance

Performance variation is one of the main challenges that BCIs are confronted with, when being used over extended periods of time. Shared control techniques could partially cope with such a problem. In this paper, we propose a taxonomy of shared control approaches used for BCIs and we review some of the recent studies at the light of these approaches. We posit that the level of assistance provided to the BCI user should be adjusted in real time in order to enhance BCI reliability over time. This approach has not been extensively studied in the recent literature on BCIs. In addition, we investigate the effectiveness of providing online adaptive assistance in a motor-imagery BCI for a tetraplegic end-user with an incomplete locked-in syndrome in a longitudinal study lasting 11 months. First, we report a reliable estimation of the BCI performance (in terms of command delivery time) using only a window of 1 s in the beginning of trials (AUC ≈ 0.8 ). Second, we demonstrate how adaptive shared control can exploit the output of the performance estimator to adjust online the level of assistance in a BCI game by regulating its speed. In particular, online adaptive assistance was superior to a fixed condition in terms of success rate ( ). Remarkably, the results exhibited a stable performance over severalmonths without recalibration of the BCI classifier or the performance estimator.

An Integrated Decision Making Approach for Adaptive Shared Control of Mobility Assistance Robots

Mobility assistance robots provide support to elderly or patients during walking. The design of a safe and intuitive assistance behavior is one of the major challenges in this context. We present an integrated approach for the context-specific, on-line adaptation of the assistance level of a rollator-type mobility assistance robot by gain-scheduling of low-level robot control parameters. A human-inspired decision-making model, the drift-diffusion Model, is introduced as the key principle to gain-schedule parameters and with this to adapt the provided robot assistance in order to achieve a human-like assistive behavior. The mobility assistance robot is designed to provide (a) cognitive assistance to help the user following a desired path towards a predefined destination as well as (b) sensorial assistance to avoid collisions with obstacles while allowing for an intentional approach of them. Further, the robot observes the user long-term performance and fatigue to adapt the overall level of (c) physical assistance provided. For each type of assistance a decision-making problem is formulated that affects different low-level control parameters. The effectiveness of the proposed approach is demonstrated in technical validation experiments. Moreover, the proposed approach is evaluated in a user study with 35 elderly persons. Obtained results indicate that the proposed gain-scheduling technique incorporating ideas of human decision-making models shows a general high potential for the application in adaptive shared control of mobility assistance robots.

Distributed and Adaptive Shared Control Systems: Methodology for the Replication of Experiments

Much work in robotics aimed at real-world applications falls in the large segment between teleoperated and fully autonomous systems. Such systems are characterized by the close coupling between the human operator and the robot, in principle, allowing the agents to share their particular sensing, adaptation, and decision-making capabilities. Replicable experiments can advance the state of the art of such systems but pose practical and epistemological challenges. For example, the trajectory of the system is governed by the adaptation both in the human and the robot agent. What do we need besides (or instead of) data sets for such a system? The degree of similarity between comparable experiments and the exact meaning of replication need to be clarified. Here, we explore replication of a distributed and adaptive shared control for an assistive robot manipulator. We attempt a methodological approach for reporting two virtual human experiments on the system: modeling the complete human-robot binomial, deriving closedloop performance metrics from the models, and openly publishing the results and experiment implementations.

Design and Evaluation of the Kinect-Wheelchair Interface Controlled (KWIC) Smart Wheelchair for Pediatric Powered Mobility Training

Background: Children with severe disabilities are sometimes unable to access powered mobility training. Thus, we developed the Kinect-Wheelchair Interface Controlled (KWIC) smart wheelchair trainer that converts a manual wheelchair into a powered wheelchair. The KWIC Trainer uses computer vision to create a virtual tether with adaptive shared-control between the wheelchair and a therapist during training. It also includes a mixed-reality video game system. Methods: We performed a year-long usability study of the KWIC Trainer at a local clinic, soliciting qualitative and quantitative feedback on the device after extended use. Results: Eight therapists used the KWIC Trainer for over 50 hours with 8 different children. Two of the children obtained their own powered wheelchair as a result of the training. The therapists indicated the device allowed them to provide mobility training for more children than would have been possible with a demo wheelchair, and they found use of the device to be as safe as or safer than conventional training. They viewed the shared control algorithm as counter-productive because it made it difficult for the child to discern when he or she was controlling the chair. They were enthusiastic about the video game integration for increasing motivation and engagement during training. They emphasized the need for additional access methods for controlling the device. Conclusion: The therapists confirmed that the KWIC Trainer is a useful tool for increasing access to powered mobility training and for engaging children during training sessions. However, some improvements would enhance its applicability for routine clinical use.

Adaptive Shared Control for a Novel Mobile Assistive Robot

This paper presents a new adaptive servo-level shared control scheme for a mobile assistive robot that aims at assisting senior and disabled people to transport heavy objects in a complex environment with obstacles. Several technical problems and challenges related to the assistive robotic system and the shared controller are addressed. Specifically, a nonlinear tracking controller is developed for the robot to follow the user. An obstacle avoidance controller is developed based on the deformable virtual zone principle for the robot to avoid obstacles. The adaptive servo-level shared controller utilizes the tracking controller and the obstacle avoidance controller’s outputs to generate a new shared control output to command the robot. Experiments show that the user can guide the movement of the robot safely and smoothly in the complex environment with the developed controllers.

EEG-Based Mobile Robot Control Through an Adaptive Brain–Robot Interface

A major challenge in two-class brain-computer interface (BCI) systems is the low bandwidth of the communication channel, especially while communicating and controlling assistive devices, such as a smart wheelchair or a telepresence mobile robot, which requires multiple motion command options in the form of forward, left, right, backward, and start/stop. To address this, an adaptive user-centric graphical user interface referred to as the intelligent adaptive user interface (iAUI) based on an adaptive shared control mechanism is proposed. The iAUI offers multiple degrees-of-freedom control of a robotic device by providing a continuously updated prioritized list of all the options for selection to the BCI user, thereby improving the information transfer rate. Results have been verified with multiple participants controlling a simulated as well as physical pioneer robot.

An Adaptive Shared Control System for an Intelligent Mobility Aid for the Elderly

The control system for a personal aid for mobility and health monitoring (PAMM) for the elderly is presented. PAMM is intended to assist the elderly living independently or in senior assisted living facilities. It provides physical support and guidance, as well as monitoring basic vital signs for users that may have both limited physical and cognitive capabilities. This paper presents the design of a bi-level control system for PAMM. The first level is an admittance-based mobility controller that provides a natural and intuitive human machine interface. The second level is an adaptive shared controller that allocates control between the user and the computer based on metrics of the user's performance. Field trials at an eldercare facility show the effectiveness of the design.