Sensorimotor Skill Communication: A Literature Review

Vahan Babushkin,Wanjoo Park,Muhammad Hassan Jamil,Mohamad Eid

doi:10.1109/access.2021.3081449

Vahan Babushkin, Wanjoo Park + Show 2 more

Open Access

https://doi.org/10.1109/access.2021.3081449

Copy DOI

Journal: IEEE Access	Publication Date: Jan 1, 2021
Citations: 1	License type: CC BY 4.0

Affiliation: New York University Abu Dhabi, New York University

Abstract

A sensorimotor skill is a sequence of motions generated in response to external stimuli and aiming to accomplish a particular task. It can be communicated to reproduce the task in a distant environment with similar settings. In this work, we conceptualize a multi-modal sensorimotor skill communication system that incorporates modeling, simulation, and evaluation of the sensorimotor skill. The proposed sensorimotor skill communication system can be applied for learning a specific style of human sensorimotor skill and teaching the skill to distant learners, which can be implemented in a variety of applications such as Tele-consultation, Tele-diagnosis, Tele-treatment, Tele-monitoring, and Tele-support. To understand the processes behind the communication of sensorimotor skill we review the representation of a human sensorimotor system from the neurobiological perspective. Then we analyze the existing literature on sensorimotor skill communication systems and propose a taxonomy of currently available methods for sensorimotor skill modeling, simulation, and evaluation. Furthermore, we propose a benchmark for evaluating the quality of the sensorimotor skill communication system. We present a case study aiming to demonstrate modeling the dental sensorimotor skill of periodontal probing. Lastly, we discuss challenges and limitations and provide perspectives for future research in developing sensorimotor skill communication systems.

Highlights

Haptic playback techniques combined with virtual reality (VR) systems are widely implemented in dental simulations, for training periodontal procedures [12], [119]–[123]
Sensory information is routed from the visual, auditory, and somatosensory cortices into the posterior parietal cortex, which in turn routes relevant data to the dorsolateral prefrontal cortex, the supplementary motor area, the premotor cortex, and the primary motor cortex
The primary motor cortex is tasked with providing motor commands to generate a response

Summary

INTRODUCTION

Motor primitives are closely associated with motor pattern generators (MPGs) [66], [67] – the complete motor circuits including sensory feedback, central pattern generators (CPGs) (circuits that do not require sensory feedback to produce motor activities) and modulations from descending pathways through which the motor signals travel from the brain to lower motor neurons [68] This approach is used for imitation learning in hierarchical distributed motor control systems, which allows to simplify the perception of a demonstrated movement and facilitate the selection and execution of an optimal action, e.g. This approach models the neuronal mechanisms responsible for adapting the robot’s behavior to different scenarios

SENSORIMOTOR SKILL SIMULATION

SENSORIMOTOR SKILL EVALUATION

CASE STUDY

SUMMARY OF FINDINGS Our main findings are summarized below: