Methods of automated detection of travel points when training a collaborative robot

Abstract

An algorithm has been developed and implemented in this paper, which allows automating the process of forming and controlling scenarios for the movement of a collaborative robot (“Cobot”) through a database of points without specific interfaces, services, and software tools characteristic of each Cobot model. The unification of the developed single graphical interface is achieved by automating the work with Cobot controllers through specialised structured file formats and Robot Operation System (ROS), and by automatically detecting marks as movement points in the image received from the stereo camera using neural network-based models and image processing techniques. Research based on a series of experiments ensured the selection of the most effective image processing method and neural network model in terms of accuracy, speed, resource consumption. The approach formalised in the paper and the graphical interface allowed to implement a classical set of industrial tasks of Cobot motion control.