The article is devoted to the application of deep neural networks for predicting time series that characterize target trajectories in over-the-horizon radar images (OTH). Such neural networks are effective in cases where traditional methods precision is not sufficient. Method, described in this work relies on the similarities of an area close to the target in the next radar image to the corresponding areas in the previous images along the same trajectory. This approach in similar to “optical flow” calculation, which is used for tracking object motion across an image sequence. However, existing neural network architectures, such as FlowNet, SpyNet and PWC-Net are based on the “dense” optical flow and thus require definition of sample flow vectors for the entire images. Sample radar images, available for model learning, usually have flow vectors available only for a set of points in the images. Besides, OTH radar images are typically represented in azimuth, range and speed dimensions, which makes it difficult to apply existing architectures designed for optical images. OpenCV, a popular framework for image processing contains an implementation of “sparse” optical flow based on the Lucas-Kanade method and allows to track the motion of isolated areas in the image. However, this method is primarily designed for optical images and does not support adaptation to the specifics of radar images. The article provides an example of choosing the type and characteristics of a neural network for the task of trajectory extrapolation. A comparative assessment of various variants of neural network architectures is provided. The possibility of solving the problem using a combination of convolutional and recurrent neural networks is shown. A significant advantage of the proposed trajectory processing approach has been demonstrated. That is the ability of an adaptive system to effectively determine the most likely options for continuing the target trajectory by learning from data.