Traffic Analysis Through Deep-Learning-Based Image Segmentation From UAV Streaming

Abstract

Alongside many traditional as well as novel applications, in the latest years, drones have been widely adopted as remote sensing platforms for road traffic monitoring in urban areas and on highways. The problem of traffic monitoring on Region of Interest (RoI) based on drone imagery is a challenging task, especially when the surveillance drone is constantly moving. In this work, two specific subtasks have been addressed. The goal of the first stage is to predict the RoI in drone imagery of traffic scenes using deep-learning (DL)-based approaches instead of traditional image processing; in this connection, the goal of the second task is to perform vehicle detection on the selected RoI. To ensure diversity and robustness, drone images with different altitudes, positions, and view points have been considered. To achieve these goals, two custom aerial data sets for RoI extraction and detection were built by collecting aerial sequences from flying unmanned aerial vehicles (UAVs) and by transmitting them to the base station leveraging 5G technology. Two different ad hoc DL-based architectures have been designed for the RoI extraction task to maximize the accuracy and inference speed, respectively, and have been evaluated on two different data sets: 1) a custom-built data set and 2) a Massachusetts roads data set. Finally, the models providing the best performance have been combined to further improve the overall results. Experimental tests show that the proposed framework represents a promising solution for drone-based road traffic monitoring in critical areas, exploiting imagery from a variety of viewing angles and altitudes.