Virtual Radar: Real-Time Millimeter-Wave Radar Sensor Simulation for Perception-Driven Robotics

Abstract

This article presents ViRa <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> Available online: https://vira.aau.at/., a real-time open-source millimeter-wave radar simulation framework for perception-driven robotic applications. ViRa provides (i) raw data of radar sensors in real-time, simulation of (ii) multi-antenna configurations for spatial estimation of objects, (iii) wave penetration of non-conductive objects to infer information in occluded situations, (iv) different radar beam patterns, and, (v) configurations of radar sensors as given by real-world radars. By using ViRa, researchers can simulate radar sensors in different robotic scenarios and investigate radars prior to the installation. This allows an acceleration in the development of radar sensors for robotic applications without the need of real hardware. Contrary to simple model abstractions, which only output loose features, ViRa generates raw radar data using computer graphics techniques on graphics processing unit (GPU) level embedded inside a game engine environment. ViRa allows to feed data directly into machine learning frameworks, which enables further improvement in novel research directions, such as safe human-robot interaction or agile drone flights in obstacle-rich environments. The proposed simulation framework is validated with data from different scenarios in robotics such as human tracking for human-robot interaction. The obtained results are compared with a reference simulation framework and show significantly higher correlation when compared to real-world measurement data.