Chapter 13 - 3D object detection and tracking

Abstract

3D object detection and tracking are important tasks in robotics and autonomous systems because the application of 2D object detection methods cannot provide enough understanding of the 3D world that a robot (or agent) operate in. In this chapter, we describe 3D object detection and tracking methods, grouping them based on the sensors they use for collecting information about the environment. We describe in detail the most popular Lidar-based methods, the most affordable camera-based methods with monocular and binocular images, and data fusion methods that exploit information collected by multiple sensors at once. We also describe the most popular public datasets and metrics used for performance evaluation of detection and tracking methods.