Arbitrary-angle bounding box based location for object detection in remote sensing image

Abstract

ABSTRACT Object location is a fundamental yet challenging problem in object detection. In the remote sensing image, different imaging projection directions make the same object have various rotation angles, and in some scenes, the object distribution is relatively dense. Most of the existing deep learning-based object detection algorithms utilize horizontal bounding box to locate objects, which causes inaccurate location of the objects with dense distribution or arbitrary direction, thus leading to the detection misses. In this paper, we propose an arbitrary-angle bounding box based object location and embed it into the Faster R-CNN, developing a new framework called Rotated Faster R-CNN (R-FRCNN) for object detection in remote sensing image. In R-FRCNN, we specially improve anchor ratios to adapt to the objects like ship with large aspect ratio and increase the weights of the horizontal bounding box regression to reduce the interference of the arbitrary-angle bounding box on the horizontal bounding box prediction. Comprehensive experiments on a public dataset and a self-assembled dataset (which we make publically available) show the superior performance of our method compared to standalone state-of-the-art object detectors.