MarsNet: Automated Rock Segmentation With Transformers for Tianwen-1 Mission

Abstract

The Mars exploration mission of China named Tianwen-1 is being carried out as scheduled. The Navigation and Terrain Cameras (NaTeCam) equipped on the Zhurong Rover play an essential role in obstacle recognition. The main obstacles on the Martian surface are rocks of different sizes, which influence the path planning of Zhurong Rover in scientific exploration. Most existing semantic segmentation methods are based on the U-Net architecture with ResNet or other backbones, and features extracted by these methods lack of the long-range dependencies. To fully exploit the context information, we propose the MarsNet framework for Mars image, which combines Transformers with the convolutional neural network as the backbone, and hybrid dilated convolution (HDC) is also employed to the decoder path to help detect the huge rocks. Besides, since there are few open-source datasets for rock segmentation for Mars, we establish a segmentation dataset from Martian surface image, named TWMARS, captured by NaTeCam. Extensive experiments are conducted on TWMARS dataset, and the experimental results demonstrate that MarsNet achieves accurate rock segmentation and outperforms state-of-the-art methods. The source code is available at: https://github.com/BUPT-ANT-1007/MarsNet.