SOCNet: A Lightweight and Fine-Grained Object Recognition Network for Satellite On-Orbit Computing

Abstract

High-quality remote sensing images not only provide opportunities for deep learning-based image interpretation, but also challenge satellite edge devices for storage, processing and downlinking to the ground server. Satellite on-orbit object recognition is an effective measure to solve this challenge. However, there is an insurmountable gap between the extremely limited computing and storage resources of satellites and the demand for those of deep learning. To solve this problem, a fast and lightweight intelligent satellite-on-orbit computing network (SOCNet) is proposed. First, the overall network architecture based on the idea of flat multi-branch feature extraction is proposed to accelerate model inference and reduce the network depth. Second, we propose the idea of exchanging a larger receptive field for network depth and combine the idea of depthwise separable convolution to further reduce the amount of parameters. We design a feature extraction method of coupled fine-coarse-grained for efficient feature extraction. Finally, global average pooling is used for feature fusion to further reduce network parameters amount and computational complexity. We have performed multiple sets of ablation experiments and some state-of-the-art comparison experiments on the server and carried out experimental verification on the NVIDIA Jetson TX2 mobile device to mimic the resource-constrained environment on the satellite. SOCNet with parameters of 0.21 MB, model size of 1.22 MB and computation cost of 50.81 MB floating point operations has achieved 99% comprehensive accuracy, 2.45 ms latency and 408 images per second throughput on 30 types of aircraft datasets with the 224 × 224 remote sensing images.