Video process detection for space electrostatic suspension material experiment in China’s Space Station

Abstract

The purpose of video process detection is to identify key processes of interest and associated semantic categories, which is an important computer vision task for localizing key processes in space science experiments. To detect experimental processes in space electrostatic suspension material experiment on China’s Space Station, we propose a Slow-and-Fast Dual-Stream Network. It extracts multi-scale temporal semantic information by designing a Slow-and-Fast Stream structure and effectively detects the experimental processes with various temporal scales. In addition, the Two Path Temporal Pyramid Network (TP2N) enhances the bi-direction flow among multi-scale features on the temporal dimension to alleviate boundary sensitivity. The validation experiments on our established dataset demonstrate the effectiveness of our proposed method with 62.43% mAP, outperforming the related state-of-the-art temporal action localization methods with nearly 7% mAP gain. This paper is the first application of deep learning in space electrostatic suspension material experiments on China’s Space Station and further provides important technical support for the identification of key processes in space science experiments.