Learning Temporal Features for Detection on Maritime Airborne Video Sequences Using Convolutional LSTM

Abstract

In this paper, we study the effectiveness of learning temporal features to improve detection performance in videos captured by small aircraft. To implement this learning process, we use a convolutional long short-term memory (LSTM) associated with a pretrained convolutional neural network (CNN). To improve the training process, we incorporate domain-specific knowledge about the expected size and number of boats. We carry out three tests. The first searches the best sequence length and subsampling rate for training and the second compares the proposed method with a traditional CNN, a traditional LSTM, and a gated recurrent unit (GRU). The final test evaluates our method with the already published detectors in two data sets. Results show that in favorable conditions, our method’s performance is comparable to other detectors but, on more challenging environments, it stands out from other techniques.