Improved seabird image classification based on dual transfer learning framework and spatial pyramid pooling

Abstract

Seabird plays an important role in the marine ecosystem and is an indispensable part of the food chain. However, the seabird population has been experiencing a rapid decline due to various factors including climate change, fisheries, and invasive non-native species. To better protect seabirds, the first step is to accurately monitor them. Automatic classification of seabirds would significantly speed up the monitoring process. In this paper, we propose a dual transfer learning framework for improved seabird image classification based on spatial pyramid pooling. Specifically, a dual transfer learning framework is used to capture various patterns to improve the discriminability of the proposed model. Both InceptionV3 and DenseNet201 are used as the backbones, whose outputs are concatenated using a spatial pyramid pooling (SPP) layer. Here, SPP is used to address images of different sizes. Next, two types of pooling, global average-pooling (GAP) and global max-pooling (GMP) are applied to the output of the SPP layer, where the results of GAP and GMP are linearly added up. Our method takes both InceptionV3 and DenseNet201 as feature extractors and is trained offline in an end-to-end style. The proposed dual transfer learning framework-based seabird image classification method reached the accuracy, precision, recall, F1-score of 95.11%, 95.33%, 95.11%, 95.13% on the 10 classes seabird image dataset.