Two-stream network with phase map for few-shot classification

Abstract

As an important research direction of deep learning, few-shot classification mainly solves problems of classification when training samples are scarce. Under this circumstance, how to effectively use the information of existing samples has become the key to solve few-shot classification problems. We propose a method to fully mine existing samples information, which can be implemented in the training and testing stages. Specifically, we introduce a two-stream neural network as an embedding model to extract features of the original image and its phase map, and perform fine-grained adaptive feature fusion to them. The algorithm can learn and extract more fully-informed fusion features under the network. Besides, we also introduce Circle Loss in loss function, which has a non-linear decision boundary. Under the joint supervision of Soft-max Loss and Circle Loss, the distinction between different classes of features in embedding space increases. We conduct experiments on miniImageNet, tieredImageNet, and CIFAR-FS, respectively. The accuracy rate is increased by 0.99%, 0.96%, and 0.91%, which proves the effectiveness of our algorithm.