Feature augmentation based on information fusion rectification for few-shot image classification

Abstract

In the issue of few-shot image classification, due to lack of sufficient data, directly training the model will lead to overfitting. In order to alleviate this problem, more and more methods focus on non-parametric data augmentation, which uses the information of known data to construct non-parametric normal distribution to expand samples in the support set. However, there are some differences between base class data and new ones, and the distribution of different samples belonging to same class is also different. The sample features generated by the current methods may have some deviations. A new few-shot image classification algorithm is proposed on the basis of information fusion rectification (IFR), which adequately uses the relationship between the data (including the relationship between base class data and new ones, and the relationship between support set and query set in the new class data), to rectify the distribution of support set in the new class data. In the proposed algorithm, feature of support set is expanded through sampling from the rectified normal distribution, so as to augment the data. Compared with other image augmentation algorithms, the experimental results on three few-shot datasets show that the accuracy of the proposed IFR algorithm is improved by 1.84–4.66% on 5-way 1-shot task and 0.99–1.43% on 5-way 5-shot task.