Feature augmentation based on manifold ranking and LSTM for image classification

Abstract

Image classification is a critical topic due to its wide application and several challenges associated. Despite the huge progress made last decades, there is still a demand for context-aware image representation approaches capable of taking into the dataset manifold for improving classification accuracy. In this work, a representation learning approach is proposed, based on a novel feature augmentation strategy. The proposed method aims to exploit available contextual similarity information through rank-based manifold learning used to define and assign weights to samples used in augmentation. The approach is validated using CNN-based features and LSTM models to achieve even higher accuracy results on image classification tasks. Experimental results show that the feature augmentation strategy can indeed improve the accuracy of results on widely used image datasets (CIFAR10, Stanford Dogs, Linnaeus5, Flowers102 and Flowers17) in different CNNs (ResNet152, VGG16, DPN92). The results indicate gains up to 20% and show the potential of the developed approach in achieving higher accuracy results for image classification.