ADANOISE: Training neural networks with adaptive noise for imbalanced data classification

Abstract

The class imbalance problem, which has been recognized in many real-world applications, negatively affects the performance of neural networks. To address the class imbalance problem, resampling and cost-sensitive learning have been commonly applied. In this study, we propose a novel training method for neural networks based on adaptive noise, named ADANOISE. This method incorporates the ideas of both resampling and cost-sensitive learning to improve the training of a neural network under class imbalance. For the neural network, random noise is added to the input when it learns from the minority class. To make the learning objective cost-sensitive, each minority class instance is oversampled by adding different noise vectors randomly sampled from a noise distribution. The neural network and the parameter of the noise distribution are simultaneously trained. By doing so, the noise distribution adapts to the training data in a data-driven fashion toward improving the performance of the neural network. We demonstrate the effectiveness of the proposed method through experiments on benchmark datasets.