Abstract
The class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. Hence, these datasets have a significantly negative impact on the performance of many state-of-the-art methods. In this article, we propose a class imbalance loss (CI loss) to handle this problem. To distinguish imbalanced datasets in accordance with the extent of imbalance, we also define an imbalance degree that works as a decision index factor in the CI loss. Because the minority classes with fewer samples probably lose chances in descending the gradient in the training process, CI loss is introduced to make these minority classes descend further than the majority classes. In view of the imbalanced distribution of data in few-shot learning, a method for generating an imbalanced few-shot learning dataset is presented in this article. We conducted a large number of experiments in the MiniImageNet dataset, which showed the effectiveness of an algorithm for model-agnostic metalearning for rapid adaptation with CI loss. In the problem of detecting 15 ship categories, our loss function is transplanted to a rotational region convolutional neural network detection method and a cascade network architecture and achieves higher mean average precision than focal loss and cross-entropy loss. In addition, the Mixed National Institute of Standards and Technology dataset and the Moving and Stationary Target Acquisition and Recognition dataset are sampled to imbalance datasets to verify the effectiveness of CI loss.
Highlights
I N MANY domains, data, including visual data, naturally exhibit imbalance in their category distribution
Experimental results on MiniImageNet, Mixed National Institute of Standards and Technology (MNIST) dataset, Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset, and the optical ship location and identification dataset have shown that the proposed loss function performs better than other state-of-the-art methods
Experiments were conducted in three aspects: 1) datasets in equal distribution of each class in the training and testing sets for normal sample scale learning (e.g., MNIST and MSTAR); 2) datasets in different distributions of each class in the training and testing sets for few-shot learning (e.g., MiniImageNet); 3) imbalance in both training and testing sets for objection detection and recognition task [e.g., American Optical Ship Recognition (NUDT-AOSR15)]
Summary
Abstract—The class imbalance problem exists widely in vision data. In these imbalanced datasets, the majority classes dominate the loss and influence the gradient. The majority classes dominate the loss and influence the gradient These datasets have a significantly negative impact on the performance of many stateof-the-art methods. We propose a class imbalance loss (CI loss) to handle this problem. Because the minority classes with fewer samples probably lose chances in descending the gradient in the training process, CI loss is introduced to make these minority classes descend further than the majority classes. In view of the imbalanced distribution of data in few-shot learning, a method for generating an imbalanced few-shot learning dataset is presented in this article.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
More From: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.