Abstract
Since deep neural networks may classify out-of-distribution image data into in-distribution classes with high confidence scores, this problem may cause serious or even fatal hazards in certain applications, such as autonomous vehicles and medical diagnosis. Therefore, out-of-distribution detection (also called anomaly detection or outlier detection) of image classification has become a critical issue for the successful development of neural networks. In other words, a successful neural network needs to be able to distinguish anomalous data that is significantly different from the data used in training. In this paper, we propose an efficient data augmentation network to detect out-of-distribution image data by introducing a set of common geometric operations into training and testing images. The output predicted probabilities of the augmented data are combined by an aggregation function to provide a confidence score to distinguish between in-distribution and out-of-distribution image data. Different from other approaches that use out-of-distribution image data for training networks, we only use in-distribution image data in the proposed data augmentation network. This advantage makes our approach more practical than other approaches, and can be easily applied to various neural networks to improve security in practical applications. The experimental results show that the proposed data augmentation network outperforms the state-of-the-art approaches in various datasets. In addition, pre-training techniques can be integrated into the data augmentation network to make substantial improvements to large and complex data sets. The code is available at https://www.github.com/majic0626/Data-Augmentation-Network.git .
Highlights
Deep neural networks have achieved very impressive results in various computer vision tasks [1]–[3]
When training neural networks for image classification, geometric transformations such as translation and rotation are often used for data augmentation [27]
EXPERIMENTAL RESULTS we conduct a set of experiments to evaluate the effectiveness of our data augmentation network for out-of-distribution detection
Summary
Deep neural networks have achieved very impressive results in various computer vision tasks [1]–[3]. We assume that when input images are from out-of-distribution, the model will produce a set of predicted probabilities with inconsistent distributions Based on this assumption, Algorithm 2 illustrates the procedure that how the model detects out-of-distribution data during the evaluation phase. The model takes in enhanced data in multiple rotation angles and produces a set of predicted probabilities Oi. An aggregation function is introduced to obtain the confidence score s from the distributions.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.