Abstract
With the rapid development of deep learning technologies, the quality and security of deep learning systems have aroused great concern recently. Much research has been done in testing deep learning systems. Nevertheless, the oracle problem still remains since the input space of DNN-based software is usually very large and manually labeling is boring and cost-effective. Inspired by structural testing for traditional software, in this paper, we propose an algorithm to mitigate the oracle problem by selecting test inputs worth labeling. Specifically, we propose a test subset selection algorithm that can automatically select a test suite with high coverage but a small size when the labeling budget is limited. Compared with DeepXplore, the proposed algorithm can generate smaller test suites with higher coverage.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.