Abstract

A new data-driven programming model is defined by the deep learning (DL) that makes the internal structure of a created neuron system over a fixed of training data. DL testing structure only depends on the data labeling and manual group. Nowadays, a lot of coverage criteria have been developed, but these criteria basically count the neurons' quantity whose activation during the implementation of a DL structure fulfilled certain properties. Also, existing criteria are not adequately fine-grained to capture delicate behaviors. This paper develops an optimized deep belief network (DBN) with a search and rescue (SAR) algorithm for testing coverage criteria. For an optimal selection of DBN structure, the SAR algorithm is introduced. The main objective is to test the DL structure using different criteria to enhance the coverage accuracy. The different coverage criteria such as KMNC, NBC, SNAC, TKNC, and TKNP are used for the testing of DBN. Using the generated test inputs, the criteria is validated and the developed criteria are capable to capture undesired behaviors in the DBN structure. The developed approach is implemented by Python platform using three standard datasets like MNIST, CIFAR-10, and ImageNet. For analysis, the developed approach is compared with the three LeNet models like LeNet-1, LeNet-4 and LeNet-5 for the MNIST dataset, the VGG-16, and ResNet-20 models for the CIFAR-10 dataset, and the VGG-19 and ResNet-50 models for the ImageNet dataset. These models are tested on the four adversarial test input generation approaches like BIM, JSMA, FGSM, and CW, and one DL testing method like DeepGauge to validate the efficiency of the suggested approach. The simulation results proved that the proposed approach obtained high coverage accuracy for each criterion on four adversarial test inputs and one DL testing method as compared to other models.

Highlights

  • For a past few decades, a deep learning (DL) has obtained boundless victory in several safety–critical applications like speech recognition, image processing, and board games [1]

  • To measure the ability of the proposed structure, 4 existing adversarial test examples[27] such as FGSM, BIM, JSMA, and CW and 1corresponding DL testing method like DeepGauge [19] are considered for the comparative study.Five types of coverage criteria such as k-multisection Neuron Coverage (KMNC), Neuron boundary coverage (NBC), Strong neuron activation coverage (SNAC), Top-k neuron coverage (TKNC), and Top-k neuron patterns (TKNP) are used for the testing of deep belief network (DBN) structure

  • In this work, an optimized DBN with search and rescue (SAR) algorithm has been proposed for testing the numerouscoverage criteria

Read more

Summary

Introduction

For a past few decades, a DL has obtained boundless victory in several safety–critical applications like speech recognition, image processing, and board games [1]. To make the efficient performance error illuminating test cases, the valuable descriptive rules frequently permit testers even though practical structures reveal much more complex behavior [11] This intuition directed the investigators to consider the different ways which industrialize the testing role with intelligence in the optimization and test case assortment. By collecting the data about the software being investigated, the superiority assertion is maintained by the intellectual software testing actions It points out the requirement for a search-based optimization procedure the resources can be successfully employed [12]. The remaining of the paper is systematized as trails: “Related works” section provide the recent related works, the overall proposed methodology is explained in the third section which include the DBN structure with optimization approach and the different coverage criteria for testing of DL systems. The conclusion and future scopes are discussed in the fifth section

Related works
Findings
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call