A neural network sensitivity analysis in the presence of random fluctuations

Abstract

In this work we investigate the sensitivity analysis of the noise applied to a neural network. The goal of this study is to try to understand the network's behavior and the outputs sensitivity from the perturbation of weights during the training process. From an engineering point of view, noise is perceived as detrimental to the system and the quality of the output, but in biological neural systems, we can observe noise fluctuations, which possess certain abilities to improve information processing. By means of sensitivity analysis tools we show quantitatively the acceptable level of noise which provides optimal solution to the random fluctuations without sacrificing the behavior of the network. The three different indicators utilized in this endeavor allow us to observe whether the noise variance is detrimental or beneficial, and whether it acts as a source of fluctuation.