Neural Network: A to Z

Abstract

An artificial neural network is a basic building block for deep learning. Understanding the neural network and making intuitive sense of them is a major challenge for anyone who wants to use them. This is partly due to incomplete articles and highly technical and mathematical papers. Although understanding papers are the best way to completely grasp the ideas, it's very intimidating to beginners. Most of the articles available online are not complete in the sense that they fail to provide intuition about nuances of neural networks at a deeper level. It is important to understand the neural network at a deeper level to make practical use of it. With partial knowledge application of neural networks falls apart at multiple levels from choosing cost function to the learning rate. In this paper, we have covered major concepts of neural networks which is important to fully understand neural networks functionality. This paper also contains a zoomed-in view of each part of mathematics through equations and python code.