This workshop will cover the fundamental topics in neural networks. We will learn about perception, calculation of loss, training and gradient descent, and backpropagation. We will study the benefits of neural networks by comparing it with previous methods on a sample problem. This will build the foundation required to understand deep neural networks and its applications in Natural Language Processing and Computer Vision.