In this post I’ll talk about simple addition to classic SGD algorithm, called momentum which almost always works better and faster than Stochastic Gradient Descent. Momentum or SGD with momentum…

In mathematical analysis, the maxima and minima (the respective plurals of maximum and minimum) of a function, known collectively as extrema (the plural of extremum), are the largest and smallest…

Below are the various playlist created on ML,Data Science and Deep Learning. Please subscribe and support the channel. Happy Learning! Deep Learning Playlist: https://www.youtube.com/watch?v=DKSZHN7jftI&list=PLZoTAELRMXVPGU70ZGsckrMdr0FteeRUi Data Science Projects playlist: https://www.youtube.com/watch?v=5Txi0nHIe0o&list=PLZoTAELRMXVNUcr7osiU7CCm8hcaqSzGw NLP playlist: https://www.youtube.com/watch?v=6ZVf1jnEKGI&list=PLZoTAELRMXVMdJ5sqbCK2LiM0HhQVWNzm Statistics Playlist:…

The weights of artificial neural networks must be initialized to small random numbers. This is because this is an expectation of the stochastic optimization algorithm used to train the model, called…

This video is the continuation of the activation functions from my complete deep learning playlist.In this video we will cover the ELU, Prelu,Softmax,Swish and Softplus Activation functions. ⭐ Kite…

After going through this video, you will know: 1. What are the basics problems of Sigmoid and Threshold activation function? 2. What is a Relu activation function? 3. What is a Leaky Relu…

After going through this video, you will know: Large weights in a neural network are a sign of a more complex network that has overfit the training data. Probabilistically dropping out nodes…