Deep Learning Lecture 4.3 - Stochastic Gradient Descent

Deep Learning Lecture: Optimization Methods
Stochastic Gradient Descent (SGD)
SGD with Momentum