Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
Bias Correction in Exponentially Weighted Averages We initialize V0 = 0, so while calculating the V1 value it will only be equal to (1 — β) * Θ1. It will not generalize well to the actual values. We need to use bias correction to overcome this challenge. Instead of using the previous equation,