Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
helps us reach the global minima much more quickly. There are a few more learning rate decay methods: Exponential decay: α = (0.95)epoch_number * α0 α = k / epochnumber1/2* α0 α = k / t1/2* α0 Here, t is the mini-batch number. This was all about optimization algorithms and module 2! Take a deep