Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
w.r.to Θ can be best expressed as: Where ε is the small step which we take towards the left and right of Θ. Make sure that the derivative calculated above is nearly equal to the actual derivative of the function. Below are the steps we follow for gradient checking: Take W[1], b[1],…., w[L], b[L]