Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
and reshape it into a big vector Θ: We also calculate dW[1], db[1],…, dw[L], db[L] and reshape it into a big vector dΘ Finally, we check whether dΘ is the gradient of J(Θ) For each i, we calculate: We use Euclidean distance (ε) to measure whether both these terms are equal: We want this value to be