Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
different patterns. There is one more technique that can help ensure that our implementations are correct and will run quickly. Gradient Checking Gradient checking is used to find bugs (if any) in the implementation of backpropagation. Consider the following graph: The derivative of the function