Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
potential solution to this problem can be random initialization. Consider a single neuron as shown below: For this example, we can initialize the weights as: The primary reason behind initializing the weights randomly is to break symmetry. We want to make sure that different hidden units learn