Deep Learning, Regularisation, Optimization Algorithms, Deep Neural Networks, Gradient Descent.
a neural network for a multi-class classification looks like. So, for layer L, the output will be: Z[L] = W[L]*a[L-1] + b[L] The activation function will be: Let’s understand this with an example. Consider the output from the last hidden layer: We then calculate t using the formula given above: