Deep Learning, Machine Learning, Python, TensorFlow, Artificial Intelligence.
differentiable function for backpropagation. Softmax. Image by the author. The cross-entropy can be defined as the negative natural logarithm (base e) of the SoftMax output value. The value of M represents the number of output classes. In the example, there are 3 output classes, so M is equal to 3.