No, I had not used the exponential function before.
But I locked the weights for negative values and so I only needed the condition, that the row in the tensor summed must result in 1.
So the Softmax function is perfectly suitable.