Solved by Nikronic in post #2 
              
              
                Hi, 
Yes, it will. 
For instance, if you have [1, 3, 2, 2, 2] tensor, then validating softmax value at position [0, 0, 0, 0, 0], you need following calculation: 
torch.exp(x[0, 0, 0, 0, 0])/ (torch.exp(x[0, 0, 0, 0, 0])+torch.exp(x[0, 1, 0, 0, 0])+torch.exp(x[0, 2, 0, 0, 0]))

Bests