Solved by albanD in post #5 
              
              
                Good that you found it ! 
The answer is that a softmax with a single output is a constant function that outputs 1 all the time. And the gradient of a constant function is 0.