To add to KFrank’s post, this deals with the fundamental difference between sigmoid and softmax. A more detailed comparison can be found here on StackExchange 8; specifically with regards to neural networks, this post on StackExchange 1 is also helpful.