Solved by KFrank in post #3 
              
              
                Hi Mainul! 

It will be better to use a single output for a binary-classification 
problem, rather than two (which you could logically do).  By 
doing so you eliminate one redundancy, and the parameters 
that go along with it, from your network.  This will provide at 
least a modest advantage. 

The…