Solved by sonnguyen in post #6 
              
              
                You have to scale your target or you need a better initialization of output weight. 
I am assuming that you doing regression here. 
The key thing is, your network outputs should start at the average of the targets, in your case it should be around -2700 if you don’t want to scale your targets. Then …