Solved by KFrank in post #2 
              
              
                Hi Edward! 

Yes, it is perfectly fine to use a loss that can become negative. 
Your reasoning about this is correct. 
To add a few words of explanation: 
A smaller loss – algebraically less positive or algebraically more 
negative – means (or should mean) better predictions.  The 
optimization step…