Solved by ptrblck in post #2 
              
              
                In your bbox_regression_loss you are calculating the torch.sqrt of y_pred. 
Did you make sure to not pass negative values to this method, as this will create NaN outputs?