Solved by richard in post #2 
              
              
                By default, loss is averaged over pixels*batch_size. This behavior can be controlled: http://pytorch.org/docs/master/nn.html?highlight=nllloss#torch.nn.NLLLoss2d