Solved by ptrblck in post #2 
              
              
                I’m not sure, if I understand this sentence correctly. 
Are you comparing these use cases: 
# case0
output = model(unnormalized_input)
loss0 = criterion(output, unnormalized_target)

# case1
output = model(normalized_input)
loss1 = criterion(output, normalized_target)

If so, then I would expect th…