Never mind, I understand it now. The problem (it is actually not a problem if you understand it) was that I was calculating total loss, and my train loader was about twice as big as valid loader. So if I set both loaders batch size to be 16 my train loss on average (if model is not overfitting) should be twice as big as valid loader.