I found some interesting thing which I don’t understand. When I created my train and valid loaders I made the train loader batch size = 16 and valid loader = 1. The validation total loss was like 10 times the loss of train loss. Then I changed batch size to 16 and the validation loss became like twice as low as train loss. Then I set valid batch size to 32 and the loss became about 4 times smaller than train loss.
I’m still confused with how this thing works. Any help will be appreciated.