@KFrank thanks for correction , yes i fixed it and now gap between training and validation has been closed , but still validation loss is lesser than training , could you please elaborate more what do you mean by
" but this is easier to hand-wave away with more
“hard” samples in your training set or normalization vagaries, etc."
epoch : 1,training loss : 1.1062123730735536 , validation loss : 0.9584911298922756
epoch : 101,training loss : 0.5904753306208222 , validation loss : 0.5017905667378958
epoch : 201,training loss : 0.4886256533068133 , validation loss : 0.43560073343017525
epoch : 301,training loss : 0.4826799846960937 , validation loss : 0.43197416186192145
epoch : 401,training loss : 0.47715110642727154 , validation loss : 0.4264545226974467


loss1130×752 67.8 KB