Thanks for your information. I already did a training without data augmentation.

loss.png1280×960 62.7 KB

But its not looking much better.
I used SGD and CosinWithRestarts. Is it better to use other values tmax or a different scheduler?

optimizer = optim.SGD(params, 0.001, momentum=0.95, weight_decay=0.001)
scheduler = CosineWithRestarts(optimizer, t_max=30)