As with any others, to speed up you can try using smaller model and parallel data loading (dataloader), making sure one is not a bottle neck for others. To reduce overfiting, you can try stuffs like data augmentation, weight decay, dropout, etc