Your question might be too general, as there is no silver bullet to make a model generalize. Your best bet would be to check other implementations and reuse their workflow (i.e. in particular the model architecture, data augmentation, optimization etc.).