Maybe this paper can help:

  
      
      arXiv.org
  
  
    

Bag of Tricks for Image Classification with Convolutional Neural Networks 8

Much of the recent progress made in image classification research can be
credited to training procedure refinements, such as changes in data
augmentations and optimization methods. In the literature, however, most
refinements are either briefly...