Solved by Kushaj in post #5 
              
              
                Review the Bag of Tricks for Image Classification with Convolutional Neural Networks for some pointers. 
Preprocessing: Zeros padding with value=4 and then randomly crop a 32x32 image. For normalization use mean=[0.491, 0.482, 0.447] and std=[0.247, 0.243, 0.261]. For data augmentation, use horizont…