Hi, I think that a better option is to change the first conv layer stride to 1 and the last pooling layer according to its input. You can check this project here for many examples on cifar10:

  
      
      GitHub
  
  
    

kuangliu/pytorch-cifar 3

pytorch-cifar - 95.16% on CIFAR10 with PyTorch