I went through similar problem only mine was hyperparameter tuning for feedforward neural networks. Then I ran into this very helpful article, you should check it:

  
      
      Xavier Valcarce – 1 Oct 18
  
  
    

Feedforward neural network & Optimization of Hyperparameters using... 272

0. Overview Here is shown how to create a Feedforward neural network (FNN) using Pytorch -- Facebook's AI framework. We'll go through the creation of a FNN, with a user set number of layer/neurones. Making a custom Dataloader is also discussed, so...