I am using SGD optimizer and CrossEntropyLoss with lr=0.001.
Maybe I should try to tune my hyperparameters. Is it possible for you to share some example of how to use Hyperopt or Hypersearch in Pytorch CNN??