Thank you. However, I’m not using fancy stuff like dropout layers. The only thing I’m using is to include gradients via torch.autograd in the cost function which are calculate inside the nn.module and they are used both in eval and train.