Solved by justusschock in post #14 
              
              
                Usualy yes (if you don’t use torch.no_grad or something similar. Could you provide a gist with a minimum working example? This would be helpful, since we would able to debug ourselves.