Solved by ptrblck in post #4 
              
              
                Could you post the model definition by wrapping the code into three backticks ```? 
Also, are you using e.g. torch.backends.cudnn.deterministic = True as described here?