Based on your code snippet you are not setting the deterministic cudnn settings and are not using the proposed torch.use_deterministic_algorithms() operation, so non-deterministic results might be expected.