Thank you for your reply.However i tried setting torch.backends.cudnn.deterministic = True.But i still get different train loss.But if i set torch.backends.cudnn.enabled = False, then i can get same train loss.
Are there anything else that i need to change？