juliustao:

Has anyone seen similar cases or have insights into how using amp could remove nondeterminism?


Non-deterministic results could be caused by the actual kernel selection and amp could be using e.g. deterministic cuDNN kernels.