Thanks for the experiment stats. Based on the mean and std it doesn’t seem that TF32 or the GPU is changing the final results significantly in the 5 runs.
To further isolate the difference, you could try to make the runs deterministically (e.g. to remove the influence of shuffling the dataset) and also make sure to use the same library stack (same PyTorch, CUDA, cudnn, etc. versions).