Wow… your testcase makes me creepy…
Thanks, though. I’m using 4 Titan Xp and I just increase the atol to 1e-7 to make my testcase work.
Is there any technical paper that the cascaded precision error incurs the performance degeneration in machine learning?