Hi py!



 pytorcher:

I believe I have tracked it down to one of the computers returning slightly wrong values for softmax.  Any reason why this would be?
(Pdb) (X[0].exp() / X[0].exp().sum()).tolist()
[0.09599629789590836, …
…
(Pdb) F.softmax(X[0]).tolist()
[0.09599630534648895, …


This is floating-point round-off error.  First cast X to a
dtype = torch.double tensor, and then redo your test.
Your “right” numbers and “wrong” numbers will now agree
to about twice as many decimal places.
Best.
K. Frank