Hi Basile!



 Basile:

The logits ranged from -20 to 20, which at first I thought could be a problem, but even for the small differences like -2 / 2 it output like 10^-5 and 10^-8.


As you’ve described things, this can’t happen (unless I give a perverse
interpretation to your description).
Could you capture the issue numerically, and post a complete, runnable
script that reproduces the issue?  Please also let us know what version
of pytorch you are running.
Best.
K. Frank