I run again my code 10 times and I got similar results between PyTorch and Keras. Maybe my original 4 runs were particularly unlucky for PyTorch. Or maybe there was some bug in my old 0.2 implementation. Sincerely I can’t figure it out but I’m glad (and sorry) this was a false alarm!
These are my new results:
PyTorch
1.2381e-05
2.8960e-04
1.2643e-04
7.6845e-05
2.5028e-05
1.1711e-04
1.2660e-04
1.5379e-04
1.1074e-04
4.8524e-04
Keras
3.7622e-05
2.4301e-04
9.6022e-05
1.2589e-04
3.5417e-04
6.3925e-05
8.8122e-05
2.6460e-04
2.0003e-04