This is the result based on your settinh
  0 | 1.63084 
  1 | 1.26171 
  2 | 1.00780 
  3 | 0.87280

And
    0 | 1.62280 
    1 | 1.32109 
    2 | 1.16098


But the problem is that setting deterministic=True  spends a lot of time for 1 epoch (about 100x slower)