tfwnicholson:

There is nothing you can do about this if you are after repeatable results on the GPU, GPU computation is inherently stochastic. However you can try:

running your experiments repeatedly (with different weight initialisations as well) and average them to get a more robust estimate of your score
run your experiments for a shorter time (until before the divergence occurs)
run your experiments on a single core CPU



Hey Tom, thanks for the explanation. That would make sense if I used GPUs. But the results shown here are from running the script “as it is” on my macbook’s CPU. There is no threading or parallelism in this script so I assume it run on a single core. Could someone reproduce these results?