This is crucial when saving checkpoints (because we have a cluster that only allows to run 1day jobs and then I have to re-start it another day from the exact place).
Reproducibility in Deep Learning is a very big issue and this doesn’t make it better.
I’d make a feature request.