Yeah, our CPU rng isn’t thread safe at the moment. This is a high priority task tracked at https://github.com/pytorch/pytorch/issues/3794 30. The GPU one should work fine (and is faster). So numpy and GPU should be sufficient for now!