Is it anyway I can sample random numbers directly on GPU, avoiding sampling on CPU and then transfer, such as:
torch.tensor.randn(10,10).cuda() #REALLY SLOW
maybe adding to the torch.distribution package a way to tell sampling is performed on GPU, because the source code of this methods always use torch.tensor but not torch.cuda.tensor.
Or add torch.cuda.FloatTensor(10,10).randn_
This would be really useful.
Thanks