It all in the title:
torch.Tensor.cuda has an async parameter that allows asynchronous transfer from pinned memory to GPU. Does torch.Tensor.to automatically uses async when possible?
I wasn’t able to find the relevant piece of source code.