Hi, thanks for the info!
However, I could see the slowdown even with the latest version.  Upon close looking, looks like PR #25111 (that you mentioned) is concerned with torch.utils.data and not the tensor API?
…So maybe the solution could be adding a similar logic to torch.Tensor.pin_memory()?