Hey,
I’ve found out that calling .numpy() on a tensor and transferring it to GPU with .to(device) results in data synchronization between CPU and GPU after augmenting variable on GPU (saved numpy vector gets updated too). How does PyTorch achieve that? Is it always synchronizing variables between CPU and GPU? I doubt because that would be slow I guess.