Transferring a tensor from the GPU to the CPU will synchronize the code and might thus reduce the overall performance of your script.
The transfer itself might not take a lot of time, but the code would have to wait until the GPU workload is finished to be able to transfer the result back to the CPU.