PyTorch tensors and NumPy arrays share the same memory locations.
I’ve compared converting to NumPy arrays from PyTorch and Tensorflow here: http://stsievert.com/blog/2017/09/07/pytorch/ 262
On my local machine, PyTorch takes 0.5 microseconds to convert between the two.