Yes it should work and also should be quite fast, since numpy conversions are nearly free, because they share the same data with the tensor.
Also, have a look at @ncullen93’s gist 8. There might to be some useful transformations for you.