Hi,
The general policy we have in pytorch is that we avoid doing any copy that are hidden from the user. (cpu/gpu or different types).
Even though you could argue that this can make the user’s code more verbose. It usually allows the user to have a better control on what happens in its code.