there’s no downside that i can see.
However, the runtime of that particular line doesn’t matter compared to the overall compute time. it’s probably < 0.1% of time compared to forward/backward / step() etc.
If you are seeing it to be a larger chunk, that’s possibly because CUDA API is asynchronous, but that operation in particular is a synchronizing point.