Are you only applying the posted transformation in your code snippet without any model training?
If so, then I would expect the GPU utilization to be at 0%, since the CPU will be used.
For the increase in iteration time: I guess you might be storing some tensors, which are still attached to the computation graph, and are indeed training the model. This would increase the memory usage as well as the processing time.