Are you sure the code runs on GPU?
Could you check the .type attribute of the Tensors?
If my machine becomes laggy, it’s most likely I forgot to push the data onto the GPU, my RAM full and I’m using the swap.
If that’s not the issue, could you post a small executable code snippet so that I can check if on my machine?