Thanks for your reply, it might be.
But is that going to cause 0% GPU utility all the time? After all at least model forward should have been on GPU. Sorry I don’t understand the interaction between CPU and GPU.