Thanks for the update! I assume you’ve then created a code snippet containing the model training loop alone and are still seeing the slowdown in each iteration?
If so, could you please post the code here so that we could take a look?