I see the same problem of high CPU usage and slow training time for Fast AI examples on google colab with GPU using the pytorch nightly build in the last couple of days. I tried a custom GPU instance on google cloud but that also has the same behavior. I think there is some regression in PyTorch.