I should mention that I am a newbie to Pytorch, so there might be some thing I am missing. Here is what I tried.

Login to https://colab.research.google.com/notebooks/welcome.ipynb 4

Create a new notebook with GPU runtime.
Install pytorch nightly and fast ai.

!pip install torch_nightly -f https://download.pytorch.org/whl/nightly/cu92/torch_nightly.html
!pip install fastai


Run the examples/cifar.ipynb 5 notebook.

The time it takes to execute  learn.fit_one_cycle is way more than reported in that notebook. I printed the cuda device name and is cuda available calls both calls listed that the gpu is available. During executing the above notebook, I monitored the cpu and gpu usage and the cpu usage was higher and gpu was not used that much even though it did list a running python process.