magp18:

I am using an HDD


This might create a data loading bottleneck.
You could use the data_time meter from the ImageNet example 2 to track the data loading time.
This post 3 gives you some more information in case you haven’t read it already.