Not sure why to check the GPU utilization? GPU utilization depends on multiple factors, like batch size and even image size.
Anyhow, I checked GPU utilization and it is low in all cases. but this is not due to data-loading bottleneck rather than because I am using small model and small data (MNIST-like data set) just to compare the performance.