Hi,
I am trying to train my model on 8 GPUS. Although I am able to use all the GPUs for training, but I can see that my Volatile GPU utilization is not perfect. It is fluctuating between all 0s to some % usage.
I tried to increase the number of workers in my dataloader. I also did pin_memory= True and then using async=True with volatile=False for training inputs.
But still  the problem is existing.