Hello,
I have been training a Resnet18 network on synthetic dataset of about 350,000 images. Each of the image has a label, all the labels are stored in a text file. I have created a simple custom Dataset class that loads one image at a time inside the getitem function. The label file is just read once in the init function and converted to a tensor (since its small).
The trouble is one epoch would take me about 45+ minutes in a system with a V100 GPU. As far as I am concerned, is it not a bit too much? Can it be due to a slow dataloading? Please share your opinions on this.
Thanks