Depends on some facts:

Do you have enough RAM to contain your whole data
How many CPUs do you have, how many GPUs?
How big is your batchsize?
With how many workers do you train?
Do you do some online/offline augmentation?