aplassard:

Do you need to use the whole dataset for training? Is there any reason you couldn’t just train on 1 million rows? Or simply just train for 1-2 epochs on the whole dataset. One epoch would take about 16 days.


No. I do need the whole dataset for training and yes, I will be training it for one epoch only.