Hi all,
I’m working on a project which is trained using two different datasets. I’d like to use to Data Loaders to do this; however, to loop through the Data Loaders, I am forced to use the iterable object. This is restrictive because I’d like to sample (without replacement) from each dataset. Other issues: the sizes of the datasets are different, and the batch size for the samples are also different.
I saw a similar question in which a custom dataset was created to remedy this. However, with that, I would not be able to run entire epochs over the larger dataset, and I would not be able to have different batch sizes. Any suggestions?