I wonder if there is a way to prevent the DataLoader from calling getitem so often, so as to say something like:
Do only load 5 sequences in advance (and not plenty as it does now, which has problems with cuda out of memory).
Has anyone tried this before?