Two things:

If you plan to use torchtext.data.TabularDataset, your data should be able to fit in the memory. Only then can torchtext read and create batches of data.
If the above is not possible, you can use lazy loading to create your custom batches (use yield like used in Python generators).