Hello Amir,
so having done both for different problems, I’d say that it depends on your taste.
torchtext worked well for me in Handwriting generation 50 and it is a great way to keep some transparency in what is in your dataset and avoid compiling the batches by yourself.
That said, using torch.nn.utils.rnn’s pack_sequence to write my own collate function (turning a list of dataset entries into batches for each dataset item) was all it took to use sequences (on a model not yet on github) with the standard torch.utils.data.Dataset / Dataloader mechanisms.
Best regards
Thomas