Maybe it’ll give you some performance advantage, but you should definitely check, if it’s the bottleneck in your application.
It’s always annoying to fine tune some methods when the bottleneck is somewhere else.
You could have a look at torch.utils.bottleneck 35 to check your model code.
To time your DataLoader you could have a look at the imagenet example 17.
Also, how are you currently loading your text data in pytorch? It might help to save it as a hdf5 file.