Hugdatafast: huggingface/nlp  fastai
An integration to make use of hundreds of datasets with fastai, and some handy transforms to make concatenated dataset like language model dataset.
 pip install hugdatafast
 Documentation: https://hugdatafast.readthedocs.io/en/latest/ 38
Doing NLP ?
See if you can turn your data pipeline into just 3 lines. 
hugdatafast_fastai1216×871 234 KB
The updates will also be tweeted on my Twitter Richard Wang 3.