It supports all kind datasets, and it could also be used to load raw text file.But you need to write your own loader(read file into memory) and  transform(transform text data to tensor).
As for text datasets, try:

  
      
      GitHub
  
  
    

pytorch/text 31

Data loaders and abstractions for text and NLP. Contribute to pytorch/text development by creating an account on GitHub.