I’m not sure, but out NLP experts might know the answer. 


This blog post 1.3k describes, how to load and use the embeddings. Note that now you can also use the classmethod from_pretrained 569 to load the weigths.


Yes, this is also shown in the blog post.