Ha ha ha I can relate to that problem 
Yes, we are actually using the same pre-trained weights that were trained on the billions tweets.
Transferring weights from Keras to pyTorch is actually very simple (could have written a word or two about that indeed)