Solved by AbdulsalamBande in post #2 
              
              
                Yes you might not see improvements because in your model you need to do something like this . 
I did the same thing in the project below 
self.embedding = nn.Embedding(n_tokens, embedding_size)
self.embedding.weight.data.copy_(pretrained_vectors)

Link to Project that contains Your problem solution