Solved by Kushaj in post #4 
              
              
                Use layer.weight to get the embedding matrix. In general whenever you want to extract something from any layer in pytorch just look up at the __init__ function in the source code.