Solved by ptrblck in post #2 
              
              
                Try calling double() on your layer: 
emb = nn.Embedding(...)
emb = emb.double()

This should change the type of internal parameters to float64.