If you set the random seed you do get the same output
>>> torch.manual_seed(5)
>>> torch.nn.Embedding(3,2)(torch.autograd.Variable(torch.LongTensor([0,1,2])))
Variable containing:
-0.4868 -0.6038
-0.5581  0.6675
-0.1974  1.9428
[torch.FloatTensor of size 3x2]

>>> torch.manual_seed(5)
>>> torch.nn.Embedding(3,2)(torch.autograd.Variable(torch.LongTensor([0,1,2])))
Variable containing:
-0.4868 -0.6038
-0.5581  0.6675
-0.1974  1.9428
[torch.FloatTensor of size 3x2]