Thank you for your reply.
As suggested in your code, I am trying something like below
import torch.nn as nn
word_to_ix = {"hello": 0, "world": 1}
num_sentences = 4
num_unique_words = 1

embeddings = nn.Embedding(num_unique_words, 5)
indices = torch.LongTensor([word_to_ix["hello"]])
one_hot_buffer = torch.eye(num_sentences)   

one_hot = one_hot_buffer[indices]
embed = embeddings(autograd.Variable(indices))

#print(embed.data.type())
#print(one_hot.data.type())
concatenated = torch.cat((embed,one_hot), 1)
print(concatenated)

But at the time of concatenation, I am getting this error 'RuntimeError: expected Variable as element 1 in argument 0, but got tuple’
As output of nn.embedding and hot vector are of different datatype.
What I am doing wrong and how can I solve this? looking for your suggestion. I am using pytorch 0.3.
As suggested by some solutions, I am trying to convert datatype of one_hot by appending .float() but it is also not working. Can someone please suggest me some solution for this.