@cswhjiang
Did you manage to implement it. I am confused because when i put model.cuda(), won’t the embeddings also get to gpu as well.
If you did manage to implement it, would you mind sharing a snippet of it.
Thanks