modeling_xlnet.py lines 798  torch.eisum('i,d->id', pos_seq, inv_freq)
hi  I run position embedding in modeling_xlnet.py , but it not work  , why not torch.eisum('i,d->id', [pos_seq, inv_freq])  ?i use pytorch 0.4.1
I don't understand your question.

Can you give more details and point to the exact code lines you are referring to?

You cannot provide specific position indices to XLNet if that's what you are trying to do. You have to use the built-in relative embeddings.<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
<|||||>For new PyTorch 1.0, the syntax should be `torch.eisum('i,d->id', pos_seq, inv_freq) `<|||||>This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
