Perm Mask in XLNet
## ❓ Questions & Help

<!-- A clear and concise description of the question. -->
"Mask to indicate the attention pattern for each input token with values selected in [0, 1]: **If perm_mask[k, i, j] = 0, i attend to j in batch k; if perm_mask[k, i, j] = 1**, i does not attend to j in batch k. If None, each token attends to all the others (full bidirectional attention). Only used during pretraining (to define factorization order) or for sequential decoding (generation)."
Can you confirm this is not the reverse i attend to j in batch k **if perm_mask[k, i, j] = 1** ?
Thanks a lot for your great work!
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
