position embedding 1026 while sequence length allowed 1024?
#34
by
wahaha1987
- opened
I am confused with the discrepancy among the following three numbers:
- the max sequence length is 1024
- the token id max length of a pair of query and document is 1026
- the position embedding is 1026
How come?