Device Map Auto not supported and Is there any way to increase the length of input sequence ????
#5
by
ideepankarsharma2003
- opened
Is there any way to increase the length of the input sequence?
This checkpoint is initialized from BertModel, which uses absolute position embeddings and restricts the length to 512. I have noticed that some people have proposed methods for expanding the input length, please refer to https://huggingface.co/thenlper/gte-large/discussions/9
But since this 512 could be expanded right