Max Model Input Length

#11
by sushant-m-nair - opened

Hello dear @maintainers,
Can you please tell what is the maximum number of tokens that the model can accept at a time? I am having difficulty finding documentation that reveals this.

Thanks

Falcons.ai org

1024 if I remember correctly. It is based on the T5small model

mstatt changed discussion status to closed

Actually, I found out later...
It is 512

Sign up or log in to comment