mistralai

/

Mistral-Large-Instruct-2407

like 801

Follow

Mistral AI_ 2,564

+1
To run the model at 128k, should we extend the max_position_embeddings or is there some sort of RoPE Scaling configuration that we should apply?

+1
Currently only support 32k with vllm deployment test.

Dear developers. Please clarify. In your blog you write about 128k, but the model says “max_position_embeddings”: 32768.
What to believe?

Hi! Should be fixed soon: https://huggingface.co/mistralai/Mistral-Large-Instruct-2407/discussions/11
Its indeed 128k!! 🔥