Text Generation
Transformers
PyTorch
mistral
Not-For-All-Audiences
nsfw
text-generation-inference
Inference Endpoints
Sliding window
#1
by
saishf
- opened
Mentioned here it seems mistral 7b 0.2 doesn't use sliding window, the config was wrong for a while in the original repo and it is incorrect in this models repo
https://huggingface.co/alpindale/Mistral-7B-v0.2-hf/discussions/1
Got it