Still no GGUF uploads?
#1
by
mingyi456
- opened
It has been 3 days since the repo was created, but there are still no actual GGUFs available. Is there something wrong with the chat template, or some other bug? From what I see on LM Studio, and using
@Bartowski
's quant, there appears to be a chat template issue, and after manually copying the chat template over, there seems to be a serious repetition issue.
Are you guys experiencing something similar, and thus choosing not to release any GGUFs yet?
About the repetition issue did you try presence_penalty 1.5 ? They suggest that on their modelcard and for me it solved the issue.
But I'm closely watching here too, but it seems other models got priority in their queue 🥹 Patience ;)