Hm...
#1
by
woofwolfy
- opened
Q5KS and chatml, i dunno what is it (it happen with all qwen models)
Tagging Cran here.
Just to be sure check if you're running the latest version of KoboldCpp for inference.
Tagging Cran here.
Just to be sure check if you're running the latest version of KoboldCpp for inference.
Yeah, i use 1.75.2 version (upd: try figure out)
woofwolfy
changed discussion status to
closed