GGUF update needed due to eos token id change?
#2
by
async0x42
- opened
Hi bartowski, thanks for the GGUFs, there was this commit on the base repo before, do the GGUFs need to be updated? https://huggingface.co/trashpanda-org/QwQ-32B-Snowdrop-v0/commit/ce75c91128db70056f8e7dfffe1d2431075d0e85
Actually if you check the GGUF metadata you can see:
tokenizer.ggml.eos_token_id 151645
So llama.cpp must have pulled the eos token from somewhere other than config.json, so it's configured properly already :)
Interesting, thanks; that's great to know!
async0x42
changed discussion status to
closed