How do I extend a Qwen3 model that has been pulled by Ollama using the YaRN method?
#1
by
MikeNate
- opened
I've pulled a model using the command ollama run hf.co/unsloth/Qwen3-30B-A3B-128K-GGUF:Q6_K
.
How do I modify the config.json
file to include rope_scaling
as explained in the documentation?
Thanks for considering my query!
I've pulled a model using the command
ollama run hf.co/unsloth/Qwen3-30B-A3B-128K-GGUF:Q6_K
.How do I modify the
config.json
file to includerope_scaling
as explained in the documentation?Thanks for considering my query!
We already set it pretty sure in our params so when u download it, it should be set
Thank you @shimmyshimmer
I had tried it on Ollama but it wasn’t working for me. I’ll try it out again. Thanks!