How do I extend a Qwen3 model that has been pulled by Ollama using the YaRN method?

#1
by MikeNate - opened

I've pulled a model using the command ollama run hf.co/unsloth/Qwen3-30B-A3B-128K-GGUF:Q6_K.

How do I modify the config.json file to include rope_scaling as explained in the documentation?

Thanks for considering my query!

Unsloth AI org

I've pulled a model using the command ollama run hf.co/unsloth/Qwen3-30B-A3B-128K-GGUF:Q6_K.

How do I modify the config.json file to include rope_scaling as explained in the documentation?

Thanks for considering my query!

We already set it pretty sure in our params so when u download it, it should be set

Thank you @shimmyshimmer

I had tried it on Ollama but it wasn’t working for me. I’ll try it out again. Thanks!

Sign up or log in to comment