ROPE settings

#1
by Y4iges - opened

rope.JPG
Hello! Can you please explain what settings for ROPE I shoud enter to extend context lenght to 32k (as mentioned in model descr.)? I'm using LM-studio.

Owner

Hey;

Rope is covered in detail at the very bottom of this doc/repo page:

https://huggingface.co/DavidAU/TieFighter-Holodeck-Holomax-Mythomax-F1-V1-COMPOS-20B-gguf

Thanks,

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment