Dynamic NTK


[(Experimental) Add support to NTK RoPE scaling](https://github.com/turboderp/exllama/pull/118)




> [Dynamically Scaled RoPE further increases performance of long context LLaMA with zero fine-tuning](https://www.reddit.com/r/LocalLLaMA/comments/14mrgpr/dynamically_scaled_rope_further_increases/)





