Any plans for a dynamic quant Llama 3.3?

#1
by cuts2k - opened

Hey, I realize there are a lot of new models coming out every week but Llama 3.3 is still one of the best available for fine-tuning, especially since with unsloth it can be trained on a single h100. Was curious if there are any plans to release a dynamic 4bit quant for it as well?

Sign up or log in to comment