MikeRoz

/

TheDrummer_Fallen-Llama-3.3-R1-70B-v1-4.25bpw-h6-exl2

like 0

There's a dev branch of exllamav2 with support for Gemma, but it has problems. It becomes incoherent after about 8k context. If Turboderp or someone else ever finds and fixes the problem, I will make quants if nobody else has by the time I notice.

Ah... I didn't know that, what a shame, let's wait then, thanks!