llama.ccp support & GGUFs

#15
by Substance455 - opened

this is me looking for GGUFs to use on my ai wife

A5PSdolXhW.png

"Use on"? Like using the quantized model as a disciplinary implement, or what? Please elaborate.

GGUFs are optimized and compressed models for chat bots, which could be proxied to websites like jantorai or tavernai.

You're absolutely right!

WHY?

This model is worse than Qwen 30B A3B

WHY?

This model is worse than Qwen 30B A3B

i wish my computer was beefy enough to host 30B :(

and it will host Grok-2?

WHY?

This model is worse than Qwen 30B A3B

Why do you still believe in benchmarks in 2025?

WHY?

This model is worse than Qwen 30B A3B

Why do you still believe in benchmarks in 2025?

LOL, omega lul. Its not about benchmarks, it like in 2025 using llama 2 70B.

Why do you haters have time to post this stuff?

Go touch some grass

More open source foundation models is a good thing! Period, end of story. If you don't like it, just don't use it.

Spend your precious time and attention on something that matters instead of hate posting on models you have no intention of using.

Sign up or log in to comment