mradermacher
/

annie-lite-v0.2.4-qwen3-8b-GGUF

text-generation-inference

Model card Files Files and versions

annie-lite-v0.2.4-qwen3-8b-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 16 commits

mradermacher's picture

auto-patch README.md

1a5f12b verified about 23 hours ago

.gitattributes

2.41 kB

uploaded from leia about 23 hours ago
README.md

3.99 kB

auto-patch README.md about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.IQ4_XS.gguf

4.59 GB
xet

uploaded from leia about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.Q2_K.gguf

3.28 GB
xet

uploaded from leia about 24 hours ago
annie-lite-v0.2.4-qwen3-8b.Q3_K_L.gguf

4.43 GB
xet

uploaded from leia about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.Q3_K_M.gguf

4.12 GB
xet

uploaded from leia about 24 hours ago
annie-lite-v0.2.4-qwen3-8b.Q3_K_S.gguf

3.77 GB
xet

uploaded from leia about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.Q4_K_M.gguf

5.03 GB
xet

uploaded from leia about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.Q4_K_S.gguf

4.8 GB
xet

uploaded from leia about 24 hours ago
annie-lite-v0.2.4-qwen3-8b.Q5_K_M.gguf

5.85 GB
xet

uploaded from leia about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.Q5_K_S.gguf

5.72 GB
xet

uploaded from leia about 23 hours ago
annie-lite-v0.2.4-qwen3-8b.Q6_K.gguf

6.73 GB
xet

uploaded from leia about 24 hours ago
annie-lite-v0.2.4-qwen3-8b.Q8_0.gguf

8.71 GB
xet

uploaded from leia about 24 hours ago
annie-lite-v0.2.4-qwen3-8b.f16.gguf

16.4 GB
xet

uploaded from leia about 24 hours ago