mradermacher
/

Llama-4-Scout-17B-6E-Instruct-GGUF

mixture of experts

Model card Files Files and versions Community

Llama-4-Scout-17B-6E-Instruct-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 16 commits

mradermacher's picture

uploaded from nico1

77c5724 verified 8 days ago

.gitattributes

2.63 kB

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.IQ4_XS.gguf

25.8 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q2_K.gguf

17.7 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q3_K_L.gguf

24.8 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q3_K_M.gguf

23 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q3_K_S.gguf

20.8 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q4_K_M.gguf

28.8 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q4_K_S.gguf

27.2 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q5_K_M.gguf

33.7 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q5_K_S.gguf

32.7 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q6_K.gguf

38.9 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q8_0.gguf.part1of2

25.8 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.Q8_0.gguf.part2of2
24.6 GB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.mmproj-Q8_0.gguf

931 MB
LFS

uploaded from nico1 8 days ago
Llama-4-Scout-17B-6E-Instruct.mmproj-f16.gguf

1.75 GB
LFS

uploaded from nico1 8 days ago
README.md

3.34 kB

auto-patch README.md 8 days ago