TheBloke
/

Mixtral_34Bx2_MoE_60B-GGUF

Model card Files Files and versions Community

Mixtral_34Bx2_MoE_60B-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit 52531fd)

b7e44d4 over 1 year ago

.gitattributes

1.8 kB

GGUF model commit (made with llama.cpp commit 52531fd) over 1 year ago
mixtral_34bx2_moe_60b.Q2_K.gguf

20.5 GB
LFS

GGUF model commit (made with llama.cpp commit 52531fd) over 1 year ago
mixtral_34bx2_moe_60b.Q3_K_M.gguf

26.8 GB
LFS

GGUF model commit (made with llama.cpp commit 52531fd) over 1 year ago
mixtral_34bx2_moe_60b.Q4_0.gguf

34.3 GB
LFS

GGUF model commit (made with llama.cpp commit 52531fd) over 1 year ago
mixtral_34bx2_moe_60b.Q4_K_M.gguf

34.4 GB
LFS

GGUF model commit (made with llama.cpp commit 52531fd) over 1 year ago