ikawrakow
/

mixtral-instruct-8x7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

mixtral-instruct-8x7b-quantized-gguf

1 contributor

History: 7 commits

ikawrakow's picture

Adding IQ3_XSS and fixed medium models

0c06c11 10 months ago

.gitattributes

1.56 kB

Adding k-quants 10 months ago
README.md

1.82 kB

Update README.md 10 months ago
mixtral-instruct-8x7b-iq3-xxs.gguf

18.3 GB
LFS

Adding IQ3_XSS and fixed medium models 10 months ago
mixtral-instruct-8x7b-q2k.gguf

15.4 GB
LFS

Adding k-quants 10 months ago
mixtral-instruct-8x7b-q3k-medium.gguf

22.5 GB
LFS

Adding IQ3_XSS and fixed medium models 10 months ago
mixtral-instruct-8x7b-q3k-small.gguf

20.3 GB
LFS

Adding k-quants 10 months ago
mixtral-instruct-8x7b-q40.gguf

26.4 GB
LFS

Adding legacy ggml quants 10 months ago
mixtral-instruct-8x7b-q41.gguf

29.3 GB
LFS

Adding legacy ggml quants 10 months ago
mixtral-instruct-8x7b-q4k-medium.gguf

28.4 GB
LFS

Adding IQ3_XSS and fixed medium models 10 months ago
mixtral-instruct-8x7b-q4k-small.gguf

26.7 GB
LFS

Had somehow missed to add Q4_K_S 10 months ago
mixtral-instruct-8x7b-q50.gguf

32.2 GB
LFS

Adding legacy ggml quants 10 months ago
mixtral-instruct-8x7b-q5k-small.gguf

32.2 GB
LFS

Fixed wrong file name 10 months ago