Quant-Cartel
/

experiment_2_8b-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

experiment_2_8b-iMat-GGUF

1 contributor

History: 8 commits

InferenceIllusionist's picture

InferenceIllusionist

Upload experiment_2_8b-iMat-IQ4_XS.gguf

073b62f verified 9 months ago

.gitattributes

1.86 kB

Upload experiment_2_8b-iMat-IQ4_XS.gguf 9 months ago
README.md

2.04 kB

Update README.md 9 months ago
experiment_2_8b-iMat-IQ4_XS.gguf

4.45 GB
LFS

Upload experiment_2_8b-iMat-IQ4_XS.gguf 9 months ago
experiment_2_8b-iMat-Q4_K_M.gguf

4.92 GB
LFS

Upload experiment_2_8b-iMat-Q4_K_M.gguf 9 months ago
experiment_2_8b-iMat-Q5_K_M.gguf

5.73 GB
LFS

Upload experiment_2_8b-iMat-Q5_K_M.gguf 9 months ago
experiment_2_8b-iMat-Q6_K.gguf

6.6 GB
LFS

Upload experiment_2_8b-iMat-Q6_K.gguf 9 months ago
experiment_2_8b-iMat-Q8_0.gguf

8.54 GB
LFS

Upload experiment_2_8b-iMat-Q8_0.gguf 9 months ago