mradermacher
/

shivneri-marathi-llm-7b-v0.1-i1-GGUF

Model card Files Files and versions Community

shivneri-marathi-llm-7b-v0.1-i1-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 17 commits

mradermacher's picture

uploaded from kaos

0742517 verified 16 days ago

.gitattributes

2.68 kB

uploaded from kaos 16 days ago
README.md

244 Bytes

uploaded from kaos 16 days ago
imatrix.dat

4.94 MB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ1_M.gguf

2.32 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ2_M.gguf

3.13 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ2_XXS.gguf

2.59 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ3_M.gguf

4.11 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ3_XXS.gguf

3.49 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ4_NL.gguf

5.01 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-IQ4_XS.gguf

4.77 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q2_K.gguf

3.48 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q2_K_S.gguf

3.25 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q3_K_M.gguf

4.37 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q3_K_S.gguf

3.98 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q4_K_M.gguf

5.33 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q4_K_S.gguf

5.05 GB
LFS

uploaded from kaos 16 days ago
shivneri-marathi-llm-7b-v0.1.i1-Q6_K.gguf

7.01 GB
LFS

uploaded from kaos 16 days ago