TheDrummer
/

Rocinante-12B-v1.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Rocinante-12B-v1.1-GGUF

1 contributor

History: 6 commits

TheDrummer's picture

Update README.md

e4d6df8 verified 3 months ago

.gitattributes

2.04 kB

Upload folder using huggingface_hub 3 months ago
README.md

2.2 kB

Update README.md 3 months ago
Rocinante-12B-v1.1-BF16.gguf

24.5 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-F16.gguf

24.5 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-Q2_K.gguf

4.79 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-Q3_K_M.gguf

6.08 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-Q4_K_M.gguf

7.48 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-Q5_K_M.gguf

8.73 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-Q6_K.gguf

10.1 GB
LFS

Upload folder using huggingface_hub 3 months ago
Rocinante-12B-v1.1-Q8_0.gguf

13 GB
LFS

Upload folder using huggingface_hub 3 months ago