Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
- pytorch
|
| 12 |
- transformers
|
| 13 |
---
|
| 14 |
-
Created using llama.cpp b5202: `llama.cpp/build/bin/llama-quantize MAI-DS-R1-bf16-00001-of-00030.gguf MAI-DS-R1-tq1_0 TQ1_0`.
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
|
|
|
|
| 11 |
- pytorch
|
| 12 |
- transformers
|
| 13 |
---
|
| 14 |
+
Created using llama.cpp b5202: `llama.cpp/build/bin/llama-quantize MAI-DS-R1-bf16-00001-of-00030.gguf MAI-DS-R1-tq1_0 TQ1_0`. You can download q8 with bf16 embedding and bf16 output gguf here: https://huggingface.co/GeorgyGUF/MAI-DS-R1-q8-with-bf16-embedding-and-bf16-output.gguf
|
| 15 |
|
| 16 |
## Model Details
|
| 17 |
|