Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model:
|
| 4 |
+
- NeverSleep/Lumimaid-v0.2-12B
|
| 5 |
+
base_model_relation: quantized
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
library_name: safetensors
|
| 8 |
+
tags:
|
| 9 |
+
- exl3
|
| 10 |
+
- 4-bit
|
| 11 |
+
- 6-bit
|
| 12 |
+
- 8-bit
|
| 13 |
+
---
|
| 14 |
+
## EXL3 quants: [ [H8-4.0BPW](https://huggingface.co/DeathGodlike/Lumimaid-v0.2-12B_EXL3/tree/H8-4.0BPW) | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Lumimaid-v0.2-12B_EXL3/tree/H8-6.0BPW) | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Lumimaid-v0.2-12B_EXL3/tree/H8-8.0BPW) ]
|
| 15 |
+
|
| 16 |
+
# Original model: [Lumimaid-v0.2-12B](https://huggingface.co/NeverSleep/Lumimaid-v0.2-12B) by [NeverSleep](https://huggingface.co/NeverSleep)
|