Hugging Face's logo

tuantran1632001
/
Psyfighter2-Orca2-13B-ties-GGUF

GGUF
GGUF
KoboldAI/LLaMA2-13B-Psyfighter2
microsoft/Orca-2-13b
Model card Files Community
tuantran1632001 commited on
Commit
b9980b3
•
1 Parent(s): 3aef66e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -1
README.md CHANGED
@@ -11,4 +11,22 @@ quantized_by: tuantran1632001
11
  base_model: tuantran1632001/Psyfighter2-Orca2-13B-ties
12
  ---
13
 
14
- This is the GGUF quantize of the merged model [tuantran1632001/Psyfighter2-Orca2-13B-ties](https://huggingface.co/tuantran1632001/Psyfighter2-Orca2-13B-ties).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  base_model: tuantran1632001/Psyfighter2-Orca2-13B-ties
12
  ---
13
 
14
+ This is the GGUF quantize of the merged model [tuantran1632001/Psyfighter2-Orca2-13B-ties](https://huggingface.co/tuantran1632001/Psyfighter2-Orca2-13B-ties).
15
+
16
+ | File | Quantize | Size |
17
+ |------|----------|------|
18
+ | [Psyfighter2-Orca2-13B-ties-fp16.gguf](Psyfighter2-Orca2-13B-ties-fp16.gguf) | fp16 | 25GiB |
19
+ | [Psyfighter2-Orca2-13B-ties-Q2_K.gguf](Psyfighter2-Orca2-13B-ties-Q2_K.gguf) | Q2_K | 5.1GiB |
20
+ | [Psyfighter2-Orca2-13B-ties-Q3_K_L.gguf](Psyfighter2-Orca2-13B-ties-Q3_K_L.gguf) | Q3_K_L | 6.5GiB |
21
+ | [Psyfighter2-Orca2-13B-ties-Q3_K_M.gguf](Psyfighter2-Orca2-13B-ties-Q3_K_M.gguf) | Q3_K_M | 6.0GiB |
22
+ | [Psyfighter2-Orca2-13B-ties-Q3_K_S.gguf](Psyfighter2-Orca2-13B-ties-Q3_K_S.gguf) | Q3_K_S | 5.3GiB |
23
+ | [Psyfighter2-Orca2-13B-ties-Q4_0.gguf](Psyfighter2-Orca2-13B-ties-Q4_0.gguf) | Q4_0 | 6.9GiB |
24
+ | [Psyfighter2-Orca2-13B-ties-Q4_1.gguf](Psyfighter2-Orca2-13B-ties-Q4_1.gguf) | Q4_1 | 6.8GiB |
25
+ | [Psyfighter2-Orca2-13B-ties-Q4_K_M.gguf](Psyfighter2-Orca2-13B-ties-Q4_K_M.gguf) | Q4_K_M | 7.7GiB |
26
+ | [Psyfighter2-Orca2-13B-ties-Q4_K_S.gguf](Psyfighter2-Orca2-13B-ties-Q4_K_S.gguf) | Q4_K_S | 7.0GiB |
27
+ | [Psyfighter2-Orca2-13B-ties-Q5_0.gguf](Psyfighter2-Orca2-13B-ties-Q5_0.gguf) | Q5_0 | 8.4GiB |
28
+ | [Psyfighter2-Orca2-13B-ties-Q5_1.gguf](Psyfighter2-Orca2-13B-ties-Q5_1.gguf) | Q5_1 | 9.2GiB |
29
+ | [Psyfighter2-Orca2-13B-ties-Q5_K_M.gguf](Psyfighter2-Orca2-13B-ties-Q5_K_M.gguf) | Q5_K_M | 8.6GiB |
30
+ | [Psyfighter2-Orca2-13B-ties-Q5_K_S.gguf](Psyfighter2-Orca2-13B-ties-Q5_K_S.gguf) | Q5_K_S | 8.4GiB |
31
+ | [Psyfighter2-Orca2-13B-ties-Q6_K.gguf](Psyfighter2-Orca2-13B-ties-Q6_K.gguf) | Q6_K | 10GiB |
32
+ | [Psyfighter2-Orca2-13B-ties-Q8_0.gguf](Psyfighter2-Orca2-13B-ties-Q8_0.gguf) | Q8_0 | 13GiB |