Mungert
/

LiveCC-7B-Instruct-GGUF

Model card Files Files and versions

LiveCC-7B-Instruct-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 28 commits

Mungert's picture

Upload LiveCC-7B-Instruct-q8_0.gguf with huggingface_hub

65704a7 verified 4 months ago

.gitattributes

3.34 kB

Upload LiveCC-7B-Instruct-q8_0.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-bf16_q4_k.gguf

6.11 GB
xet

Upload LiveCC-7B-Instruct-bf16_q4_k.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-bf16_q6_k.gguf

7.54 GB
xet

Upload LiveCC-7B-Instruct-bf16_q6_k.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-bf16_q8_0.gguf

9.12 GB
xet

Upload LiveCC-7B-Instruct-bf16_q8_0.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-f16.gguf

15.2 GB
xet

Upload LiveCC-7B-Instruct-f16.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-f16_q4_k.gguf

6.11 GB
xet

Upload LiveCC-7B-Instruct-f16_q4_k.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-f16_q6_k.gguf

7.54 GB
xet

Upload LiveCC-7B-Instruct-f16_q6_k.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-f16_q8_0.gguf

9.12 GB
xet

Upload LiveCC-7B-Instruct-f16_q8_0.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-iq2_m.gguf

3.2 GB
xet

Upload LiveCC-7B-Instruct-iq2_m.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-iq2_s.gguf

3.07 GB
xet

Upload LiveCC-7B-Instruct-iq2_s.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-iq2_xs.gguf

2.76 GB
xet

Upload LiveCC-7B-Instruct-iq2_xs.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-iq2_xxs.gguf

2.62 GB
xet

Upload LiveCC-7B-Instruct-iq2_xxs.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-iq3_xs.gguf

3.41 GB
xet

Upload LiveCC-7B-Instruct-iq3_xs.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-iq3_xxs.gguf

3.26 GB
xet

Upload LiveCC-7B-Instruct-iq3_xxs.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q2_k_l.gguf

3.55 GB
xet

Upload LiveCC-7B-Instruct-q2_k_l.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q2_k_s.gguf

2.96 GB
xet

Upload LiveCC-7B-Instruct-q2_k_s.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q3_k_l.gguf

4.29 GB
xet

Upload LiveCC-7B-Instruct-q3_k_l.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q3_k_m.gguf

4.02 GB
xet

Upload LiveCC-7B-Instruct-q3_k_m.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q3_k_s.gguf

3.56 GB
xet

Upload LiveCC-7B-Instruct-q3_k_s.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q4_k_l.gguf

5.09 GB
xet

Upload LiveCC-7B-Instruct-q4_k_l.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q4_k_m.gguf

4.82 GB
xet

Upload LiveCC-7B-Instruct-q4_k_m.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q4_k_s.gguf

4.6 GB
xet

Upload LiveCC-7B-Instruct-q4_k_s.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q5_k_l.gguf

5.78 GB
xet

Upload LiveCC-7B-Instruct-q5_k_l.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q5_k_m.gguf

5.52 GB
xet

Upload LiveCC-7B-Instruct-q5_k_m.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q5_k_s.gguf

5.39 GB
xet

Upload LiveCC-7B-Instruct-q5_k_s.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q6_k_l.gguf

6.52 GB
xet

Upload LiveCC-7B-Instruct-q6_k_l.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q6_k_m.gguf

6.25 GB
xet

Upload LiveCC-7B-Instruct-q6_k_m.gguf with huggingface_hub 4 months ago
LiveCC-7B-Instruct-q8_0.gguf

8.1 GB
xet

Upload LiveCC-7B-Instruct-q8_0.gguf with huggingface_hub 4 months ago