Brianpuz commited on
Commit
9c7e1cf
·
verified ·
1 Parent(s): ebaccf5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2-0.5B-Instruct
3
+ language:
4
+ - en
5
+ license: apache-2.0
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - chat
9
+ - llama-cpp
10
+ - gguf-my-repo
11
+ ---
12
+
13
+ # Brianpuze/Qwen2-0.5B-Instruct-Q4_K_M-GGUF
14
+ Absolutely tremendous! This repo features **GGUF quantized** versions of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) — made possible using the *very powerful* `llama.cpp`. Believe me, it's fast, it's smart, it's winning.
15
+
16
+ ## Quantized Versions:
17
+ Only the best quantization. You’ll love it.
18
+
19
+ ## Run with llama.cpp
20
+ Just plug it in, hit the command line, and boom — you're running world-class AI, folks:
21
+
22
+ ```bash
23
+ llama-cli --hf-repo Brianpuze/Qwen2-0.5B-Instruct-Q4_K_M-GGUF --hf-file qwen2-0.5b-instruct-q4_k_m.gguf -p "AI First, but also..."
24
+ ```
25
+
26
+ This beautiful Hugging Face Space was brought to you by the **amazing team at [Antigma Labs](https://antigma.ai)**. Great people. Big vision. Doing things that matter — and doing them right.
27
+
28
+ Total winners.