Files changed (1) hide show
  1. README.md +53 -41
README.md CHANGED
@@ -1,41 +1,53 @@
1
- ---
2
- base_model: Qwen/Qwen2.5-3B-Instruct
3
- language:
4
- - en
5
- library_name: transformers
6
- license: other
7
- license_name: qwen-research
8
- license_link: https://huggingface.co/Qwen/Qwen2.5-3B-Instruct/blob/main/LICENSE
9
- pipeline_tag: text-generation
10
- tags:
11
- - chat
12
- - mlx
13
- ---
14
-
15
- # TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea
16
-
17
- The Model [TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea](https://huggingface.co/TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea) was
18
- converted to MLX format from [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct)
19
- using mlx-lm version **0.20.2**.
20
-
21
- ## Use with mlx
22
-
23
- ```bash
24
- pip install mlx-lm
25
- ```
26
-
27
- ```python
28
- from mlx_lm import load, generate
29
-
30
- model, tokenizer = load("TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea")
31
-
32
- prompt="hello"
33
-
34
- if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
35
- messages = [{"role": "user", "content": prompt}]
36
- prompt = tokenizer.apply_chat_template(
37
- messages, tokenize=False, add_generation_prompt=True
38
- )
39
-
40
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
41
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-3B-Instruct
3
+ language:
4
+ - zho
5
+ - eng
6
+ - fra
7
+ - spa
8
+ - por
9
+ - deu
10
+ - ita
11
+ - rus
12
+ - jpn
13
+ - kor
14
+ - vie
15
+ - tha
16
+ - ara
17
+ library_name: transformers
18
+ license: other
19
+ license_name: qwen-research
20
+ license_link: https://huggingface.co/Qwen/Qwen2.5-3B-Instruct/blob/main/LICENSE
21
+ pipeline_tag: text-generation
22
+ tags:
23
+ - chat
24
+ - mlx
25
+ ---
26
+
27
+ # TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea
28
+
29
+ The Model [TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea](https://huggingface.co/TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea) was
30
+ converted to MLX format from [Qwen/Qwen2.5-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-3B-Instruct)
31
+ using mlx-lm version **0.20.2**.
32
+
33
+ ## Use with mlx
34
+
35
+ ```bash
36
+ pip install mlx-lm
37
+ ```
38
+
39
+ ```python
40
+ from mlx_lm import load, generate
41
+
42
+ model, tokenizer = load("TheBlueObserver/Qwen2.5-3B-Instruct-MLX-884ea")
43
+
44
+ prompt="hello"
45
+
46
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
47
+ messages = [{"role": "user", "content": prompt}]
48
+ prompt = tokenizer.apply_chat_template(
49
+ messages, tokenize=False, add_generation_prompt=True
50
+ )
51
+
52
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
53
+ ```