Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ This model is a fine-tuned version of the **Qwen2.5-0.5B-Instruct** model, speci
|
|
26 |
|
27 |
## How to Get Started with the Model
|
28 |
|
29 |
-
Use the code below to load and use the model:
|
30 |
|
31 |
```python
|
32 |
from unsloth import FastLanguageModel
|
@@ -46,8 +46,9 @@ model, tokenizer = FastLanguageModel.from_pretrained(
|
|
46 |
PROMPT = "How many r's are in the word strawberry?"
|
47 |
|
48 |
SYSTEM_PROMPT = """
|
49 |
-
A conversation between User and Assistant. The user asks a question,
|
50 |
-
|
|
|
51 |
Respond in the following format:
|
52 |
<reasoning>
|
53 |
...
|
|
|
26 |
|
27 |
## How to Get Started with the Model
|
28 |
|
29 |
+
Use the code below to load and use the model with vLLM & Unsloth:
|
30 |
|
31 |
```python
|
32 |
from unsloth import FastLanguageModel
|
|
|
46 |
PROMPT = "How many r's are in the word strawberry?"
|
47 |
|
48 |
SYSTEM_PROMPT = """
|
49 |
+
A conversation between User and Assistant. The user asks a question,
|
50 |
+
and the Assistant solves it. The assistant first thinks about the
|
51 |
+
reasoning process in the mind and then provides the user with the answer.
|
52 |
Respond in the following format:
|
53 |
<reasoning>
|
54 |
...
|