Update README.md
Browse files
README.md
CHANGED
@@ -74,7 +74,7 @@ Believe it or not, this was by complete accident. I accidentally mixed in a reas
|
|
74 |
Turns out, the reasoning dataset taught the model to **only** reason during more complex, multi-stepped prompts.
|
75 |
|
76 |
# What you NEED to know before using:
|
77 |
-
Number 1, you **cannot** load it in 4 bit. I was so confused on why it wasn't working. Loading it in 4 bit just removes the reasoning entirely and turns it into an actual base model, so
|
78 |
|
79 |
Number 2, use the ChatML template:
|
80 |
```
|
|
|
74 |
Turns out, the reasoning dataset taught the model to **only** reason during more complex, multi-stepped prompts.
|
75 |
|
76 |
# What you NEED to know before using:
|
77 |
+
Number 1, you **cannot** load it in 4 bit. I was so confused on why it wasn't working. Loading it in 4 bit just removes the reasoning entirely and turns it into an actual base model, so if you don't want reasoning, that works, I guess? I don't really know why.
|
78 |
|
79 |
Number 2, use the ChatML template:
|
80 |
```
|