oscar128372 commited on
Commit
1cebca3
·
verified ·
1 Parent(s): 5f11ed5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -74,7 +74,7 @@ Believe it or not, this was by complete accident. I accidentally mixed in a reas
74
  Turns out, the reasoning dataset taught the model to **only** reason during more complex, multi-stepped prompts.
75
 
76
  # What you NEED to know before using:
77
- Number 1, you **cannot** load it in 4 bit. I was so confused on why it wasn't working. Loading it in 4 bit just removes the reasoning entirely and turns it into an actual base model, so win-win, I guess?
78
 
79
  Number 2, use the ChatML template:
80
  ```
 
74
  Turns out, the reasoning dataset taught the model to **only** reason during more complex, multi-stepped prompts.
75
 
76
  # What you NEED to know before using:
77
+ Number 1, you **cannot** load it in 4 bit. I was so confused on why it wasn't working. Loading it in 4 bit just removes the reasoning entirely and turns it into an actual base model, so if you don't want reasoning, that works, I guess? I don't really know why.
78
 
79
  Number 2, use the ChatML template:
80
  ```