Commit
•
0475128
1
Parent(s):
5830e38
Update README.md
Browse files
README.md
CHANGED
|
@@ -62,6 +62,14 @@ Sometimes the model "spells out" the stop token as `</s>` like Capybara, so you
|
|
| 62 |
|
| 63 |
***
|
| 64 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
Credits:
|
| 66 |
|
| 67 |
https://github.com/cg123/mergekit/tree/dare
|
|
|
|
| 62 |
|
| 63 |
***
|
| 64 |
|
| 65 |
+
I run Yi models in exui for maximum context size on 24GB GPUs. You can fit about 47K context on an empty GPU at 4bpw, and exui's speed really helps at high context:
|
| 66 |
+
|
| 67 |
+
https://github.com/turboderp/exui
|
| 68 |
+
|
| 69 |
+
https://huggingface.co/brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties-exl2-4bpw-fiction
|
| 70 |
+
|
| 71 |
+
***
|
| 72 |
+
|
| 73 |
Credits:
|
| 74 |
|
| 75 |
https://github.com/cg123/mergekit/tree/dare
|