Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- ewof/koishi-instruct-metharme
|
4 |
+
- PygmalionAI/PIPPA
|
5 |
+
---
|
6 |
+
|
7 |
+
just testing for now, qlora marge, several things different between this and the 7b
|
8 |
+
|
9 |
+
https://rentry.org/v43eo updated the rentry slightly
|
10 |
+
|
11 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f38f3a89203d118da8b477/HkWCy5CQwlBGEpmmLAwuO.png)
|
12 |
+
|
13 |
+
NousResearch/Llama-2-13b-hf tuned on koishi data (without code subsets) for 1 epoch
|
14 |
+
|
15 |
+
then tuned on pippa for 1 epoch
|
16 |
+
|
17 |
+
then tuned on limarp (without ponyville, lolicit, all the fallen, and eka's portal subsets) for 2 epochs
|
18 |
+
|
19 |
+
all metharme format
|