Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ datasets:
|
|
7 |
|
8 |
Expirements in large-scale small-scale preference learning.
|
9 |
|
10 |
-
falcon-rw-1b trained with PRO (preference ranking optimization, see https://arxiv.org/abs/2306.17492) on SuperMC and PRM800K for 3 epochs, using my supertrainer2000 framework.
|
11 |
|
12 |
This is an expiremental model.
|
13 |
|
|
|
7 |
|
8 |
Expirements in large-scale small-scale preference learning.
|
9 |
|
10 |
+
falcon-rw-1b trained with PRO (preference ranking optimization, see https://arxiv.org/abs/2306.17492) on SuperMC and PRM800K (only stage 1) for 3 epochs, using my supertrainer2000 framework.
|
11 |
|
12 |
This is an expiremental model.
|
13 |
|