euclaise commited on
Commit
dbbcb88
·
1 Parent(s): f6905cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ datasets:
7
 
8
  Expirements in large-scale small-scale preference learning.
9
 
10
- falcon-rw-1b trained with PRO (preference ranking optimization, see https://arxiv.org/abs/2306.17492) on SuperMC and PRM800K for 3 epochs, using my supertrainer2000 framework.
11
 
12
  This is an expiremental model.
13
 
 
7
 
8
  Expirements in large-scale small-scale preference learning.
9
 
10
+ falcon-rw-1b trained with PRO (preference ranking optimization, see https://arxiv.org/abs/2306.17492) on SuperMC and PRM800K (only stage 1) for 3 epochs, using my supertrainer2000 framework.
11
 
12
  This is an expiremental model.
13