Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
shenxq
/
zephyr-7b-dpo-qlora-pairrm
like
0
PEFT
Safetensors
snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
mistral
alignment-handbook
Generated from Trainer
trl
dpo
4-bit precision
bitsandbytes
License:
apache-2.0
Model card
Files
Files and versions
Community
Use this model
main
zephyr-7b-dpo-qlora-pairrm
Commit History
End of training
26127fb
verified
shenxq
commited on
Mar 19, 2024
Model save
c7bc043
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 1200
25f422b
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 1100
f8012f2
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 1000
852b2c1
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 900
b054169
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 800
c055884
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 700
955a49a
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 600
1f1931e
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 500
d663666
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 400
d9f0d39
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 300
9946318
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 200
1952928
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 100
951dac4
verified
shenxq
commited on
Mar 19, 2024
End of training
193ff66
verified
shenxq
commited on
Mar 19, 2024
Model save
41409cb
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 1200
30a24a4
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 1100
36a33ec
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 1000
2909dcf
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 900
8a1b795
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 800
ac17e41
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 700
30b714d
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 600
71a19c5
verified
shenxq
commited on
Mar 19, 2024
Training in progress, step 500
d22a602
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 400
9485479
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 300
b3869fb
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 200
588e960
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 100
64c1231
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 700
517a830
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 600
ddeeaad
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 500
5f7d11c
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 400
2ff7a67
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 300
70a6103
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 200
966a90f
verified
shenxq
commited on
Mar 18, 2024
Training in progress, step 100
b2e7f86
verified
shenxq
commited on
Mar 18, 2024
initial commit
ada6e2b
verified
shenxq
commited on
Mar 18, 2024