Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
trl-lib
's Collections
Comparing DPO with IPO and KTO
Online-DPO
Online-DPO
updated
Aug 2
Upvote
-
trl-lib/pythia-1b-deduped-tldr-online-dpo
Updated
Aug 2
•
9
trl-lib/pythia-1b-deduped-tldr-sft
Updated
Aug 2
•
3.87k
trl-lib/pythia-6.9b-deduped-tldr-online-dpo
Updated
Aug 2
•
9
trl-lib/pythia-2.8b-deduped-tldr-sft
Updated
Aug 2
•
594
trl-lib/pythia-2.8b-deduped-tldr-rm
Updated
Aug 2
•
135
trl-lib/pythia-6.9b-deduped-tldr-sft
Updated
Aug 2
•
586
trl-lib/pythia-6.9b-deduped-tldr-rm
Updated
Aug 2
•
285
trl-lib/pythia-1b-deduped-tldr-offline-dpo
Text Generation
•
Updated
Aug 2
•
10
trl-lib/pythia-2.8b-deduped-tldr-offline-dpo
Text Generation
•
Updated
Aug 2
•
12
trl-lib/pythia-6.9b-deduped-tldr-offline-dpo
Text Generation
•
Updated
Aug 2
•
15
trl-lib/pythia-2.8b-deduped-tldr-online-dpo
Text Generation
•
Updated
Aug 2
•
43
Upvote
-
Share collection
View history
Collection guide
Browse collections