AI & ML interests
None defined yet.
Recent Activity
Organization Card
This is the organization grouping all the models and datasets used in the TRL library.
spaces
7
Running
4
Dataset Length Profiler
👁
Estimate optimal max_length for SFT training
Running
Trackio2
🚀
Visualize project metrics with Trackio Dashboard
Running
Recommend Vllm Memory
😻
Estimate GPU memory needed for model training
Running
1
Train
🏋
Display Markdown instructions for TRL jobs
Sleeping
Job
🌖
Submit text to get processed output
Running
9
TextEnvironments
⚒
models
81
trl-lib/Qwen2-0.5B-Reward-Math-Sheperd
Token Classification
•
0.5B
•
Updated
•
21
•
1
trl-lib/Qwen2-0.5B-XPO
Text Generation
•
0.5B
•
Updated
•
14
•
trl-lib/Qwen2-0.5B-OnlineDPO
Text Generation
•
0.5B
•
Updated
•
12
•
trl-lib/Qwen2-0.5B-KTO
Text Generation
•
0.5B
•
Updated
•
7
trl-lib/Qwen2-0.5B-ORPO
Text Generation
•
0.5B
•
Updated
•
8
•
2
trl-lib/Qwen2-0.5B-DPO
Text Generation
•
0.5B
•
Updated
•
67
•
5
trl-lib/Qwen2-0.5B-Reward
Text Classification
•
0.5B
•
Updated
•
409
•
1
trl-lib/pythia-1b-deduped-tldr-rm
Updated
•
1.49k
trl-lib/pythia-2.8b-deduped-tldr-online-dpo
Text Generation
•
3B
•
Updated
•
14
trl-lib/pythia-6.9b-deduped-tldr-offline-dpo
Text Generation
•
7B
•
Updated
•
7
datasets
20
trl-lib/documentation-images
Viewer
•
Updated
•
7
•
102k
trl-lib/OpenMathReasoning
Viewer
•
Updated
•
3.2M
•
116
trl-lib/chatbot_arena_completions
Viewer
•
Updated
•
33k
•
199
•
1
trl-lib/rlaif-v
Viewer
•
Updated
•
83.1k
•
127
•
3
trl-lib/ultrafeedback-gpt-3.5-turbo-helpfulness
Viewer
•
Updated
•
16.6k
•
129
•
2
trl-lib/ultrafeedback-prompt
Viewer
•
Updated
•
39.8k
•
248
•
5
trl-lib/tldr-preference
Viewer
•
Updated
•
179k
•
109
•
2
trl-lib/tldr
Viewer
•
Updated
•
130k
•
8.53k
•
20
trl-lib/prm800k
Viewer
•
Updated
•
41.2k
•
50
•
2
trl-lib/math_shepherd
Viewer
•
Updated
•
445k
•
4.75k
•
8