Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
updated
a collection
4 days ago
Qwen3
updated
a model
4 days ago
nbeerbower/Yanfei-v2-Qwen3-32B
updated
a model
5 days ago
nbeerbower/Menghua-Qwen3-32B-lora
Organizations
Collections
8
models
217
nbeerbower/Yanfei-v2-Qwen3-32B
Text Generation
•
Updated
•
40
•
1
nbeerbower/Menghua-Qwen3-32B-lora
Updated
•
13
nbeerbower/Zhiming-Qwen3-32B-lora
Updated
•
11
nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B
Updated
•
12
nbeerbower/Vitus-Qwen3-14B
Updated
•
15
nbeerbower/Vitus-mistral-nemo-12B
Updated
•
39
nbeerbower/Yanfei-Qwen3-32B
Text Generation
•
Updated
•
56
•
1
nbeerbower/Schreiber-mistral-nemo-12B
Text Generation
•
Updated
•
151
•
1
nbeerbower/Qwen3-Gutenberg-Encore-14B
Text Generation
•
Updated
•
71
•
3
nbeerbower/Mistral-Nemo-Gutenberg-Encore-12B
Text Generation
•
Updated
•
177
•
10
datasets
14
nbeerbower/YanfeiMix-DPO
Viewer
•
Updated
•
22.4k
•
105
nbeerbower/human-writing-dpo
Updated
•
114
•
2
nbeerbower/NikuX2-DPO
Viewer
•
Updated
•
333
•
115
nbeerbower/NikuX1-DPO
Viewer
•
Updated
•
20
•
158
nbeerbower/cover-images
Viewer
•
Updated
•
10
•
641
•
1
nbeerbower/synthetic-fiction-dpo
Viewer
•
Updated
•
550
•
147
•
1
nbeerbower/GreatFirewall-DPO
Viewer
•
Updated
•
492
•
72
•
9
nbeerbower/reddit-dpo
Viewer
•
Updated
•
76.9k
•
37
•
1
nbeerbower/gutenberg-moderne-dpo
Viewer
•
Updated
•
346
•
73
•
3
nbeerbower/gutenberg2-dpo
Viewer
•
Updated
•
293
•
54
•
20