-
AmberYifan/llama2-7b-sft-ultrachat-safeRLHF
Text Generation • Updated • 16 -
AmberYifan/mistral-v0.1-7b-sft-ultrachat-safeRLHF
Text Generation • Updated • 17 -
AmberYifan/Mistral-7B-v0.3-sft-ultrachat-safeRLHF
Text Generation • Updated • 14 -
AmberYifan/Gemma-2-9B-sft-ultrachat-safeRLHF
Text Generation • Updated • 12
Yifan Wang
AmberYifan
AI & ML interests
None yet
Recent Activity
updated
a model
about 23 hours ago
AmberYifan/Qwen2.5-7B-Instruct-wildfeedback
published
a model
about 24 hours ago
AmberYifan/Qwen2.5-7B-Instruct-wildfeedback
updated
a model
1 day ago
AmberYifan/Qwen2.5-7B-Instruct-userfeedback
Organizations
Collections
2
This collection contains safetyQA dataset for safe SPIN training and trained models
models
423
AmberYifan/Qwen2.5-7B-Instruct-wildfeedback
Text Generation
•
Updated
•
3
•
1
AmberYifan/Qwen2.5-7B-Instruct-userfeedback
Text Generation
•
Updated
•
8
•
1
AmberYifan/Llama-3.1-8B-sft-gen-dpo-iter3
Text Generation
•
Updated
•
3
AmberYifan/Qwen2.5-7B-sft-peers-pool-KTO
Text Generation
•
Updated
•
4
AmberYifan/Qwen2.5-7B-sft-all-pool-KTO
Text Generation
•
Updated
•
4
AmberYifan/Qwen2.5-7B-sft-SPIN-Qwen2.5-72B-Instruct-KTO
Text Generation
•
Updated
•
6
AmberYifan/Qwen2.5-7B-sft-peers-pool-ORPO
Text Generation
•
Updated
•
9
AmberYifan/Qwen2.5-7B-sft-SPIN-gpt4o-KTO
Text Generation
•
Updated
•
7
AmberYifan/Qwen2.5-7B-sft-SPIN-Qwen2.5-72B-Instruct-ORPO
Text Generation
•
Updated
•
6
AmberYifan/Qwen2.5-7B-sft-dpo-10k-KTO
Text Generation
•
Updated
•
6
datasets
25
AmberYifan/mistral-v0.1-spin-hhrlhf
Viewer
•
Updated
•
5.5k
•
12
AmberYifan/sft-spin-filter
Updated
•
6
AmberYifan/sft-spin-kcenter-5k
Viewer
•
Updated
•
5.5k
•
9
AmberYifan/gsm8k-sft
Viewer
•
Updated
•
8.79k
•
11
AmberYifan/sft-spin-v
Viewer
•
Updated
•
50.5k
•
8
AmberYifan/safeRLHF-SFT
Viewer
•
Updated
•
83.4k
•
10
AmberYifan/SPIN-trans-DPOformat
Viewer
•
Updated
•
55k
•
9
AmberYifan/spin-v-diverse
Viewer
•
Updated
•
55k
•
7
AmberYifan/dpo-v
Viewer
•
Updated
•
55k
•
17
AmberYifan/spin-v
Viewer
•
Updated
•
55k
•
10