Wenboz/mistral-7b-base-p3o
Updated
Wenbo Zhang
Wenboz
AI & ML interests
Causal Inference, Out-of-distribuition Robustness, NLP
Recent Activity
updated
a dataset
1 day ago
Wenboz/rm_r1_example
published
a dataset
1 day ago
Wenboz/rm_r1_example
updated
a dataset
about 1 month ago
Wenboz/ultrafeedback_rationale_Qwen2.5-3B-Instruct_cot_v3
Organizations
None yet
models
16
Wenboz/zephyr-7b-dpo-full
Text Generation
•
1B
•
Updated
•
13
Wenboz/zephyr-7b-dpo-lora
Updated
•
3
Wenboz/llama3-wpo-lora
Updated
•
23
Wenboz/llama3-dpo-lora
Updated
•
7
Wenboz/zephyr-7b-wpo-lora
Updated
•
3
Wenboz/llama3-dpo-full
Updated
Wenboz/FsfairX-LLaMA3-RM-clone
8B
•
Updated
•
7
Wenboz/aromarm_clone
8B
•
Updated
•
4
Wenboz/phi3-offline-dpo-lora-noise-0.0-5e-7-thre-1.5-42
Updated
•
4
datasets
20
Wenboz/rm_r1_example
Viewer
•
Updated
•
100
Wenboz/ultrafeedback_rationale_Qwen2.5-3B-Instruct_cot_v3
Viewer
•
Updated
•
6
•
76
Wenboz/ultrafeedback_rationale_Qwen2.5-3B-Instruct_ultra_filter_2e-5_thre-0.8_packing_42_cot
Updated
•
9
Wenboz/ultrafeedback_rationale_Qwen2.5-3B-Instruct_ultra_sft_2e-5_thre-0.7_packing_42_cot
Viewer
•
Updated
•
63.1k
•
11
Wenboz/ultrafeedback_rationale_gemma-2-2b-it_cot
Viewer
•
Updated
•
10
•
32
Wenboz/ultrafeedback_rationale_Qwen2.5-3B-Instruct_cot
Viewer
•
Updated
•
63.1k
•
25
Wenboz/ultrafeedback_rationale_Qwen2.5-3B-Instruct_direct
Viewer
•
Updated
•
61.1k
•
28
Wenboz/ultrafeedback_rationale_Llama-3.2-3B-Instruct_cot
Viewer
•
Updated
•
61.1k
•
34
Wenboz/ultrafeedback_rationale_Qwen2.5-14B-Instruct
Viewer
•
Updated
•
8
•
27
Wenboz/llama3-instruct-reward-logps-ultrafeedback-v2
Viewer
•
Updated
•
61.8k
•
30