SongTonyLi/Llama-3.2-3B-Instruct-CPT-D1_chosen-then-SFT-D2_chosen-pref-mix
Text Generation
•
3B
•
Updated
•
10
Song Li
SongTonyLi
AI & ML interests
None yet
Organizations
models
150
SongTonyLi/Llama-3.2-3B-Instruct-CPT-D1_chosen-pref-mix
Text Generation
•
3B
•
Updated
•
7
SongTonyLi/Llama-3.2-3B-Instruct-CPT-D_chosen-pref-mix
Text Generation
•
3B
•
Updated
•
16
SongTonyLi/Llama-3.2-3B-Instruct-SFT-D1_chosen-then-D2_chosen-pref-mix
Text Generation
•
3B
•
Updated
•
7
SongTonyLi/Llama-3.2-3B-Instruct-SFT-D1_chosen-pref-mix
Text Generation
•
3B
•
Updated
•
9
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D1_chosen-then-SFT-D2_chosen-pref-mix2
Text Generation
•
1B
•
Updated
•
12
•
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D1_chosen-pref-mix2
Text Generation
•
1B
•
Updated
•
28
•
SongTonyLi/Llama-3.2-1B-Instruct-CPT-D_chosen-pref-mix2
Text Generation
•
1B
•
Updated
•
24
•
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D1_chosen-then-D2_chosen-pref-mix2
Text Generation
•
1B
•
Updated
•
22
•
SongTonyLi/Llama-3.2-1B-Instruct-SFT-D1_chosen-pref-mix2
Text Generation
•
1B
•
Updated
•
12
•
datasets
23
SongTonyLi/llama_1B_dolly_15k_data
Viewer
•
Updated
•
15k
•
36
SongTonyLi/llama_1B_stem_data
Viewer
•
Updated
•
151k
•
41
SongTonyLi/supernova_17k
Viewer
•
Updated
•
178k
•
33
SongTonyLi/tachibana_coding_10k
Viewer
•
Updated
•
104k
•
30
SongTonyLi/Magpie-Pro-Ultra-40K
Viewer
•
Updated
•
41.4k
•
30
SongTonyLi/Magpie-Pro-hard-8K
Viewer
•
Updated
•
8k
•
28
SongTonyLi/llama-1b-preference-merge-mix
Viewer
•
Updated
•
142k
•
30
•
1
SongTonyLi/dpo-mix_skywork_infinity
Viewer
•
Updated
•
131k
•
35
•
1
SongTonyLi/dpo-mix-shuffled
Viewer
•
Updated
•
44.2k
•
29
SongTonyLi/merged_orca_skywork_capybara_infinity_midL2_preference
Viewer
•
Updated
•
88k
•
38