tokyotech-llm/swallow-code
Viewer
•
Updated
•
129M
•
3.04k
•
52
SwallowCode
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
-
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp1-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 10 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 8 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 6 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 6 • 1 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp4-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp5-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp6-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp7-Llama-3.3-70B-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp8-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp9-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 6 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp10-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 6 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 5 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp11-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp12-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 4 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0010000
8B • Updated • 3 -
tokyotech-llm/Llama-3.1-8B-code-ablation-exp13-LR2.5e-5-WD0.1-iter0012500
8B • Updated • 3