Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN
Paper
•
2412.13795
•
Published
•
19
Chenghao Dong
GNOD
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 2 months ago
Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and
Post-LN
upvoted
a
paper
about 2 months ago
SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training
liked
a model
3 months ago
TheBloke/llava-v1.5-13B-GPTQ
Organizations
None yet
GNOD's activity
upvoted
2
papers
about 2 months ago