BinghengWu's picture

3 4 10

BinghengWu

wubingheng

·

https://github.com/wubingheng111

AI & ML interests

I like to fine-tune the small models of the Doge series.

Recent Activity

upvoted a paper about 8 hours ago

Trainable Dynamic Mask Sparse Attention

updated a model 6 days ago

SmallDoge/Qwen2.5-7B-Instruct-Math-long-25k

updated a model 6 days ago

SmallDoge/Qwen2.5-7B-Instruct-Math-short-25k

View all activity

Organizations

authored a paper 11 days ago

Concise Reasoning, Big Gains: Pruning Long Reasoning Trace with Difficulty-Aware Prompting

Paper • 2505.19716 • Published May 26 • 5

authored 2 papers 8 months ago

Cheems: Wonderful Matrices More Efficient and More Effective Architecture

Paper • 2407.16958 • Published Jul 24, 2024 • 4

Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architecture

Paper • 2412.11834 • Published Dec 16, 2024 • 8