UMoE: Unifying Attention and FFN with Shared Experts
Paper
•
2505.07260
•
Published
•
9
Debopam Dey
pritamdeb68
AI & ML interests
AI , NLP and Data Science
Recent Activity
updated
a dataset
4 days ago
pritamdeb68/FineWeb-long-context-documents
published
a dataset
4 days ago
pritamdeb68/FineWeb-long-context-documents
upvoted
a
paper
5 days ago
UMoE: Unifying Attention and FFN with Shared Experts
Organizations
None yet
upvoted
a
paper
5 days ago
upvoted
an
article
5 months ago
Article
The NLP Course is becoming the LLM Course!
By
and 9 others
•
•
99
upvoted
an
article
6 months ago
Article
How to train a new language model from scratch using Transformers and Tokenizers
By
•
•
44