Article
The 4 Things Qwen-3's Chat Template Teaches Us
By
ā¢
ā¢
47Mohammed Hamdy
mmhamdy
AI & ML interests
TechBio | AI4Sci | NLP | Reinforcement Learning
Recent Activity
upvoted
an
article
3 days ago
The 4 Things Qwen-3's Chat Template Teaches Us
liked
a model
8 days ago
facebook/KernelLLM
upvoted
a
paper
10 days ago
Text Generation Beyond Discrete Token Sampling
Organizations
mmhamdy's activity
upvoted
an
article
3 days ago
liked
a
model
8 days ago
upvoted
a
paper
10 days ago
upvoted
an
article
about 1 month ago
Article
Tiny Agents: a MCP-powered agent in 50 lines of code
By
ā¢
ā¢
265
upvoted
a
paper
about 2 months ago
posted
an
update
2 months ago
Post
1633
What inspired the Transformer architecture in the "Attention Is All You Need" paper? And how were various ideas combined to create this groundbreaking model?
In this lengthy article, I explore the story and the origins of some of the ideas introduced in the paper. We'll explore everything from the fundamental attention mechanism that lies at its heart to the surprisingly simple explanation for its name, Transformer.
š” Examples of ideas explored in the article:
ā What was the inspiration for the attention mechanism?
ā How did we go from attention to self-attention?
ā Did the team have any other names in mind for the model?
and more...
I aim to tell the story of Transformers as I would have wanted to read it, and hopefully, one that appeals to others interested in the details of this fascinating idea. This narrative draws from video interviews, lectures, articles, tweets/Xs, and some digging into the literature. I have done my best to be accurate, but errors are possible. If you find inaccuracies or have any additions, please do reach out, and I will gladly make the necessary updates.
Read the article: https://huggingface.co/blog/mmhamdy/pandemonium-the-transformers-story
In this lengthy article, I explore the story and the origins of some of the ideas introduced in the paper. We'll explore everything from the fundamental attention mechanism that lies at its heart to the surprisingly simple explanation for its name, Transformer.
š” Examples of ideas explored in the article:
ā What was the inspiration for the attention mechanism?
ā How did we go from attention to self-attention?
ā Did the team have any other names in mind for the model?
and more...
I aim to tell the story of Transformers as I would have wanted to read it, and hopefully, one that appeals to others interested in the details of this fascinating idea. This narrative draws from video interviews, lectures, articles, tweets/Xs, and some digging into the literature. I have done my best to be accurate, but errors are possible. If you find inaccuracies or have any additions, please do reach out, and I will gladly make the necessary updates.
Read the article: https://huggingface.co/blog/mmhamdy/pandemonium-the-transformers-story
published
an
article
2 months ago
Article
Pandemonium: The Transformers Story
By
ā¢
ā¢
6
published
an
article
2 months ago
Article
Osirian AI: A Call For The Resurrection And Reuse Of Deep Learning Models.
By
ā¢
liked
a
model
3 months ago
liked
a
Space
3 months ago
upvoted
a
paper
3 months ago
commented
a
paper
3 months ago
liked
a
model
3 months ago
upvoted
an
article
3 months ago
Article
A Deepdive into Aya Vision: Advancing the Frontier of Multilingual Multimodality
By
and 3 others
ā¢
ā¢
74
upvoted
a
collection
3 months ago
upvoted
an
article
3 months ago
Article
Common AI Model Formats
By
ā¢
ā¢
39
upvoted
a
collection
3 months ago
upvoted
a
paper
3 months ago
liked
a
model
3 months ago
upvoted
a
collection
3 months ago