Hymba: A Hybrid-head Architecture for Small Language Models
Paper
•
2411.13676
•
Published
•
44
James PRO
jtatman
AI & ML interests
improving domain specific models and re-sampling data, refining datasets for use in different modalities, small scale micro-llm clusters using quantized and smoothed models, and all emerging llm stack connecting technologies. Small models rock.
Recent Activity
updated
a model
1 day ago
jtatman/smol_vlm_125_faces_merged
updated
a model
1 day ago
jtatman/smol_vlm_125_faces_merged-celebrity-faces-bnb8bit-qlora
published
a model
1 day ago
jtatman/smol_vlm_125_faces_merged-celebrity-faces-bnb8bit-qlora
Organizations
jtatman's activity
upvoted
a
paper
4 months ago
upvoted
a
paper
7 months ago
upvoted
a
collection
8 months ago
upvoted
an
article
8 months ago
Article
Llama 3.1 - 405B, 70B & 8B with multilinguality and long context
•
232
upvoted
2
papers
9 months ago
upvoted
an
article
10 months ago
Article
Welcome Gemma - Google's new open LLM
•
23
upvoted
a
collection
10 months ago
upvoted
3
papers
about 1 year ago
upvoted
2
papers
over 1 year ago