Hymba: A Hybrid-head Architecture for Small Language Models
Paper
β’
2411.13676
β’
Published
β’
46
β’
3
Pavlo Molchanov PRO
pmolchanov
AI & ML interests
Efficiency in Multi-Modal LLMs
Recent Activity
published
a model
10 days ago
nvidia/VILA-HD-8B-PS3-4K-SigLIP
published
a model
10 days ago
nvidia/VILA-HD-8B-PS3-1.5K-SigLIP
published
a model
10 days ago
nvidia/PS3-4K-SigLIP
Organizations
pmolchanov's activity
Update LMFlow support
#6 opened 6 months ago
by
shizhediao2
Update LMFlow support
#10 opened 6 months ago
by
shizhediao2
when will the Hymba-125M-Instruct be released? thanks
1
#6 opened 7 months ago
by
nemonameless
How good would this be for RAG?
2
#2 opened 7 months ago
by
Unomagan
How well this model can inference on cpu only devices?
2
#5 opened 7 months ago
by
mhdaw
A collection of observations in the code
π
5
2
#1 opened 7 months ago
by
AntonV
Add base model metadata
#7 opened 7 months ago
by
davanstrien
Add link to paper, update tags
#3 opened 7 months ago
by
nielsr
Update README.md
1
#4 opened 7 months ago
by
mishig
commented
a
paper
7 months ago
commented
a
paper
9 months ago
Mistral-NeMo-Minitron-8B-Chat
π
1
5
#5 opened 10 months ago
by
rasyosef
Awesome model, instruct version as well possibly?
3
#2 opened 10 months ago
by
OPPEYRADY
Context Length
π
π₯
6
1
#4 opened 10 months ago
by
Sao10K
commented
a
paper
10 months ago
Where is Minitron-4B-Instruct?
1
#2 opened 11 months ago
by
mgoin
Import error
5
#1 opened about 1 year ago
by
halidziya1