Hugging Face's logo

mradermacher
/
Llama-4-Maverick-17B-128E-Instruct-GGUF

Transformers
PyTorch
facebook
meta
llama
llama4
Model card Files Community
2

Looking forward to iQ Q3 and Q4 versions of this

#1
by wa999 - opened
Discussion
wa999
•
edited 17 days ago

iQ Q3 and Q4 versions

Great work!
Thanks!

wa999 changed discussion title from Looking forward to iQ Q4 version of this to Looking forward to iQ Q3 and Q4 version of this
wa999 changed discussion title from Looking forward to iQ Q3 and Q4 version of this to Looking forward to iQ Q3 and Q4 versions of this
nicoboss

You can follow https://hf.tst.eu/status.html to see what versions come next.

nicoboss

My nico1 server is currently working on the following Llama 4 tasks:

nico1    nice size (static/imatrix) -- jobs 15/8-40 maxm 130 free 2137 budget 1307 uploads 186 hfd 1170 32c
        -7777  804 si Llama-4-Maverick-17B-128E-Instruct           run/static 5/12,Q6_K [415/531]
        -6665  218  I Llama-4-Scout-17B-16E-Instruct               run/imatrix 16/24,IQ2_XS [194/628] (hfu i1-IQ2_XXS i1-Q3_K_L)
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment