GGuf Version

#5
by apcameron - opened

I was able to make a gguf version using the updated llama.cpp
Do you plan to release a gguf version?

Unsloth AI org

I was able to make a gguf version using the updated llama.cpp
Do you plan to release a gguf version?

Hi it's already up: https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Also Maverick: https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment