Hugging Face's logo

IEITYuan
/
Yuan2-M32-gguf-int4

GGUF
Inference Endpoints
Model card Files Community
1

llama.cpp cannot load the model.

#1
by miaoerduo - opened
Discussion
miaoerduo
This comment has been hidden
fredusername

https://github.com/chong000/3rd_party/tree/main/llama-cpp

roccotool

Will not load in GPT4ALL either.

Sign up or log in to comment