Hugging Face's logo

QuantFactory
/
Phi-3-mini-4k-instruct-GGUF

Text Generation
GGUF
English
nlp
code
Inference Endpoints
conversational
Model card Files Community
2

Quant Request

#1
by Cran-May - opened
Discussion
Cran-May

Can you offer gguf quants for this model?
https://huggingface.co/NLPark/Test1_Cecilia

0-hero
 Quant Factory org

Phi3 128k is not yet supported by llama.cpp. Will do them immediately after they do

Sign up or log in to comment