Hugging Face's logo

TheBloke
/
airoboros-13b-gpt4-1.4-SuperHOT-8K-GPTQ

Text Generation
Transformers
Safetensors
llama
custom_code
text-generation-inference
4-bit precision
gptq
Model card Files Community
1

GGML request

#1
by DaigoNorr - opened
Discussion
DaigoNorr

Hey, seems like the bigger context is available for llama.cpp and koboldcpp. Could you quantize it in GGML? Thanks!

Participatory

Still need the ggml versions, should be possible now

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment