sszymczyk
/

snowflake-arctic-instruct-gqa-GGUF

Model card Files Files and versions Community

Quantized version of https://huggingface.co/Snowflake/snowflake-arctic-instruct

Created from commit be318cae5aba5291208f27d30991a5150500887d. The original model was changed due to fixes for GQA support, so I decided to convert it again.

Downloads last month: 15

GGUF

Model size

479B params

Architecture

arctic

2-bit

3-bit

4-bit

5-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .