File size: 518 Bytes
568177b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
license: llama3
language:
- de
- en
library_name: transformers
---
# Llama3_DiscoLeo_Instruct_8B_v0.1_4bit_awq_glc
This model is a 4 bit quantization of [DiscoResearch/Llama3_DiscoLeo_Instruct_8B_v0.1](https://huggingface.co/DiscoResearch/Llama3_DiscoLeo_Instruct_8B_v0.1)
created using [AutoAWQ](https://github.com/casper-hansen/AutoAWQ) with a custom bilingual calibration dataset and `quant_config = {"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"}`.
Copy of original model card:
... |