metadata
base_model:
- yamatazen/EtherealAurora-12B-v2
base_model_relation: quantized
quantized_by: frenzybiscuit
tags:
- awq
- 4-bit
EtherealAurora 12B v2
Released by Yamatazen
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64