AWQ Quants
Collection
Quants by FrenzyBiscuit & Artus
•
22 items
•
Updated
•
1
StrawberryLemonade-L3-70B-v1.0
Released by Sophosympatheia
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64
- Downloads last month
- 107
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support