Quantized with these parameters:
--bits 4
--group_size 128
--desc_act 1
--damp 0.1
--seqlen 16384
--num_samples 512
Quantization Dataset: Erotiquant XL
- Downloads last month
- 14
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support