exl2 quant
#2
by
SporkySporkness
- opened
Humbly requesting a 4.0 bpw exl2 quant (3.75 bpw even better to leave room for more context)
Thank you!
Made a 3.8BPW quant, enjoy.
https://huggingface.co/Blackroot/Lumimaid-v02-70B-3.8BPW-6H-Exl2/upload/main