EXL2 quants by FrenzyBiscuit

This is a 4.0 BPW

Downloads last month
2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Legion-V2.2-LLaMa-70B_EXL2_4.0bpw_H8

Quantized
(9)
this model

Collection including ReadyArt/Legion-V2.2-LLaMa-70B_EXL2_4.0bpw_H8