EXL2 Quants by FrenzyBiscuit.

This model is 4.0 BPW EXL2.

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Legion-V2.3-LLaMa-70B_EXL2_4.0bpw_H8

Quantized
(4)
this model

Collection including ReadyArt/Legion-V2.3-LLaMa-70B_EXL2_4.0bpw_H8