EXL2 quant by FrenzyBiscuit.

This is a 4.0 BPW

Downloads last month
48
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Pantheon-RP-1.8-24b-Small-3.1_EXL2_4.0bpw_H8

Collection including ReadyArt/Pantheon-RP-1.8-24b-Small-3.1_EXL2_4.0bpw_H8