exllamav2 quants of Doctor-Shotgun's L3.3-70B-Magnum-Nexus
2.25bpw H6 20.686 GiB
4.25bpw H6 36.623 GiB
6.00bpw H6 50.569 GiB
8.00bpw H8 66.712 GiB
measurement.json
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for MikeRoz/L3.3-70B-Magnum-Nexus-exl2
Base model
Doctor-Shotgun/L3.3-70B-Magnum-Nexus