I'm a little late... I guess.
Link to original model and script:
- anthracite-org/magnum-12b-v2: https://huggingface.co/anthracite-org/magnum-12b-v2
- FantasiaFoundry/GGUF-Quantization-Script: https://huggingface.co/FantasiaFoundry/GGUF-Quantization-Script
- Downloads last month
- 34
Hardware compatibility
Log In
to view the estimation
3-bit
4-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support