ArtusDev
/

Doctor-Shotgun_ML2-123B-Magnum-Diamond-EXL2

Text Generation

Model card Files Files and versions

EXL2 Quants of Doctor-Shotgun/ML2-123B-Magnum-Diamond

EXL2 quants of Doctor-Shotgun/ML2-123B-Magnum-Diamond using exllamav2 for quantization.

Quants

Quant(Revision)	Bits per Weight	Head Bits
3.0_H6	3.0	6
5.0_H6	5.0	6
8.0_H8	8.0	8

Downloading quants with huggingface-cli

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/Doctor-Shotgun_ML2-123B-Magnum-Diamond-EXL2 --revision "5.0bpw_H6" --local-dir ./

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ArtusDev/Doctor-Shotgun_ML2-123B-Magnum-Diamond-EXL2

Base model

mistralai/Mistral-Large-Instruct-2411

Finetuned

Doctor-Shotgun/ML2-123B-Magnum-Diamond

Quantized

(3)

this model