📟 Relay v0.1 (Mistral Nemo 2407): 8-bit (bnb)

This model page includes the 8-bit bitsandbytes version of relay-v0.1-Mistral-Nemo-2407. For more details about the model, and how it should be used, please see that model page.

Downloads last month
6
Safetensors
Model size
12.2B params
Tensor type
F32
·
FP16
·
I8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Quantized
(4)
this model

Dataset used to train danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Collection including danlou/relay-v0.1-Mistral-Nemo-2407-8bit