Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
XelotX
/
Mistral-7B-Instruct-v0.3-XelotX-BF16_Quants
like
0
GGUF
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
Downloads last month
2
GGUF
Model size
7.25B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
2.72 GB
3-bit
Q3_K_S
3.17 GB
Q3_K_M
3.52 GB
Q3_K_L
3.83 GB
4-bit
Q4_K_S
4.14 GB
Q4_0
4.11 GB
Q4_1
4.56 GB
Q4_K_M
4.37 GB
5-bit
Q5_K_S
5 GB
Q5_0
5 GB
Q5_1
5.45 GB
Q5_K_M
5.14 GB
6-bit
Q6_K
5.95 GB
8-bit
Q8_0
7.7 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
XelotX/Mistral-7B-Instruct-v0.3-XelotX-BF16_Quants
Mistral-7B-Instruct-v0.3
Collection
3 items
โข
Updated
Jan 20