Hugging Face's logo

SimmonsSongHW
/
Llama-3.1-8B-Instruct-GGUF

GGUF
conversational
Model card Files Community

Llama-3.1-8B-Instruct Quantization with Llama.cpp

Downloads last month
45
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

View +1 variant
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SimmonsSongHW/Llama-3.1-8B-Instruct-GGUF

Base model

meta-llama/Llama-3.1-8B
Finetuned
meta-llama/Llama-3.1-8B-Instruct
Quantized
(388)
this model

Collection including SimmonsSongHW/Llama-3.1-8B-Instruct-GGUF