pookie3000
/

Meta-Llama-3.1-8B-Q4_K_M-GGUF

text-generation-inference

Model card Files Files and versions Community

Uploaded model

Base model in GGUF format which I use to load adapters locally.

Downloads last month: 16

GGUF

Model size

8.03B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for pookie3000/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Base model

meta-llama/Llama-3.1-8B

Quantized

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Quantized

(241)

this model

Collection including pookie3000/Meta-Llama-3.1-8B-Q4_K_M-GGUF

Base Model GGUFs

GGUFs of popular base models you can use together with adapters. • 3 items • Updated Mar 2