Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

136

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 8 • 2.56k • 6

Esperanto/llama-3.2-3B-Instruct-kvc-fp16-onnx

Text Generation • Updated Oct 9 • 26 • 1

sheldonrobinson/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 10 • 14 • 1

mav23/Llama3.2-3B-Enigma-GGUF

Text Generation • Updated Oct 10 • 345 • 1

mav23/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 11 • 467 • 1

saishshinde15/TethysAI_Research

Updated Oct 14 • 134 • 2

xmadai/Llama-3.2-3B-Instruct-xMADai-INT4

Text Generation • Updated 22 days ago • 132 • 6

apto-as/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 30 days ago • 12 • 1

AIFunOver/Llama-3.2-3B-Instruct-openvino-8bit

Text Generation • Updated 8 days ago • 20 • 1

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 6

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25 • 6

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25 • 8

jxtngx/Meta-Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 66

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated about 1 month ago • 1.75k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 203

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated Sep 25 • 9

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Updated Sep 26 • 11

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 418 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_0-MLC

Updated Sep 26 • 2.15k

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 26

SanctumAI/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 32.4k • 1

jimjimjimmyjim/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 5

numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated Sep 26

paultimothymooney/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 6

brunopio/Llama-3.2-3B-Instruct-nbits4-GS64-Axis1-HQQ

Updated Sep 26 • 2

brunopio/Llama-3.2-3B-Instruct-nbits4-GSNone-Axis0-HQQ

Updated Sep 26 • 2

pingzhou/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 3

rohanprichard/Llama-3.2-3B-Instruct-MLC

Updated Sep 27 • 3

Kondara/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 27 • 22