Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

123

Full-text search

Active filters: aqlm

ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16

Text Generation • Updated Jul 25, 2024 • 6

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28, 2024 • 241 • 13

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 26

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 155

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 28, 2024 • 250 • 8

ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf

Text Generation • Updated Aug 9, 2024 • 30 • 3

galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE

Updated Aug 8, 2024

ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf

Text Generation • Updated Aug 9, 2024 • 228 • 2

ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf

Updated Aug 16, 2024 • 3

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 14, 2024 • 45 • 17

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 17, 2024 • 25 • 46

ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 84

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 300

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 38

PrunaAI/ISTA-DASLab-Llama-3.2-3B-AQLM-PV-2Bit-2x8-bnb-smashed

Updated Nov 8, 2024

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 14

slobers/pik3

Text Generation • Updated Nov 14, 2024 • 9

sdyy/bb

Updated Dec 20, 2024

Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15

Text Generation • Updated Mar 7 • 4

Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12

Text Generation • Updated Mar 7 • 4

Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15

Text Generation • Updated Mar 7 • 4

Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15

Text Generation • Updated Mar 7 • 4

Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15

Text Generation • Updated Mar 7 • 4

Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12

Text Generation • Updated Mar 7 • 6

Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15

Text Generation • Updated Mar 7 • 3

Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15

Text Generation • Updated Mar 7 • 5

Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15

Text Generation • Updated Mar 7 • 4

Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15

Text Generation • Updated Mar 7 • 3

Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15

Text Generation • Updated Mar 7 • 4

Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15

Text Generation • Updated Mar 7 • 6