Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

124

Full-text search

Active filters: 70b

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 12 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 4 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 4 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 4 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-6.0bpw-h6-exl2

Updated Jun 17, 2024 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 4 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q3_K_M-GGUF

Text Generation • Updated Jan 20 • 15 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q4_0-GGUF

Text Generation • Updated Jan 20 • 188 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated Jan 21 • 49 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q8_0-GGUF

Text Generation • Updated Jan 31 • 1

Vezora/Narwhal-7b

Text Generation • Updated Aug 25, 2023 • 7

ValiantLabs/Llama2-70B-ShiningValiant

Text Generation • Updated Jan 21 • 61 • 74

poisson-fish/Marcoroni-70B-v1-AWQ

Text Generation • Updated Sep 28, 2023 • 8

sequelbox/Llama2-70B-StellarBright

Text Generation • Updated May 15, 2024 • 28 • 45

TheBloke/ShiningValiant-1.2-GPTQ

Text Generation • Updated Oct 14, 2023 • 4 • 2

TheBloke/ShiningValiant-1.2-AWQ

Text Generation • Updated Nov 9, 2023 • 1

TheBloke/StellarBright-GGUF

Text Generation • Updated Oct 15, 2023 • 353 • 7

TheBloke/StellarBright-AWQ

Text Generation • Updated Nov 9, 2023

TheBloke/StellarBright-GPTQ

Text Generation • Updated Oct 15, 2023 • 6

TheBloke/ShiningValiant-1.2-GGUF

Text Generation • Updated Oct 16, 2023 • 332 • 9

IHaBiS/StellarBright-2.55bpw-h8-exl2

Text Generation • Updated Oct 18, 2023 • 2

LoneStriker/ShiningValiant-2.4bpw-h6-exl2

Text Generation • Updated Oct 24, 2023

LoneStriker/ShiningValiant-4.0bpw-h6-exl2

Text Generation • Updated Oct 24, 2023

LoneStriker/ShiningValiant-4.65bpw-h6-exl2

Text Generation • Updated Oct 24, 2023

LoneStriker/ShiningValiant-5.0bpw-h6-exl2

Text Generation • Updated Oct 24, 2023

LoneStriker/ShiningValiant-3.0bpw-h6-exl2

Text Generation • Updated Oct 25, 2023

LoneStriker/ShiningValiant-2.6bpw-h6-exl2

Text Generation • Updated Oct 25, 2023 • 1

LoneStriker/ShiningValiant-6.0bpw-h6-exl2

Text Generation • Updated Oct 25, 2023

TheBloke/ShiningValiant-1.3-AWQ

Text Generation • Updated Dec 14, 2023

TheBloke/ShiningValiant-1.3-GGUF

Text Generation • Updated Dec 14, 2023 • 375 • 4