Edit Models filters

Model Tree

TheDrummer/Anubis-70B-v1

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

20

Full-text search

Active filters: TheDrummer/Anubis-70B-v1

bartowski/Anubis-70B-v1-GGUF

Text Generation • Updated Dec 22, 2024 • 8.3k • 9

mradermacher/Anubis-70B-v1-GGUF

Updated Dec 22, 2024 • 119 • 1

mradermacher/Anubis-70B-v1-i1-GGUF

Updated Dec 22, 2024 • 625

Jellon/Anubis-70B-v1-exl2-3bpw

Updated Dec 24, 2024 • 10

Dracones/Anubis-70B-v1_exl2_8.0bpw

Text Generation • Updated Dec 25, 2024 • 60 • 1

Dracones/Anubis-70B-v1_exl2_7.0bpw

Text Generation • Updated Dec 25, 2024 • 7

Dracones/Anubis-70B-v1_exl2_6.0bpw

Text Generation • Updated Dec 25, 2024 • 17

Dracones/Anubis-70B-v1_exl2_5.0bpw

Text Generation • Updated Dec 25, 2024 • 14

Dracones/Anubis-70B-v1_exl2_4.5bpw

Text Generation • Updated Dec 25, 2024 • 30

Dracones/Anubis-70B-v1_exl2_4.0bpw

Text Generation • Updated Dec 25, 2024 • 17

Dracones/Anubis-70B-v1_exl2_3.5bpw

Text Generation • Updated Dec 25, 2024 • 21

Dracones/Anubis-70B-v1_exl2_3.0bpw

Text Generation • Updated Dec 25, 2024 • 5

Dracones/Anubis-70B-v1_exl2_2.75bpw

Text Generation • Updated Dec 25, 2024 • 2

Dracones/Anubis-70B-v1_exl2_2.5bpw

Text Generation • Updated Dec 25, 2024 • 6

Dracones/Anubis-70B-v1_exl2_2.25bpw

Text Generation • Updated Dec 25, 2024 • 11

backyardai/Anubis-70B-v1-GGUF

Updated about 1 month ago • 1.29k

beezu/Anubis-70B-v1-MLX-8Bit

Updated 1 day ago • 2

beezu/Anubis-70B-v1-MLX-6Bit

Updated 1 day ago

beezu/Anubis-70B-v1-MLX-4Bit

Updated 1 day ago • 3

beezu/Anubis-70B-v1-MLX-3Bit

Updated about 24 hours ago