Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-embeddings-inference

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Models

101

Full-text search

Active filters: float16

OpenNMT/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Dec 1, 2023 • 17

avans06/ALMA-7B-ct2-int8_float16

Text Generation • Updated Dec 15, 2023 • 12

avans06/ALMA-13B-ct2-int8_float16

Text Generation • Updated Dec 15, 2023 • 8

avans06/madlad400-7b-mt-bt-ct2-int8_float16

Updated Dec 24, 2023 • 7 • 2

avans06/Meta-Llama-3-8B-Instruct-ct2-int8_float16

Text Generation • Updated Apr 25, 2024 • 3

nitsuai/ct2fast-all-MiniLM-L6-v2

Sentence Similarity • Updated Apr 26, 2024 • 11

nitsuai/ct2fast-paraphrase-multilingual-MiniLM-L12-v2

Sentence Similarity • Updated Apr 26, 2024 • 7

Weblet/Llama-2-7b-chat-hf-ct2-int8

Text Generation • Updated Apr 30, 2024 • 5

DavidAU/Estopia-Grande-20B-Instruct-Ultra-GGUF

Text Generation • Updated Nov 14, 2024 • 137 • 1

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10, 2024 • 27

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13, 2024 • 47