RedHatAI/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
8B
•
Updated
•
2.24k
•
•
24
RedHatAI/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation
•
16B
•
Updated
•
7
RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation
•
16B
•
Updated
•
17.9k
•
8
RedHatAI/Qwen2-7B-Instruct-quantized.w4a16
Text Generation
•
2B
•
Updated
•
4
RedHatAI/Qwen2-72B-Instruct-quantized.w4a16
Text Generation
•
12B
•
Updated
•
6
•
4
RedHatAI/Qwen2-1.5B-Instruct-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
10
RedHatAI/Qwen2-0.5B-Instruct-quantized.w4a16
Text Generation
•
0.3B
•
Updated
•
17
RedHatAI/Qwen2-72B-Instruct-quantized.w8a16
Text Generation
•
20B
•
Updated
•
6
•
1
RedHatAI/Qwen2-7B-Instruct-quantized.w8a16
Text Generation
•
3B
•
Updated
•
17
RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a16
Text Generation
•
0.6B
•
Updated
•
20
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a16
Text Generation
•
0.2B
•
Updated
•
32
RedHatAI/Llama-2-7b-chat-quantized.w4a16
Text Generation
•
1B
•
Updated
•
7
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w4a16
Text Generation
•
2B
•
Updated
•
19
•
2
RedHatAI/Llama-2-7b-chat-quantized.w8a16
Text Generation
•
2B
•
Updated
•
29
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a16
Text Generation
•
2B
•
Updated
•
55
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16
Text Generation
•
19B
•
Updated
•
94
•
5
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16
Text Generation
•
3B
•
Updated
•
523
•
3
RedHatAI/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
5
RedHatAI/SparseLlama-2-7b-evolcodealpaca-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
5
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
71B
•
Updated
•
8
•
3
RedHatAI/Llama-2-7b-gsm8k-pruned_70
Text Generation
•
7B
•
Updated
•
32
RedHatAI/Llama-2-7b-gsm8k-pruned_50
Text Generation
•
7B
•
Updated
•
11
•
1
RedHatAI/Llama-2-7b-gsm8k
Text Generation
•
Updated
•
270
•
5
RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
1B
•
Updated
•
459k
•
23
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_50.2of4
Text Generation
•
7B
•
Updated
•
5
RedHatAI/SparseLlama-2-7b-cnn-daily-mail-pruned_70
Updated
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
7
RedHatAI/Llama-2-7b-cnn-daily-mail-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
7
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse
Text Generation
•
Updated
•
6
•
1
RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse
Text Generation
•
Updated
•
9