mgoin/Nemotron-4-340B-Instruct-hf-FP8
Text Generation
•
Updated
•
1.44k
•
3
Nemotron in vLLM
Nemotron models that have been converted and/or quantized to work well in vLLM
-
-
mgoin/Nemotron-4-340B-Base-hf-FP8
Text Generation • Updated • 173 • 2 -
mgoin/Nemotron-4-340B-Instruct-hf
Text Generation • Updated • 174 • 4 -
mgoin/Nemotron-4-340B-Base-hf
Text Generation • Updated • 181 • 1 -
mgoin/Minitron-4B-Base-FP8
Text Generation • Updated • 1.18k • 3 -
mgoin/Minitron-8B-Base-FP8
Text Generation • Updated • 43 • 3 -
mgoin/nemotron-3-8b-chat-4k-sft-hf
Text Generation • Updated • 14