RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 11B • Updated Feb 12 • 11.8k • 32
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 2B • Updated May 30 • 40.3k • 29
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • 3B • Updated Oct 23, 2024 • 1.97k • 10
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • 58B • Updated Oct 10, 2024 • 120 • 12
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • 406B • Updated Oct 19, 2024 • 3.56k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • 406B • Updated Dec 3, 2024 • 66 • 1
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated Oct 19, 2024 • 1.29k • 7
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Feb 11 • 16.5k • 21
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated May 30 • 59.2k • 17
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 19B • Updated Oct 9, 2024 • 846 • 5
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • 105B • Updated Oct 9, 2024 • 10 • 1