RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 11B • Updated Feb 12 • 8.83k • 32
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • 3B • Updated Oct 23, 2024 • 2.17k • 10
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • 58B • Updated Oct 10, 2024 • 366 • 12
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • 406B • Updated Oct 19, 2024 • 741 • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • 406B • Updated Dec 3, 2024 • 307 • 2
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated Oct 19, 2024 • 1.03k • 7
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Feb 11 • 6.52k • 21
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated May 30 • 19.5k • 17
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 19B • Updated Oct 9, 2024 • 790 • 5
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • 105B • Updated Oct 9, 2024 • 5 • 2