relaxml/Llama-2-7b-QTIP-4Bit
2B
•
Updated
•
277
•
2
QTIP Quantized Models
See https://github.com/Cornell-RelaxML/qtip
-
-
relaxml/Llama-2-7b-QTIP-3Bit
1B • Updated • 2 • 1 -
relaxml/Llama-2-7b-chat-QTIP-3Bit
1B • Updated • 3 -
relaxml/Llama-2-13b-QTIP-3Bit
3B • Updated • 7 -
relaxml/Llama-2-13b-chat-QTIP-3Bit
3B • Updated • 2 -
relaxml/Llama-2-70b-QTIP-3Bit
13B • Updated • 2 -
relaxml/Llama-2-70b-chat-QTIP-3Bit
13B • Updated • 2 -
relaxml/Llama-2-7b-chat-QTIP-4Bit
2B • Updated • 2 -
relaxml/Llama-2-13b-QTIP-4Bit
4B • Updated • 2 -
relaxml/Llama-2-13b-chat-QTIP-4Bit
4B • Updated • 2 -
relaxml/Llama-2-70b-QTIP-4Bit
18B • Updated • 2 -
relaxml/Llama-2-70b-chat-QTIP-4Bit
18B • Updated • 2 -
relaxml/Llama-2-70b-chat-QTIP-2Bit
9B • Updated • 2 -
relaxml/Llama-2-70b-QTIP-2Bit
9B • Updated • 2 -
relaxml/Llama-2-13b-chat-QTIP-2Bit
2B • Updated • 2 -
relaxml/Llama-2-13b-QTIP-2Bit
2B • Updated • 4 -
relaxml/Llama-2-7b-QTIP-2Bit
1B • Updated • 446 -
relaxml/Llama-2-7b-chat-QTIP-2Bit
1B • Updated • 2 • 1 -
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
3B • Updated • 996 • 2 -
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
2B • Updated • 803 -
relaxml/Llama-3.1-8b-Instruct-QTIP-2Bit
2B • Updated • 1.02k • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
105B • Updated • 2 -
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
80B • Updated • 2 • 1 -
relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit
54B • Updated • 2 • 3 -
relaxml/Llama-3.3-70B-Instruct-QTIP-4Bit
19B • Updated • 11 • 1 -
relaxml/Llama-3.3-70B-Instruct-QTIP-3Bit
15B • Updated • 9 • 1 -
relaxml/Llama-3.3-70B-Instruct-QTIP-2Bit
11B • Updated • 52 • 2