relaxml/Llama-3.1-70B-Instruct-2Bit-YAQA-QTIP
11B
•
Updated
•
1
YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.