ISTA-DASLab
/

Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (2)

Clinical Quant

#5 opened 12 months ago by

One needs a Qwen 72B AQLM

#4 opened about 1 year ago by

ZN2at4_ops15sum_IntList_out4callERKNS_6TensorEN3c1016OptionalArrayRefIlEEbSt8optionalINS5_10ScalarTypeEERS2

#3 opened about 1 year ago by