zetasepic
/

Rombo-LLM-V3.1-QWQ-32b-abliterate-6.5bpw-h8-exl2

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (0)

Improve language tag

#2 opened about 2 months ago by

you should make 4 or 4.25 bit quantization to make it usable on 24GB cards

#1 opened 3 months ago by