This is a Exl2 quantized version of Pygmalion-2-13b-SuperCOT-weighed

Please refer to the original creator for more information.

Branches:

main: 4 bits per weight
5.0bpw: 5 bits per weight
6.0bpw: 6 bits per weight

Downloads last month: 17

Inference Examples

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Collection including royallab/Pygmalion-2-13b-SuperCOT-weighed-exl2

Exl2

Collection

Models that we have quantized to exllamav2's quantization format • 22 items • Updated Feb 15 • 2