Pygmalion-3
Collection
6 items
•
Updated
•
4
This repo contains the ExLlamaV2 quants of the Pygmalion-3-12B model.
The main branch only contains the measurement.json
file, to produce your own quants of the model with a different bpw.
You can find the pre-quanted checkpoints in the following branches:
Base model
IntervitensInc/Mistral-Nemo-Base-2407-chatml