Model Quantization Tool


### Model Quantization Tools
|Title|
|:-:|
|[AutoGPTQ](https://texonom.com/autogptq-8a1d898788434aa2bc00fb43fd34411d)|
|[bitsandbytes](https://texonom.com/bitsandbytes-1575b433faaf455ba0d86cf5f7e5190b)|


### Model Quantization Inference Tools
|Title|
|:-:|
|[ExLLaMa](https://texonom.com/exllama-250efbb669814c8e9ef7f85d902fc919)|
|[](https://texonom.com/d292b2922f684a35aa126a84abe5075c)|
|[PyLLaMA](https://texonom.com/pyllama-9e4fc8a8f08c4c6eaee8600943a621f8)|








