AutoGPTQ
[AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ) [GPTQ](https://texonom.com/gptq-87428aee2a774b93906ab2213a1b6dc6) [AdaLoRa](https://texonom.com/adalora-e93b8dedde8542e99be72d6509ecfbae)


need cuda
based on GPTQ algorithm
![](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F3cf2e57f-8df2-4065-a537-9fd7e9cd649f%2FUntitled.png?table=block&id=9943d6a2-bdf4-4d03-9a06-dd484caed62f&cache=v2)

[AutoGPTQ Triton](https://texonom.com/autogptq-triton-030b1c01209341e295590fd19f97b09e)


[AutoGPTQ Quantization](https://texonom.com/autogptq-quantization-8fb40b7620ba4353ba12ea6b1ac14b75)

```typepip install auto-gptq```



  



