Model Quantization


### Reduce memory and model size, Improve inference speed (max 32/bit multi)
- Not every layer can be quantized
- Not every model reacts the same way to quantization
### Model Quantization Notion
|Title|
|:-:|
|[Quantization Aware Training](https://texonom.com/quantization-aware-training-e0fe4518abdc43c2ad661911b87a597c)|
|[Post-training quantization](https://texonom.com/post-training-quantization-ee4a0b4f02184b1193a68073dc60800e)|
|[Quantization Module Fusion](https://texonom.com/quantization-module-fusion-56a36e892c93498fb404da0c816549b4)|
|[Ouput Dequantization](https://texonom.com/ouput-dequantization-b0002e5322cb4acbb9171daea3d6fd87)|
|[Quantization Calibration](https://texonom.com/quantization-calibration-1e3675b171a44c1cb2b7d365e117e22b)|
|[Quantization Formular](https://texonom.com/quantization-formular-9f59115b5e7c438698ad3a9281d01d89)|
|[Quantization Error](https://texonom.com/quantization-error-789326c5a6294b44bab927096fe3f576)|
|[Quantization Clipping Range](https://texonom.com/quantization-clipping-range-d12231d52ec647f0b6df771e4b6514f1)|



### Model Quantization Usages
|Title|
|:-:|
|[Model Quantization Algorithm](https://texonom.com/model-quantization-algorithm-98bef3c3fe7e4bcc90df5144d7a42003)|
|[Model Quantization Tool](https://texonom.com/model-quantization-tool-384bc2583bcb498e9331ffc804315253)|



### 4bit or 8bit
> [The case for 4-bit precision: k-bit Inference Scaling Laws](https://arxiv.org/abs/2212.09720)





