LLMEasyQuant -- An Easy to Use Toolkit for LLM Quantization
<|reference_start|>LLMEasyQuant -- An Easy to Use Toolkit for LLM Quantization: Currently, there are many quantization methods appeared for LLM quantization, yet few are user-friendly and easy to be deployed locally. Packages like TensorRT and Quantohave many underlying structures and self-invoking internal functions, which are not conducive to developers' personalized development and learning for deployment. Therefore, we develop LLMEasyQuant, it is a package aiming to for easy quantization deployment which is user-friendly and suitable for beginners' learning.<|reference_end|>
@article{liu2024llmeasyquant,
    title={LLMEasyQuant -- An Easy to Use Toolkit for LLM Quantization},
    author={Dong Liu, Meng Jiang, Kaiser Pister},
    journal={arXiv preprint arXiv:2406.19657},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.19657},
    primaryClass={cs.LG}
}