Intel Neural Compressor, Hugging Face, Neural Coder, Deep Learning.
performance on CPUs or GPUs. It supports post-training static and dynamic quantization of PyTorch models. It supports automatic accuracy-driven tuning strategies for users to easily generate quantized model. Users can easily apply static, dynamic, and aware-training quantization approaches while