Intel Neural Compressor, Hugging Face, Neural Coder, Deep Learning.
and run models on targeted hardware. As such, Optimum enables users to efficiently use any of these platforms with the same ease inherent to transformers. Recently, Intel’s Neural Coder (powered by Intel Neural Compressor) has enabled the support of automatic enabling of INT8 quantization with the