Visual Studio Code, Deep Learning, Intel Neural Compressor, Pytorch.
Neural Coder button at the top right and select the optimization (quantization) that you want to run on your code. Select “INC Enable INT8 (Static),” “INC Enable INT8 (Dynamic),” or “INC Enable BF16” then wait loading to complete. Progress bar You will see that the quantization has been enabled