We are checking out the Huggingface Optimum. There are some issues that we would like to clarify:


Pruning does not always speedup model, and it may increase the model’s storage size which is not expected.


Dynamic quantization works only on CPU (Running it on GPU shows error conflict between CPU and GPU


Could someone or developer in the area explain this behavior? We think the Huggingface Optimum has a high hope for model compression.
If some details are necessary, I would be glad to clarify more.