Thanks @lewtun for the quick response,
I have already quantized my model via ONNX, now I was trying to use pruning as a way of further reducing the size and inference time for my DistilGPT2 model - and thought the Movement pruning notebook 2 from Hugging Face might be helpful.
But I get it, that as of now the PyTorch quantization API does not support quantizing of t he Conv1d module.
So I’ll look for other ways to prune using the Tensorflow version of the model.
Thanks again!