Hi @VictorSanh, I have a follow up question about the Saving PruneBERT notebook.
As far as I can tell, you rely on weight quantization in order to be able to use the CSR format on integer-valued weights - is this correct?
My question is whether it is possible to show the memory compression benefits of fine-pruning without quantizing the model first?
What I’d like to do is quantify the memory reduction of BERT-base vs your PruneBERT model, so that one can clearly see that X% comes from pruning, Y% from quantization and so on.
Thanks!