You will have to modify all the autograd.Functions that save it to force them to save your compressed version.
You did it properly for Linear, but there might be other Functions, like ReLU that also save it and should be modified.