First of all it is recommended not to use torch.save to save your model. Hav a look at this page 79 for more details.
For your question: I’m afraid you have to remove them before saving or save the whole model and load the whole model (you could still remove the layers after loading).
Do you want to add other FC Layers instead?