Hey @mzimmer,
yes exactly, freezing FC Layers during finetuning of a pruned model is what I wanted.
Using your suggestion worked perfectly - after several iterations zero weights stay zero.
Thanks for helping me out! Very much appreciated.