Do you mean that training accuracy is going down while training, or the training accuracy decreased after you zeroing-out some gradients?
In the first case, I’m not sure what is happening.
Maybe full code will help the understanding of that situation.
In the second case, it is natural because you use less parameters than the original model.
Thank you.