I am not sure about the case of the number of parameters. Do you have a concrete reason behind this thought? Is it related to overfitting?
As the gradients are independent, I would expect them to behave more or less similarly in both cases.
I hope you do not have implementation-related issues.