Hi Alex, well spotted. I never did this comparison.
One easy check it to compare the layers one by one, (Linear, Conv2d, BatchNorm etc.), and see if there’s any difference in the number of params.
However, I don’t think there will be any difference, provided that you pay attention to the sneaky default parameters.
After that, you can patiently compare the graphs layer by layer and see if you spot any difference. Maybe it’s a matter of omitted/shared biases in some of the layers.
Btw, the first test is also a good check for the count_parameters() function, let us now if you discover some unexpected behavior