I don’t think it has much to do with the way the modules have been defined. (They seem correct; they have identical numbers of parameters, and dimensions)
How do your optimizers look like, for each network? And could you elaborate on this?



 muon:

First one works fine, the second one’s output does not make sense


ckquote