They either fall to very close to zero or change very little, mostly all in the same direction. This would mean they mostly bear the same importance - not much at all. I’m not sure if it is a result that makes sense, hence thinking there could be some implementation problem. Do you also think the implementation is ok? Then I could be worrying needlessly and the weights are actually evolving correctly