The problem is that model.named_parameters() iterate over the weight of my network; for example (correct me if I misunderstood your point) Linear refers to a fully connected matrix of weights that map a given hidden layer’s vector to the next one. I’m- only interested in these vectors (not in the weights’ set), i.e. the set of numbers that are multiplied with weights during the forward propagation