Solved by KFrank in post #2 
              
              
                Hi jpj! 

This is fine.  At this point self.hidden_layer_1.weight is a tensor with 
shape [50, 78].  (The order of the dimensions is correct because of 
how pytorch multiplies batch tensors with weight tensors.) 

This is your problem,  You are replacing hidden_layer_1.weight, whose 
shape is consis…