Solved by usami in post #2 
              
              
                I figure out this problem now. I first compare the parameters name and values using the following code: 
trained_network = Net() # network with trained parameters
my_network = Net() # network with default initialization

my_network.load_state_dict(trained_network.state_dict())

for ((k1, v1), (k2, v…