@crcrpar,
I considered  how to write scripts according to your advice. I am now stacked because two reasons as follows;

My new networks are better inside the pretrained_net because they have data transaction with some networks inside pretrained_network.
I extensively searched for the way to set a specific network with requires_grad = True, such as  module_name.requires_grad = True, but I could not find such a method yet.

Therefore, I created another post to proceed in my original idea in a site below;

  
    
    
    Manipulate multiple of specific network's requires_grad to True or False 
  
  
    Hi, 
I am in trouble in setting up only some specific networks’ requres_grad in my network  to True or False. 
class MyNetwork: 
… 
self.layer1 = Layer1() 
self.layer2 = Layer2() 
Some other networks exist. 
… 
class Layer1(): 
… 
self.net_a = torch.nn.Linear(xx) 
Some other networks exist. 
… 
class Layer2(): 
self.net_b = torch.nn.Linear(yy) 
Some other networks exist. 
… 
Then I want set up only 
my_network.layer1.net_a, 
and 
my.network.layer2.net_b 
to be requires_grad = False. 
my_network.…
  


If you come up with any other idea, let me know.