Solved by ptrblck in post #2 
              
              
                You can freeze all parameters of the model first via: 
for param in model.parameters():
    param.requires_grad_(False)

and later unfreeze the desired blocks by printing the model (via print(model)) and use the corresponding module names to unfreeze their parameters. E.g. assuming the last two “blo…