Solved by eqy in post #2 
              
              
                If the goal is to finetune the network after changing the last layer, can you do the modification after loading the weights? For example, can you move the line 
model_transfer1._fc = nn.Linear(n_inputs, 3)

to after 
model_transfer = load_checkpoint(checkpoint_path='My retrained model',model = model…