Solved by ptrblck in post #2 
              
              
                It looks like you are unfreezing all but the last five layers in the model. Also note that model.parameters() will give you all parameters separately, e.g. the weight and bias if used in the particular layer, so you might want to use model.children() or make sure your slicing operation really captur…