Could you tell me why you are using this line?



 Sam_Fst:

for param in model.parameters():
param.requires_grad = False


Seems to me that setting the requires grad to False, prevents the optimizer from calculating gradients for the parameters and prevents any optimization from taking place.