If you only want to fine-tune the parameters in model.fine you could do the following:
model = ...
optimizer = torch.optim.Adam(model.fine.parameters(),lr = 0.001)

Now the optimizer will only try to update parameters within the .fine submodule.