optimizer = torch.optim.SGD(filter(lambda p: p.requires_grad, model.parameters()), lr=0.0006, momentum=0.9)

is this what you were talking about? if yes, pls also explain what would happen if pass the parameters as
optimizer = torch.optim.SGD(model.parameters(), lr=0.0006, momentum=0.9) ???