I know it’s trivial for a parameter vector, but when I iterate through the params in, for example:
torch.cat([param.flatten() for param in self.policy.model.parameters()])
setting requires_grad to false returns an error. How do I turn off the gradient for the individual param scalar weights?