How can I check this?
However, Optimizer contains params with requires_grad as True. I checked it with the following code:
 for param in self._optimizer.param_groups[0]['params']:
      if param.requires_grad:
              print(param.grad)

Note that all params’ grad is equal to “None”.
For information, I use “AdamW” as an optimizer.