Hi,
I just have a try on requires_grad and params_groups in optimizer.
Set requires_grad=False can no longer calculate gradients of the related module and keep their grad None. Configuring optimizer can make the params don’t update in opt.step() but their gradients still calculate.