Hi,
You don’t want to have parameters shared in multiple optimizers as internal states kept for example by Adam or momentum will be wrong.
You can create one optimizer for each set of paremeters and .step() all the ones that need to be updated at that iterations.