You could pass only a subset to the corresponding optimizers.
This per-param example 201 shows how to use different arguments for specific parameter sets, but you could use the syntax to create two optimizers with different parameters.