Depending on your use case you could either use different param_groups within one optimizer or a second optimizer.
If done correctly, the performance should not differ although each param should only be optimized by one optimizer, as they could have gradients pointing to different directions for different objectives, which could cause an oscillation without proper convergence.