Hi,
What do you mean by “more than others”? If you don’t want to optimize some parts of your net, you can create two optimizer, each containing de parameters for different part of your net and call .step() on each of them only when you want to update this part of the net.