Hi,
I am afraid the provided optimzers won’t allow that.
I think the simplest is to reimplement whichever optimizer you want to use based on the original implementation like the one for sgd here 13.
For sgd  it should be fairly simple, but I am not sure how adam is supposed to behave in that case.