Hi, Thomas
Thanks for your reply. Can I separate the update into two parts? First, use torch optimizer to update the weights as regular training process. Then, send the weights to proximal operator, and reset the weights of the model by using the results of proximal operator. Is this process seems reasonable to you?
Though I think It might be slower than directly modify the update rule in SGD.
Best,
Shangqian