Hi @knilox and @sayanghosh ,
Thank you for the discussions. The working is very clear to me now.
However, I am not clear as to what is the consensus that is reached here to solve this specific problem?
Do we remove the gradient penalty term completely from the code?
If we keep it then how do we do the DP in this case using opacus?
Again, I understand what is discussed and it all makes sense. But what is the prescribed way forward is not clear to me.