Yes.
I think it’s the same issue. I’ve tried to run without enabling cuDNN and so far my memory usage is  constant. Thank You.
It could be nice if this issue shown in the nn documentation to prevent others stumbling into the same issue.