mMagmer:

you can’t use backward when using In-place operation.
i think a workaround is to write a custom module with a set backward method if it’s possible.


I am considering why torch.add will increase 58MB memory usage?
how about some other operation, such as, torch.divide, torch.mul and etc.?