googlebot:

No, that’s probably error that you get if you do backward() twice.


My code with nn.ReLU works fine and with this custom activation after introducing Variable works fine as well (if I backward twice, it should be problematic with nn.ReLU too).
if you look at this post,  it is suggested to do multiplication for the trainable variable.