Hi community, I wanted to create a custom activation function which requires custom autograd function (something similar to MyRelu example here 8. When I apply it,  the forward() is called and its definition is used to compute activation but when I use loss.backward(), the backward() defined is not called. Even in the MyRelu example (attached above) doesn’t seem to utilize the backward() function.
I’m not sure which part I’m understanding wrongly. Any insights and corrections would be much appreciated. Thanks in advance