I have pytorch 0.3.0 without .post4 running on python 3.6 on ubuntu.
I can’t see why my ISRLU works without a backward function, and your HadamardProd doesn’t.
You might have some success replacing the call to HadamardProd in forward with the code from HadamardProd.forward.