Hi, Thomas
I have one thing to confirm. In pytorch 0.3, the forward function, every variable will be transferred to tensor, yet in backward, x, = ctx.saved_variables, then x is a variable. While, from what you say about pytorch > 0.4, the backward function sets autograd tracking disabled by default.  Thank you!