Ok, why do we need to use save_for_backward for this ? Is it just a convention ? Or does it performs additional checks ?
But intermediary tensors are fine to save, right ? I tried to save some with save_for_backwards but it failed, so I saved them as attributes in self (ctx now)