@albanD do I cause any harm if I delete the fields at the end of backward? E.g., I noticed that gradcheck will not work anymore if I do so, since apparently calls backward more than once per forward call. Are you relying in the framework on having the fields in ctx (that I populate) available also after the first call to backward?