wait, then what is my problem? It definitely did not work for me using my training code, it just trained as usual, while it was supposed to fail the training…
Is calling optimizer.backward() then right way of doing it?