But if we not use backward and do all in manual passion,

Not sure what you mean by this.
If you don’t use the autograd engine and write everything by hand, you can do whatever you want as you write it by hand.