@albanD
For the sake of the argument of reducing the computation overhead in the backward,
If we can divide this into parts, the forward and the backward, can’t we get better performance.



 albanD:

That would be a LOT of work 


Which APIs would be involved in such a task? How complex could this task be?
Could you give insight with respect to the existing APIs?