Additional discussion of [feature request] Simple and Efficient way to get gradients of each element of a sum 131
@tom I hope I interpreted your last post correctly by posting here.

The code to reproduce the numbers I see is available here 55.
The main.py file runs different ways of computing individual gradients and checks/times them.
Your recommendation seems to be along the line of Goodfellow’s derivation 39, implemented as goodfellow, timing output under goodf.
I don’t think it is a bug per-se, just an inefficient use of things.
I am not sure what you want to look at but I’m happy to discuss the issue