Solved by soulitzer in post #4 
              
              
                No problem! Seems like since you need to update A later using this computed gradient, it actually seems like the vjp IS what you want here. In that case, I wouldn’t worry about the “entire Jacobian” to much and no further action is needed apart from just using .grad(delL_delWo, A), and using a grad_…