Yeah, so I don’t think any way to directly generate just the diagonal unless you have special properties you know about (like "only the ith input influences the ith output as we - except for batch norm - have in minibatches).