Machine Learning, Pytorch.
Hessian of cross entropy loss and making the mistake of starting with “devolved” notation and stumbling into cumbersome algebra. The “evolved” notation could instead go something like this — Treat logits theta as the parameter and class x as the random variable in one-hot encoding, then softmax can