Hi,
Unless the hessian is already a diagonal matrix (from the structure of your network), which is very unlikely if you’re using a CNN, then it’s not really possible to do compute this “quickly”.
You can try package like this one 52 though that will allow you to compute them approximately faster.