Softplus already has support for double backward in the master branch 22, and it will be present in the next release.
If you need it now, you can compile from master following the instructions in https://github.com/pytorch/pytorch#from-source 7