I’m using just nn.Linear() and nn.Bilinear() layers so it should be twice differentiable.
Well I’ll be damned, when I do that I get a proper graph:
Screen Shot 2020-10-21 at 11.28.15 AM824×1198 75.5 KB