Ok so does [x.grad for x in list(self.network.parameters())] not give me all the gradients in the network?
Oh… are those the bias vectors after the weight matrices
e.g.
list(self.network.parameters())
[Parameter containing:
 0.2804  0.1939  0.2529
-0.4079 -0.4753 -0.1954
[torch.FloatTensor of size 2x3]
, Parameter containing:
       0.3318
       0.237
  [torch.FloatTensor of size 2]