mMagmer:

nn.Sequential(nn.Linear(2,6),
                      nn.Sigmoid(),
                      nn.Linear(6,1),
                      nn.Sigmoid())



Hey, thanks for your help. The file is a few hundred lines long and does a lot with the model object which breaks if I change it to this sequential method, mostly regarding getting weights into the network. I will try and get it to work with this method but think I have narrowed the problem down to the loss.backwards() not updating the gradients being the problem.