You should feed the output of the first linear layer into the second one:
out = F.relu(self.linear1(x))
self.outputs['layer1'].append(out)
out = F.relu(self.linear2(out))

The second layer is expecting and input of * x 100 and you are feeding it * x 20