But does this handle the non linearity? In case I have my conv layer as follows:
l1 = F.sigmoid(self.conv1(x))
l2 = F.sigmoid(self.conv2(l1))
...
fc = ... # have set of fc layers using nn.linear and then reconstuct them back by interchanging the input and output dimensions.
reconstruct_2 = F.sigmoid(self.deconv2(fc))
reconstruct_1 = F.sigmoid(self.deconv1(reconstruct_2))
Is the part of reconstruct_2 and reconstruct_1 correct?