I tried to do every possibe to solve this issue but I could not, I am not really If I am applying the downsample the right way
res shape torch.Size([2, 160, 32, 32])
x in binActive torch.Size([2, 160, 32, 32])
x after the conv  torch.Size([2, 96, 32, 32])
The size of tensor a (96) must match the size of tensor b (160) at non-singleton dimension 1
Thanks