hi Olaf,
thanks for spotting that, yes i did mean z.view(-1,32,21), but know i haave the following error
output = input.matmul(weight.t())

RuntimeError: size mismatch, m1: [64 x 21], m2: [2 x 672] at C:/w/1/s/tmp_conda_3.7_044431/conda/conda-bld/pytorch_1556686009173/work/aten/src\THC/generic/THCTensorMathBlas.cu:268
commenting out “z = self.decode.relu(self.decode.fc1(z))” (as i am double accounting)
gives this error
File “G:/decoder-test.py”, line 30, in forward
z = z.view(-1, 32, 21)
RuntimeError: shape ‘[-1, 32, 21]’ is invalid for input of size 4