Solved by tom in post #2 
              
              
                (I think you might need a flatten in 1, too.) 
We have a short discussion of the more general number of channels and width in our book (Stevens/Antiga/Viehmann: Deep Learning with PyTorch, Section “8.3.1 Our network as an nn.Module”). 
So the idea behind “channels should increase while width should …