Solved by ZdsAlpha in post #2 
              
              
                Set output channels to 64. 
self.conv2d = nn.Sequential(
                nn.Conv2d(1, 64, (3,6), (1, 1)),
                nn.ReLU()
            )

In pytorch channel dimension is second not last