Solved by ptrblck in post #2 
              
              
                There are multiple possible approaches and it depends how the activation shape is interpreted. 
E.g. using [64, 512, 1, 28] you could squeeze dim3 and use dim4 as the “sequence” dimension (it’s one of the spatial dimension). 
In this case, you could permute the activation so that the linear layer wi…