Solved by ptrblck in post #2 
              
              
                I’m not sure about the model architecture. 
Based on your description you are dealing with inputs of [batch_size, 1024] and are unsqueezing this input tensor to create a fake temporal dimension to [batch_size, 1024, 1]. 
If that’s the case, the nn.Conv1d with a kernel size of 1 will be a linear laye…