Hi,
I printed the two involved tensors, their size and stride are like this:
q.stride():  (147456, 576, 1)
q.size():  torch.Size([8, 256, 576])
k.transpose(1, 2).stride():  (147456, 1, 576)
k.transpose(1, 2).size():  torch.Size([8, 576, 256])

Will this warning have negative impact what I want to do, or is there any better way to implement this ?
Since the kernel size of my nn.conv2d (1, 1), is it better for me to use nn.linear ?