So like a Conv1D with weights of 1 applied to all the shifts of the vector?
i.e.
s_bs = 3
[0, 1, 0, 0, 0]
get all shifts ->
[0, 1, 0, 0, 0, 0, 0] [0, 0, 1, 0, 0, 0, 0] [0, 0, 0, 1, 0, 0, 0]
Conv1D with fixed weights ->
[0, 1, 1, 1, 0, 0, 0]
I was worried fixing the weights of a Conv1D layer would be messier, but I can try that, but wouldn’t it functionally do exactly the same thing as I did?