Hi Thomas
Thanks a lot for your answer! It is actually doing it correctly and much faster. I dont know how did you figure it out, but I really appreciate it anyways.
can I ask what is the strategy behind choosing 6 and :4 and ::2 in .unfold(1, 6, 1)[:,:4,::2] like how should they change for another step (e.g 8).
Just since you asked why I want to do it, I am trying to develop something similar to slide window for attention. but I am not sure if it gonna work yet