If seems you are using the Nodes and Timestamps dimensions as the spatial dimension at the moment.
If you just need a 1x2 filter, you could permute and reshape the input, so that Nodes is accumulated in dim0 together with the Batch and apply a nn.Conv1d layer.