You could use the depth dimension to stack a sequence of images. Note however, that the kernels in each conv layer would also have a depth dimension and would thus convolve through it as well (unless you set the kernel size to 1 for the depth).
Often nn.Conv3d is used on a “stack” of images, such as medical CT scans using slices for the depth dimension.
Depending on your use case, the same approach might also work for your “sequences”.