@apaszke would definitely be open to suggestions in this direction! The data that I’ve worked with has batches that look closer to something like:
0010011
0000111

Where everything marked 1 at a timestep is involved in a batched RNN op. Not clear to me how to get away without using torch.chunk.
Here’s another example:
001001001001111
000011100001111
000001110001111
000000011111111