Thanks - I think I understand. I’m guessing that in sequence-first layout, you’d be running the RNNs of each minibatch sample in parallel. It reminds me now of SIMD lanes:
Each column here is like a SIMD lane:
[c,m]
[a,o]
[t,u]
[-,s]
[-,e]