@jekbradbury Will batch_first=True be the standard way of using DataParallel with RNNs going on? Haven’t been able to use it with this setting, but if this will be the standard way moving forward I might as well learn how to do it  It would also be nice to have it documented somewhere. Thanks.