Hi @jekbradbury,
I didn’t do the synchronize, but I also noticed that using packing and unpacking with bidirectional RNN makes Pytorch almost 3 times slower than Tensorflow. Does pytorch plan to improve this part?
Thanks!