Probably then new runtime could handle also multiple streams:
https://groups.google.com/a/tensorflow.org/g/tfrt/c/gTfSwZexVQk 1
But as It seems to depend also on the compiler we need to ask to other team members. /cc @markdaoust @Mehdi_AMINI @Jacques_Pienaar