Solved by googlebot in post #2 
              
              
                It is TensorExprGroup with the new executor, and these should appear after second invocation (for cuda, cpu fusion is off by default). 
torch._C._jit_set_profiling_executor(False) may also be a good idea with varying shapes.