Hi,
I have come across numerous discussion that PyTorch JIT can fuse pointwise ops like layernorm, softmax etc and provide higher performance. Yet it seems most of the layers that do point ops do not use the JIT support  for point op fusing by default. For example, when I call nn.LayerNorm, I do not see any fusion happening.
What is the reason for this and how can we use JIT support on existing layers without rebuilding pytorch?.