Resolved at On CPU, vectorized float tensor addition might be slower than unvectorized float tensor addition · Issue #60202 · pytorch/pytorch · GitHub 12.
Basically, memory allocation & zero-filling costs are worse for AVX2.