Solved by eqy in post #4 
              
              
                Interesting, both CPUs have avx2 support and I’m not sure if PyTorch has any avx512 capabilities upstreamed (or in 1.6.0, for that matter). Can you try to see if using double precision initially is a usable workaround? a = torch.ones(512, 512, dtype=torch.float64)