I’ve searched why, and it seems to be related to simultaneous multithreading (SMT) and OpenMP. OMP_NUM_THREADS is (num of cpu cores) / 2 by default(?). Is this behavior intended in pytorch? I don’t think that this will help increase performance…