Hi, I have tried directly use parallel_for in ATen/ParallelOpenMP.h. Works for me. You can try this if you want to use OpenMP parallel, just specify your compiler extra_compile_args with -fopenmp and extra_link_args with -lgomp.