Depending on the workload, you might scale down the number of used CPUs via:
MKL_NUM_THREADS=1 OMP_NUM_THREADS=1 python script.py args

and inside your script:
torch.set_num_threads(1)

You might increase the number of threads if this seems to stabilize your system.