So I dont have access to a GPU  ,but have access to a 25 cluster of Xeon CPUs . Here are my questions :


If I set the number of nodes in qpub to 24 , will PyTorch automatically use all the nodes , because someone earlier said that it relies on Intel MKL and MKL should be able to detect all the CPUs available.


Also , does setting the num_workers take care of automatically distributing the workload  ?