Hi!
I am interested in possibly using Ignite to enable distributed training in CPU’s (since I am training a shallow network and have no GPU"s available). I tried using ignite.distributed with the gloo backend, but when I set nproc_per_node to more than 1, the program gets stuck and doesn’t run (it does without setting nproc_per_node). The code is practically the same as the CIFAR example 2.
My question is, is it possible to train PyTorch models on multiple CPU’s be it with or without Ignite?
Thanks in advance!