My understanding from reading the PyTorch XLA documentation 12 is that xmp.spawn() is used for multi-TPU processing. For single-TPU training, you only need to define device correctly. The difference is also shown in the PyTorch example code for single-core AlexNet 5 and multi-core AlexNet 10 training.
At this time, I’m interested in just single-TPU execution.