I implement my code modified from https://github.com/pytorch/examples/blob/master/imagenet/main.py 1 ,and now I have 2 problems:
1.Dose this code is now the best way to do distribution?
2.How to to write logs? In my opinion, We should find the major process and wrtie, but could the mp.spawn can do this?
Many thanks to your replies!