When I use DDP package to train imagenet, there are always OOM problem.
I check the GPU utilization and I found there are many processes on each GPU ？
What is the reason and how can I avoid this problem ?