I used four RTX3090 graphics cards to train the resnet18 model, but I don’t know why the utilization of one of the graphics cards is always 0.
Following this doc https://github.com/pytorch/examples/tree/master/imagenet to run the following command:
python main.py --arch resnet18 --multiprocessing-distributed --world-size 1 --rank 0 --batch-size 1024 --epochs 90

The GPU utilization results recorded by Grafana are as follows: