Hello, I am working on training different models on the four gpus I have, and there is something I do not understand in the display from nvidia-smi.
Here is what I get :
+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      7126      C   python                                      5773MiB |
|    0      8866      C   python                                       343MiB |
|    0      9130      C   python                                       343MiB |
|    1      8866      C   python                                      5773MiB |
|    2      9130      C   python                                      5773MiB |
+-----------------------------------------------------------------------------+

I am currently using only 3 gpus, but what I don’t understand is why there seems to be an extra python process on the first gpu (0), using 343 MiB. They appear only if I’m also training models on the 1 and 2 gpus, not if I’m only using gpu 0, the ouput becoming then just the first line with the 5773MiB being used.
It’s not currently a problem but I would like to understand why this is so, and if that may be a sign of me doing something wrong.
I am not working with DataParallel or multiprocessing, these are just three separate models on separate processes and normally separate gpus.
Thank you in advance for your answers and indications.
Have a good day !