mkserge:

Second point it, it should still be possible to access different GPU instances (across different GPUs) with explicitly setting the CUDA_VISIBLE_DEVICES like
CUDA_VISIBLE_DEVICES=MIG-GPU-15b2013a-3a22-6ae2-eae9-967e9bda9007/7/0
It’s just that you cannot set several at a time. But you can use one per process.
Is my understanding right?


That’s also my understanding. You are able to use a MIG instance in a separate process (otherwise you would basically remove all other MIG instances from the node), but other compute instances won’t be visible in this process.