I’m assuming that “example” in mp.spawn is the run_inference function?

Yes, that’s a typo. Fixed now.

Also, is it possible to make each GPU run multiple processes or no?

Running multiple processes on each GPU will be slower, so not recommended IMO.