Hello,
The code is a modification of the example.
self.ag_rrefs creates instances of “Agent”. If I have world-size 3 I will create 1 master and 2 Agents. Each agent will be assigned to a certain GPU.
What I would like to do is to have an agent per GPU and then the environment in the CPU.