I’m struggling to adapt the actor-critic example for a single machine multi-gpu setup.
Here’s a gist 6 of what I’m working with (or all of the code that seems relevant; note that that won’t compile due to private reward and action classes).
Current failure is a size mismatch on line 55: RuntimeError: size mismatch, m1: [1 x 43], m2: [128 x 256] which tells me it’s splitting something into 3 parts (128/3 = ~ 43).
Any feedback would be great as I’m new to splitting things up on multi-GPUs and new to Pytorch in general.