oh wow. Thanks.
Though it seems there isn’t an agreement…and it also seems it depends on the # of gpus! What a nightmare. Is there any heuristic/rough number that always makes things better but doesn’t overload?
I think at this point I don’t care about being optimal, just making it run faster than in the main thread without running the risk of overdoing it.