I see, thanks! So it’s impossible to have multiple set of duplicated weights for a given batch of inputs on the current version of PyTorch.
I assume it’s technically feasible, since weights will be loaded into separate CUDA cores prior to concurrent processing of different inputs. Am I right on this part?