I’m not deeply familiar with graph networks, so could you explain the use case a bit more? In particular how the number of nodes relates to the batch size, which gives the number of samples?
Is each sample using a different (set of) node(s)?
If so, you won’t be able to concatenate two tensors, which differ in more than a single dimension.