I am trying to process an image in non-overlapping tiles (partitions), and then compute the loss on the entire image. What this entails is a forward pass of a batch of partitions, the recomposition of the image (i.e. put them together like a jigsaw puzzle), and then computing the loss. Now when I backpropagate, I imagine I need to “wire” the pixels from the partitions to their corresponding location in the full image. How can I do that? The operation is essentially just a copy plus pixel coordinate shifts. Does the dynamic graph handle this automatically?
This seems resolvable in a similar way to the data distributed module.