I see what you mean. Backwards of sum simply expands the tensor to the forward input tensor’s shape, but still has only one memory location allotted.
I guess this means that when reading the sum tensor in backwards, I have to read it taking into account the stride values? (aka all the reads point back to the single memory element?)