Solved by albanD in post #4 
              
              
                It might also be a problem with your model not being expressive enough to push the accuracy up? 
But from a pure autograd point of view, I don’t think there is any issue with using scatter.