Solved by albanD in post #2 
              
              
                Hi, 
Yes you are correct that when using multiple devices, the accumulation is not forced to run in a specific order. 
A “simple” solution to fix that is to use a custom function that does the copy to the different devices in the forward and the accumulation in the backward (in a fixed order in your…