Unless the hardware is identical across the machines, I’m not sure that it would be expected that the gradients would be bitwise identical. For example, there might be subtle differences in rounding because different architectures might have kernels that do arithmetic operations (such as reductions) with a different ordering.