hughperkins:

However reduce all, in its current implementation, returns a scalar float, rather than a tensor. This forces a sync point.


That’s exactly what I wondered. I didn’t even know sum returns float.
Thanks!