I’m also struggling to reproduce this issue and haven’t seen it yet.
@Dhorka

are you able to initialize a random tensor on GPU1 directly?
If you are using a larger tensor (let’s say 1 million values), is c still all zeros or does it contain random values (including Inf, NaN)?