Are GPU and CPU random seeds independent?
<SCODE>torch.manual_seed(args.seed)
if args.cuda:
    torch.cuda.manual_seed(args.seed)
<ECODE> torch.manual_seed(args.seed) sufficient?
rasbt
It is sufficient for CPU determinism, but it won’t affect the GPU PRNG state. We’ve been thinking about merging these two, and we’ll probably do so in the future.
apaszke
Thanks! And merging them in future sounds like a good idea.
rasbt
Agree, less chance for mysterious inconsistency for programmers who’re not aware of this.
Alex_Choy