Pytorch, Optimization, Deep Learning, Artificial Intelligence, Tensorboard.
torch.gather backward pass. As it turns out, it is precisely this change that causes the need for a sync event. Indeed, if we remove this configuration, the performance issue disappears! The question is, can we maintain the algorithm determinism without needing to pay a performance penalty. In the