Hi, @ptrblck,
Thanks for the quick response.
MyModel does not directly call either  torch.Tensor.index_add_() ,  torch.Tensor.scatter_add_() ,  torch.bincount() ,
 torch.nn.functional.embedding_bag() , or
 torch.nn.functional.ctc_loss() .
However MyModel calls such as nn.LSTM, nn.Linear, nn.Embedding, torch.sigmoid, torch.max, torch.sum, and torch.pow.
Do you mean some of the functions MyModel calls could contain atomicAdd inside, and causing the problem?
If so, do you mean there is no fix so far?