Pytorch, Optimization, Deep Learning, Artificial Intelligence, Tensorboard.
performance issue. The problem here is that the performance issue occurs in the backward pass which we do not have control over! In particular, we do not have the ability to wrap individual operations in the backward pass with context managers. In theory, one could identify the problematic model