Pytorch, Optimization, Deep Learning, Artificial Intelligence, Tensorboard.
performance problem is the PathDropout module. Examining the forward function of the module, we can indeed see a call to torch.gather. In the case of our toy model, we needed just two iterations of analysis in order to zone in on the source of the performance issue. In practice, it is likely that