Optimization, Pytorch, Machine Learning, Deep Learning, Tensorboard.
and that it is likely to be related to copying tensors from the host to the GPU. However, this might not be enough to identify the precise line of code that is causing the issue. To facilitate our search we will wrap each line of code with a labeled torch.profiler.record_function context manager