Optimization, Pytorch, Machine Learning, Deep Learning, Tensorboard.
for portions of the code that take longer than expected. Use torch.profiler.record_function to pinpoint performance issues. Dips in GPU utilization are not necessarily aligned with the source of the performance issue. Look out for unintended data copies from the host to the GPU. These are typically