Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
found here. We initialize the torch.profiler.schedule with the warmup flag set to 3 and the repeat flag set to 1. We found that this slight increase in the number of warmup steps improves the stability of the profiling results. import numpy as np import torch import torch.nn import torch.optim